2023-11-20T06:44:39.796 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-20T06:44:39.796 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --name vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi --verbose --archive /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} -- /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037/orig.config.yaml 2023-11-20T06:44:39.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-20T06:44:39.925 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037 branch: wip-57087-3 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} email: vshankar@redhat.com first_in_suite: false job_id: '7463037' kernel: flavor: default kdb: true sha1: 7678e1afe51c4ac0c30e2c032e042c836160928a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-57087-3 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - inconsistent rstat on inode - Error recovering journal sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-57087-3 sha1: dc2d87c1fc8f518422f0be9931df0b31dc6a3bad owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9639 sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 sleep_before_teardown: 0 suite: fs suite_branch: wip-57087-3 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: dc2d87c1fc8f518422f0be9931df0b31dc6a3bad syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNzpL51gNqz4xUF966H1QvQlmp/+VMXN2RIlr8gUZDJyno4913EymWp34c045bEN3w/DhhH1V92xmMb/ODu7+3o= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHBmbQcfoU3kC5OuxqTXMlJhKGIZNquLGok3zXFwFEXkZ0hbRaPVhbglq261RhnLLHH/qK6ZOo1dnjrl+PqeFBc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-20_06:01:31 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-20T06:44:39.925 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa; will attempt to use it 2023-11-20T06:44:39.926 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa/tasks 2023-11-20T06:44:39.926 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-20T06:44:39.928 INFO:teuthology.task.internal:Checking packages... 2023-11-20T06:44:39.952 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '895e5adad9a763a0f13587c485b17f1ad3f04528' 2023-11-20T06:44:39.952 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-20T06:44:39.952 INFO:teuthology.packaging:ref: None 2023-11-20T06:44:39.952 INFO:teuthology.packaging:tag: None 2023-11-20T06:44:39.952 INFO:teuthology.packaging:branch: wip-57087-3 2023-11-20T06:44:39.952 INFO:teuthology.packaging:sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-20T06:44:39.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-57087-3 2023-11-20T06:44:40.098 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:44:40.098 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-20T06:44:40.105 INFO:teuthology.task.internal:no buildpackages task found 2023-11-20T06:44:40.105 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-20T06:44:40.116 INFO:teuthology.task.internal:Saving configuration 2023-11-20T06:44:40.131 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-20T06:44:40.138 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-20T06:44:40.166 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-20 06:38:32.304625', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINPdf64r2XmDwaEIf1af/tWdwwfebunM/DlLpo6rZ9ZQ'} 2023-11-20T06:44:40.183 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-20 06:38:32.302870', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJTxXqOJxpIlVa778wDeLMMybwQarDYkYDF00vQm5UgJ'} 2023-11-20T06:44:40.184 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-20T06:44:40.190 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-20T06:44:40.191 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-20T06:44:40.191 INFO:teuthology.run_tasks:Running task console_log... 2023-11-20T06:44:40.261 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1d22974f70>, signals=[15]) 2023-11-20T06:44:40.261 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-20T06:44:40.268 INFO:teuthology.task.internal:Opening connections... 2023-11-20T06:44:40.268 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T06:44:40.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:44:40.344 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T06:44:40.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:44:40.419 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-20T06:44:40.426 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-11-20T06:44:40.431 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-11-20T06:44:40.431 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-11-20T06:44:40.478 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-20T06:44:40.478 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2023-11-20T06:44:40.478 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="22.04" 2023-11-20T06:44:40.479 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-20T06:44:40.479 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=jammy 2023-11-20T06:44:40.479 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2023-11-20T06:44:40.479 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2023-11-20T06:44:40.479 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-20T06:44:40.479 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-20T06:44:40.479 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-20T06:44:40.479 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-20T06:44:40.479 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=jammy 2023-11-20T06:44:40.480 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-11-20T06:44:40.498 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-11-20T06:44:40.503 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-11-20T06:44:40.503 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-11-20T06:44:40.550 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-20T06:44:40.550 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Ubuntu" 2023-11-20T06:44:40.550 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="22.04" 2023-11-20T06:44:40.550 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-20T06:44:40.550 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_CODENAME=jammy 2023-11-20T06:44:40.551 INFO:teuthology.orchestra.run.smithi175.stdout:ID=ubuntu 2023-11-20T06:44:40.551 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE=debian 2023-11-20T06:44:40.551 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-20T06:44:40.551 INFO:teuthology.orchestra.run.smithi175.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-20T06:44:40.551 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-20T06:44:40.551 INFO:teuthology.orchestra.run.smithi175.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-20T06:44:40.551 INFO:teuthology.orchestra.run.smithi175.stdout:UBUNTU_CODENAME=jammy 2023-11-20T06:44:40.551 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-11-20T06:44:40.572 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-20T06:44:40.582 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-20T06:44:40.588 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-20T06:44:40.588 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2023-11-20T06:44:40.590 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2023-11-20T06:44:40.597 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-20T06:44:40.603 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-20T06:44:40.604 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2023-11-20T06:44:40.636 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2023-11-20T06:44:40.659 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-20T06:44:40.713 INFO:teuthology.run_tasks:Running task kernel... 2023-11-20T06:44:40.727 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '7678e1afe51c4ac0c30e2c032e042c836160928a'} 2023-11-20T06:44:40.727 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '7678e1afe51c4ac0c30e2c032e042c836160928a'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '7678e1afe51c4ac0c30e2c032e042c836160928a'}}, timeout 300 2023-11-20T06:44:40.728 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-20T06:44:40.728 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-20T06:44:40.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:44:40.732 DEBUG:teuthology.task.kernel:sha1 for mon.a is 7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:44:40.733 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "7678e1afe51c4ac0c30e2c032e042c836160928a"... 2023-11-20T06:44:40.733 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-11-20T06:44:40.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:44:40.734 DEBUG:teuthology.task.kernel:sha1 for mon.b is 7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:44:40.734 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "7678e1afe51c4ac0c30e2c032e042c836160928a"... 2023-11-20T06:44:40.734 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2023-11-20T06:44:40.779 INFO:teuthology.orchestra.run.smithi088.stdout:5.15.0-56-generic 2023-11-20T06:44:40.779 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:44:40.780 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-20T06:44:40.780 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:44:40.784 INFO:teuthology.orchestra.run.smithi175.stdout:5.15.0-56-generic 2023-11-20T06:44:40.784 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:44:40.784 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-20T06:44:40.785 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:44:40.930 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-11-20T06:44:40.930 DEBUG:teuthology.orchestra.run.smithi175:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-20T06:44:40.949 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-20T06:44:40.996 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-11-20T06:44:40.996 DEBUG:teuthology.orchestra.run.smithi088:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-20T06:44:41.018 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-20T06:44:41.086 INFO:teuthology.orchestra.run.smithi175.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-20T06:44:41.086 INFO:teuthology.orchestra.run.smithi175.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-20T06:44:41.086 INFO:teuthology.orchestra.run.smithi175.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-20T06:44:41.087 INFO:teuthology.orchestra.run.smithi175.stderr:hint: 2023-11-20T06:44:41.087 INFO:teuthology.orchestra.run.smithi175.stderr:hint: git config --global init.defaultBranch 2023-11-20T06:44:41.087 INFO:teuthology.orchestra.run.smithi175.stderr:hint: 2023-11-20T06:44:41.087 INFO:teuthology.orchestra.run.smithi175.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-20T06:44:41.087 INFO:teuthology.orchestra.run.smithi175.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-20T06:44:41.087 INFO:teuthology.orchestra.run.smithi175.stderr:hint: 2023-11-20T06:44:41.087 INFO:teuthology.orchestra.run.smithi175.stderr:hint: git branch -m 2023-11-20T06:44:41.087 INFO:teuthology.orchestra.run.smithi175.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-20T06:44:41.089 DEBUG:teuthology.orchestra.run.smithi175:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-20T06:44:41.150 INFO:teuthology.orchestra.run.smithi088.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-20T06:44:41.150 INFO:teuthology.orchestra.run.smithi088.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-20T06:44:41.150 INFO:teuthology.orchestra.run.smithi088.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-20T06:44:41.150 INFO:teuthology.orchestra.run.smithi088.stderr:hint: 2023-11-20T06:44:41.150 INFO:teuthology.orchestra.run.smithi088.stderr:hint: git config --global init.defaultBranch 2023-11-20T06:44:41.150 INFO:teuthology.orchestra.run.smithi088.stderr:hint: 2023-11-20T06:44:41.150 INFO:teuthology.orchestra.run.smithi088.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-20T06:44:41.150 INFO:teuthology.orchestra.run.smithi088.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-20T06:44:41.150 INFO:teuthology.orchestra.run.smithi088.stderr:hint: 2023-11-20T06:44:41.151 INFO:teuthology.orchestra.run.smithi088.stderr:hint: git branch -m 2023-11-20T06:44:41.151 INFO:teuthology.orchestra.run.smithi088.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-20T06:44:41.153 DEBUG:teuthology.orchestra.run.smithi088:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-20T06:44:41.155 DEBUG:teuthology.orchestra.run.smithi175:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-20T06:44:41.215 DEBUG:teuthology.orchestra.run.smithi175:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-20T06:44:41.228 DEBUG:teuthology.orchestra.run.smithi088:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-20T06:44:41.283 DEBUG:teuthology.orchestra.run.smithi088:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-20T06:45:22.829 INFO:teuthology.orchestra.run.smithi088.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-20T06:45:22.829 INFO:teuthology.orchestra.run.smithi088.stderr: * [new branch] main -> origin/main 2023-11-20T06:45:22.859 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190312 -> 20190312 2023-11-20T06:45:22.859 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190416 -> 20190416 2023-11-20T06:45:22.859 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190514 -> 20190514 2023-11-20T06:45:22.860 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190618 -> 20190618 2023-11-20T06:45:22.860 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190717 -> 20190717 2023-11-20T06:45:22.860 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190815 -> 20190815 2023-11-20T06:45:22.860 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20190923 -> 20190923 2023-11-20T06:45:22.860 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20191022 -> 20191022 2023-11-20T06:45:22.861 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20191215 -> 20191215 2023-11-20T06:45:22.861 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200122 -> 20200122 2023-11-20T06:45:22.861 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200316 -> 20200316 2023-11-20T06:45:22.862 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200421 -> 20200421 2023-11-20T06:45:22.862 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200519 -> 20200519 2023-11-20T06:45:22.862 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200619 -> 20200619 2023-11-20T06:45:22.862 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200721 -> 20200721 2023-11-20T06:45:22.862 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200817 -> 20200817 2023-11-20T06:45:22.863 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20200918 -> 20200918 2023-11-20T06:45:22.863 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20201022 -> 20201022 2023-11-20T06:45:22.863 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20201118 -> 20201118 2023-11-20T06:45:22.863 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20201218 -> 20201218 2023-11-20T06:45:22.863 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210208 -> 20210208 2023-11-20T06:45:22.863 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210315 -> 20210315 2023-11-20T06:45:22.863 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210511 -> 20210511 2023-11-20T06:45:22.864 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210716 -> 20210716 2023-11-20T06:45:22.864 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210818 -> 20210818 2023-11-20T06:45:22.865 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20210919 -> 20210919 2023-11-20T06:45:22.865 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20211027 -> 20211027 2023-11-20T06:45:22.865 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20211216 -> 20211216 2023-11-20T06:45:22.865 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220209 -> 20220209 2023-11-20T06:45:22.865 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220310 -> 20220310 2023-11-20T06:45:22.865 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220411 -> 20220411 2023-11-20T06:45:22.866 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220509 -> 20220509 2023-11-20T06:45:22.866 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220610 -> 20220610 2023-11-20T06:45:22.866 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220708 -> 20220708 2023-11-20T06:45:22.866 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220815 -> 20220815 2023-11-20T06:45:22.866 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20220913 -> 20220913 2023-11-20T06:45:22.866 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20221012 -> 20221012 2023-11-20T06:45:22.866 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20221109 -> 20221109 2023-11-20T06:45:22.867 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20221214 -> 20221214 2023-11-20T06:45:22.868 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230117 -> 20230117 2023-11-20T06:45:22.868 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230210 -> 20230210 2023-11-20T06:45:22.868 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230310 -> 20230310 2023-11-20T06:45:22.868 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230404 -> 20230404 2023-11-20T06:45:22.868 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230515 -> 20230515 2023-11-20T06:45:22.868 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230625 -> 20230625 2023-11-20T06:45:22.868 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230804 -> 20230804 2023-11-20T06:45:22.868 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20230919 -> 20230919 2023-11-20T06:45:22.869 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20231030 -> 20231030 2023-11-20T06:45:22.869 INFO:teuthology.orchestra.run.smithi088.stderr: * [new tag] 20231111 -> 20231111 2023-11-20T06:45:26.871 INFO:teuthology.orchestra.run.smithi088.stderr:Updating files: 49% (1615/3248) Updating files: 50% (1624/3248) Updating files: 51% (1657/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 64% (2097/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2644/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-20T06:45:26.876 INFO:teuthology.orchestra.run.smithi088.stdout:HEAD is now at 7124ce30 Merge branch 'mlimonci/encoding' into 'main' 2023-11-20T06:45:26.897 INFO:teuthology.task.kernel:Downloading kernel 7678e1afe51c4ac0c30e2c032e042c836160928a on mon.a... 2023-11-20T06:45:26.897 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:45:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-20T06:45:27.088 INFO:teuthology.orchestra.run.smithi175.stderr: * [new branch] main -> origin/main 2023-11-20T06:45:27.125 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7678e1afe51c4ac0c30e2c032e042c836160928a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g7678e1afe51c/ 2023-11-20T06:45:27.125 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g7678e1afe51c_6.6.0-g7678e1afe51c-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/7678e1afe51c4ac0c30e2c032e042c836160928a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g7678e1afe51c/ --input-file=- 2023-11-20T06:45:27.129 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190312 -> 20190312 2023-11-20T06:45:27.129 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190416 -> 20190416 2023-11-20T06:45:27.129 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190514 -> 20190514 2023-11-20T06:45:27.129 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190618 -> 20190618 2023-11-20T06:45:27.130 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190717 -> 20190717 2023-11-20T06:45:27.130 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190815 -> 20190815 2023-11-20T06:45:27.130 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190923 -> 20190923 2023-11-20T06:45:27.130 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20191022 -> 20191022 2023-11-20T06:45:27.130 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20191215 -> 20191215 2023-11-20T06:45:27.131 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200122 -> 20200122 2023-11-20T06:45:27.131 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200316 -> 20200316 2023-11-20T06:45:27.131 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200421 -> 20200421 2023-11-20T06:45:27.131 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200519 -> 20200519 2023-11-20T06:45:27.131 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200619 -> 20200619 2023-11-20T06:45:27.131 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200721 -> 20200721 2023-11-20T06:45:27.132 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200817 -> 20200817 2023-11-20T06:45:27.132 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200918 -> 20200918 2023-11-20T06:45:27.132 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20201022 -> 20201022 2023-11-20T06:45:27.132 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20201118 -> 20201118 2023-11-20T06:45:27.132 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20201218 -> 20201218 2023-11-20T06:45:27.133 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20210208 -> 20210208 2023-11-20T06:45:27.133 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20210315 -> 20210315 2023-11-20T06:45:27.133 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20210511 -> 20210511 2023-11-20T06:45:27.133 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20210716 -> 20210716 2023-11-20T06:45:27.133 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20210818 -> 20210818 2023-11-20T06:45:27.134 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20210919 -> 20210919 2023-11-20T06:45:27.134 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20211027 -> 20211027 2023-11-20T06:45:27.134 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20211216 -> 20211216 2023-11-20T06:45:27.134 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220209 -> 20220209 2023-11-20T06:45:27.134 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220310 -> 20220310 2023-11-20T06:45:27.135 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220411 -> 20220411 2023-11-20T06:45:27.135 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220509 -> 20220509 2023-11-20T06:45:27.139 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220610 -> 20220610 2023-11-20T06:45:27.139 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220708 -> 20220708 2023-11-20T06:45:27.139 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220815 -> 20220815 2023-11-20T06:45:27.139 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220913 -> 20220913 2023-11-20T06:45:27.139 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20221012 -> 20221012 2023-11-20T06:45:27.140 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20221109 -> 20221109 2023-11-20T06:45:27.140 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20221214 -> 20221214 2023-11-20T06:45:27.140 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230117 -> 20230117 2023-11-20T06:45:27.140 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230210 -> 20230210 2023-11-20T06:45:27.140 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230310 -> 20230310 2023-11-20T06:45:27.141 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230404 -> 20230404 2023-11-20T06:45:27.141 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230515 -> 20230515 2023-11-20T06:45:27.141 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230625 -> 20230625 2023-11-20T06:45:27.141 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230804 -> 20230804 2023-11-20T06:45:27.141 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230919 -> 20230919 2023-11-20T06:45:27.142 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20231030 -> 20231030 2023-11-20T06:45:27.142 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20231111 -> 20231111 2023-11-20T06:45:27.143 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi088.front.sepia.ceph.com to complete... 2023-11-20T06:45:28.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20 06:45:28 URL:https://2.chacra.ceph.com/r/kernel/testing/7678e1afe51c4ac0c30e2c032e042c836160928a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g7678e1afe51c/linux-image-6.6.0-g7678e1afe51c_6.6.0-g7678e1afe51c-1_amd64.deb [38913850/38913850] -> "/tmp/linux-image.deb" [1] 2023-11-20T06:45:28.716 INFO:teuthology.orchestra.run.smithi088.stderr:FINISHED --2023-11-20 06:45:28-- 2023-11-20T06:45:28.716 INFO:teuthology.orchestra.run.smithi088.stderr:Total wall clock time: 1.5s 2023-11-20T06:45:28.716 INFO:teuthology.orchestra.run.smithi088.stderr:Downloaded: 1 files, 37M in 1.4s (27.3 MB/s) 2023-11-20T06:45:28.719 INFO:teuthology.task.kernel:Installing kernel 7678e1afe51c4ac0c30e2c032e042c836160928a on mon.a... 2023-11-20T06:45:28.719 DEBUG:teuthology.orchestra.run.smithi088:> sudo dpkg -i /tmp/linux-image.deb 2023-11-20T06:45:28.991 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-image-6.6.0-g7678e1afe51c. 2023-11-20T06:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-20T06:45:30.942 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-20T06:45:31.049 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-image-6.6.0-g7678e1afe51c (6.6.0-g7678e1afe51c-1) ... 2023-11-20T06:45:31.134 INFO:teuthology.orchestra.run.smithi175.stderr:Updating files: 50% (1624/3248) Updating files: 51% (1657/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 64% (2099/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2644/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-20T06:45:31.139 INFO:teuthology.orchestra.run.smithi175.stdout:HEAD is now at 7124ce30 Merge branch 'mlimonci/encoding' into 'main' 2023-11-20T06:45:31.159 INFO:teuthology.task.kernel:Downloading kernel 7678e1afe51c4ac0c30e2c032e042c836160928a on mon.b... 2023-11-20T06:45:31.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7678e1afe51c4ac0c30e2c032e042c836160928a 2023-11-20T06:45:31.297 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7678e1afe51c4ac0c30e2c032e042c836160928a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g7678e1afe51c/ 2023-11-20T06:45:31.298 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g7678e1afe51c_6.6.0-g7678e1afe51c-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/7678e1afe51c4ac0c30e2c032e042c836160928a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g7678e1afe51c/ --input-file=- 2023-11-20T06:45:31.300 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi175.front.sepia.ceph.com to complete... 2023-11-20T06:45:32.844 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20 06:45:32 URL:https://2.chacra.ceph.com/r/kernel/testing/7678e1afe51c4ac0c30e2c032e042c836160928a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g7678e1afe51c/linux-image-6.6.0-g7678e1afe51c_6.6.0-g7678e1afe51c-1_amd64.deb [38913850/38913850] -> "/tmp/linux-image.deb" [1] 2023-11-20T06:45:32.844 INFO:teuthology.orchestra.run.smithi175.stderr:FINISHED --2023-11-20 06:45:32-- 2023-11-20T06:45:32.844 INFO:teuthology.orchestra.run.smithi175.stderr:Total wall clock time: 1.5s 2023-11-20T06:45:32.844 INFO:teuthology.orchestra.run.smithi175.stderr:Downloaded: 1 files, 37M in 1.4s (26.9 MB/s) 2023-11-20T06:45:32.847 INFO:teuthology.task.kernel:Installing kernel 7678e1afe51c4ac0c30e2c032e042c836160928a on mon.b... 2023-11-20T06:45:32.847 DEBUG:teuthology.orchestra.run.smithi175:> sudo dpkg -i /tmp/linux-image.deb 2023-11-20T06:45:33.145 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-image-6.6.0-g7678e1afe51c. 2023-11-20T06:45:34.426 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-image-6.6.0-g7678e1afe51c (6.6.0-g7678e1afe51c-1) ... 2023-11-20T06:45:34.533 INFO:teuthology.orchestra.run.smithi088.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g7678e1afe51c 2023-11-20T06:45:35.054 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-20T06:45:35.059 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-20T06:45:35.205 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-image-6.6.0-g7678e1afe51c (6.6.0-g7678e1afe51c-1) ... 2023-11-20T06:45:38.661 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-image-6.6.0-g7678e1afe51c (6.6.0-g7678e1afe51c-1) ... 2023-11-20T06:45:38.768 INFO:teuthology.orchestra.run.smithi175.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g7678e1afe51c 2023-11-20T06:45:55.206 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub' 2023-11-20T06:45:55.224 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-20T06:45:55.267 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2023-11-20T06:45:55.588 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-6.6.0-g7678e1afe51c 2023-11-20T06:45:55.603 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-6.6.0-g7678e1afe51c 2023-11-20T06:45:56.002 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-20T06:45:56.013 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-20T06:45:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-20T06:45:56.086 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-20T06:45:56.244 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-20T06:45:56.245 INFO:teuthology.orchestra.run.smithi088.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-20T06:45:56.245 INFO:teuthology.orchestra.run.smithi088.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-20T06:45:56.298 INFO:teuthology.orchestra.run.smithi088.stderr:done 2023-11-20T06:45:56.454 DEBUG:teuthology.orchestra.run.smithi088:> dpkg-deb -c /tmp/linux-image.deb 2023-11-20T06:45:56.462 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./ 2023-11-20T06:45:56.462 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./boot/ 2023-11-20T06:45:56.462 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 4415617 2023-11-20 01:52 ./boot/System.map-6.6.0-g7678e1afe51c 2023-11-20T06:45:56.474 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 169214 2023-11-20 01:52 ./boot/config-6.6.0-g7678e1afe51c 2023-11-20T06:45:56.475 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11352928 2023-11-20 01:52 ./boot/vmlinuz-6.6.0-g7678e1afe51c 2023-11-20T06:45:56.493 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/ 2023-11-20T06:45:56.493 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/ 2023-11-20T06:45:56.493 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/postinst.d/ 2023-11-20T06:45:56.493 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/postrm.d/ 2023-11-20T06:45:56.493 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/preinst.d/ 2023-11-20T06:45:56.494 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/prerm.d/ 2023-11-20T06:45:56.494 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/ 2023-11-20T06:45:56.494 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/ 2023-11-20T06:45:56.494 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/ 2023-11-20T06:45:56.494 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/ 2023-11-20T06:45:56.494 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/ 2023-11-20T06:45:56.494 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/ 2023-11-20T06:45:56.494 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/ 2023-11-20T06:45:56.494 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 490233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-20T06:45:56.496 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-20T06:45:56.496 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-20T06:45:56.497 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-20T06:45:56.497 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 93113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-20T06:45:56.497 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 106729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-20T06:45:56.497 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 152241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-20T06:45:56.497 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-20T06:45:56.497 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-20T06:45:56.497 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-20T06:45:56.497 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-20T06:45:56.497 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-20T06:45:56.497 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-20T06:45:56.497 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-20T06:45:56.497 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-20T06:45:56.498 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-20T06:45:56.498 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-20T06:45:56.498 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-20T06:45:56.498 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-20T06:45:56.498 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-20T06:45:56.498 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/ 2023-11-20T06:45:56.498 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpu/ 2023-11-20T06:45:56.498 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpu/mce/ 2023-11-20T06:45:56.498 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-20T06:45:56.498 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpuid.ko 2023-11-20T06:45:56.498 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/msr.ko 2023-11-20T06:45:56.498 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/ 2023-11-20T06:45:56.499 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 354433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-20T06:45:56.499 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 881625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-20T06:45:56.499 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2275865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/kvm.ko 2023-11-20T06:45:56.525 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/ 2023-11-20T06:45:56.525 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/af_alg.ko 2023-11-20T06:45:56.525 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/algif_hash.ko 2023-11-20T06:45:56.525 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/algif_skcipher.ko 2023-11-20T06:45:56.525 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/ansi_cprng.ko 2023-11-20T06:45:56.525 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/anubis.ko 2023-11-20T06:45:56.525 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/arc4.ko 2023-11-20T06:45:56.525 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/asymmetric_keys/ 2023-11-20T06:45:56.526 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-20T06:45:56.526 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/ 2023-11-20T06:45:56.526 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_memcpy.ko 2023-11-20T06:45:56.526 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_pq.ko 2023-11-20T06:45:56.526 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-20T06:45:56.526 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_tx.ko 2023-11-20T06:45:56.526 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_xor.ko 2023-11-20T06:45:56.526 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/raid6test.ko 2023-11-20T06:45:56.526 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/authenc.ko 2023-11-20T06:45:56.526 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/authencesn.ko 2023-11-20T06:45:56.526 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/blake2b_generic.ko 2023-11-20T06:45:56.526 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/blowfish_common.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/blowfish_generic.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/camellia_generic.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cast5_generic.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cast6_generic.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cast_common.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/ccm.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cmac.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crc32_generic.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cryptd.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crypto_engine.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crypto_simd.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crypto_user.ko 2023-11-20T06:45:56.527 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cts.ko 2023-11-20T06:45:56.528 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/des_generic.ko 2023-11-20T06:45:56.528 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/dh_generic.ko 2023-11-20T06:45:56.528 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/echainiv.ko 2023-11-20T06:45:56.528 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/essiv.ko 2023-11-20T06:45:56.528 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/fcrypt.ko 2023-11-20T06:45:56.528 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/khazad.ko 2023-11-20T06:45:56.528 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/lrw.ko 2023-11-20T06:45:56.528 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/lz4.ko 2023-11-20T06:45:56.528 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/lz4hc.ko 2023-11-20T06:45:56.528 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/md4.ko 2023-11-20T06:45:56.528 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/michael_mic.ko 2023-11-20T06:45:56.528 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/pcbc.ko 2023-11-20T06:45:56.529 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/pcrypt.ko 2023-11-20T06:45:56.529 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/rmd160.ko 2023-11-20T06:45:56.529 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/seed.ko 2023-11-20T06:45:56.529 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/serpent_generic.ko 2023-11-20T06:45:56.529 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 149193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/tcrypt.ko 2023-11-20T06:45:56.529 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/tea.ko 2023-11-20T06:45:56.529 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/twofish_common.ko 2023-11-20T06:45:56.529 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/twofish_generic.ko 2023-11-20T06:45:56.529 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/vmac.ko 2023-11-20T06:45:56.529 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/wp512.ko 2023-11-20T06:45:56.529 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xcbc.ko 2023-11-20T06:45:56.529 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xor.ko 2023-11-20T06:45:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xts.ko 2023-11-20T06:45:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xxhash_generic.ko 2023-11-20T06:45:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ 2023-11-20T06:45:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/ 2023-11-20T06:45:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/acpi_extlog.ko 2023-11-20T06:45:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-20T06:45:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/acpi_pad.ko 2023-11-20T06:45:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/apei/ 2023-11-20T06:45:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/apei/einj.ko 2023-11-20T06:45:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/ec_sys.ko 2023-11-20T06:45:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/platform_profile.ko 2023-11-20T06:45:56.530 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/sbs.ko 2023-11-20T06:45:56.531 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/sbshc.ko 2023-11-20T06:45:56.531 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/video.ko 2023-11-20T06:45:56.531 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/ 2023-11-20T06:45:56.531 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/acard-ahci.ko 2023-11-20T06:45:56.531 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 88865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/ahci.ko 2023-11-20T06:45:56.531 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/ahci_platform.ko 2023-11-20T06:45:56.531 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 88289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/libahci.ko 2023-11-20T06:45:56.531 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/libahci_platform.ko 2023-11-20T06:45:56.531 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_acpi.ko 2023-11-20T06:45:56.531 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ali.ko 2023-11-20T06:45:56.531 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_amd.ko 2023-11-20T06:45:56.531 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_artop.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_atiixp.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_atp867x.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_cmd640.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_cmd64x.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_cypress.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_efar.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt366.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt37x.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_it8213.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_it821x.ko 2023-11-20T06:45:56.532 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_jmicron.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_legacy.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_marvell.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_mpiix.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_netcell.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ninja32.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ns87410.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ns87415.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_oldpiix.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_opti.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_optidma.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_pcmcia.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-20T06:45:56.533 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-20T06:45:56.534 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_piccolo.ko 2023-11-20T06:45:56.534 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_radisys.ko 2023-11-20T06:45:56.534 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_rdc.ko 2023-11-20T06:45:56.534 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_rz1000.ko 2023-11-20T06:45:56.534 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_sch.ko 2023-11-20T06:45:56.534 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_serverworks.ko 2023-11-20T06:45:56.534 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_sil680.ko 2023-11-20T06:45:56.534 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_sl82c105.ko 2023-11-20T06:45:56.534 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_triflex.ko 2023-11-20T06:45:56.534 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_via.ko 2023-11-20T06:45:56.534 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pdc_adma.ko 2023-11-20T06:45:56.534 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_inic162x.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_mv.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_nv.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_promise.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_qstor.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sil.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sil24.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sis.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_svw.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sx4.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_uli.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_via.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_vsc.ko 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/auxdisplay/ 2023-11-20T06:45:56.535 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/auxdisplay/ks0108.ko 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/bcma/ 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 124473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/bcma/bcma.ko 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/ 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/aoe/ 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 113665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/aoe/aoe.ko 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/drbd/ 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 965585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/drbd/drbd.ko 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 173225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/floppy.ko 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/mtip32xx/ 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 94297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 115793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/nbd.ko 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/null_blk/ 2023-11-20T06:45:56.536 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 110385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/null_blk/null_blk.ko 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 98193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/pktcdvd.ko 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 263769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/rbd.ko 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/xen-blkback/ 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 98145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/zram/ 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/zram/zram.ko 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/applicom.ko 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hangcheck-timer.ko 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/ 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-20T06:45:56.537 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/via-rng.ko 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 148601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 139313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/lp.ko 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/mwave/ 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 84097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/mwave/mwave.ko 2023-11-20T06:45:56.538 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/nvram.ko 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ppdev.ko 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tlclk.ko 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/ 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/ 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-20T06:45:56.539 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/ 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-palmas.ko 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-si5351.ko 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-twl6040.ko 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-wm831x.ko 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/ 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ccp/ 2023-11-20T06:45:56.540 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 243025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ccp/ccp.ko 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/ 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/ 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 438761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/padlock-aes.ko 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/padlock-sha.ko 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/virtio/ 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dca/ 2023-11-20T06:45:56.541 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dca/dca.ko 2023-11-20T06:45:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/ 2023-11-20T06:45:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/dw/ 2023-11-20T06:45:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-20T06:45:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/ioat/ 2023-11-20T06:45:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 122569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-20T06:45:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/ 2023-11-20T06:45:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 79953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/amd64_edac.ko 2023-11-20T06:45:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/e752x_edac.ko 2023-11-20T06:45:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/edac_mce_amd.ko 2023-11-20T06:45:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i3000_edac.ko 2023-11-20T06:45:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i3200_edac.ko 2023-11-20T06:45:56.542 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i5100_edac.ko 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i5400_edac.ko 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i7300_edac.ko 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i7core_edac.ko 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i82975x_edac.ko 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/ie31200_edac.ko 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/sb_edac.ko 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/x38_edac.ko 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/ 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-gpio.ko 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-max14577.ko 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-max77693.ko 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-max8997.ko 2023-11-20T06:45:56.543 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-palmas.ko 2023-11-20T06:45:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-20T06:45:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-20T06:45:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/ 2023-11-20T06:45:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-20T06:45:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/efi/ 2023-11-20T06:45:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-20T06:45:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-20T06:45:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/ 2023-11-20T06:45:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-20T06:45:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-20T06:45:56.544 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-arizona.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-da9052.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-da9055.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-dln2.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-generic.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-ich.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-kempld.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-max7300.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-max730x.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-max732x.ko 2023-11-20T06:45:56.545 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-20T06:45:56.546 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-20T06:45:56.546 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-20T06:45:56.546 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-20T06:45:56.546 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-sch.ko 2023-11-20T06:45:56.546 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-20T06:45:56.546 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-20T06:45:56.546 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-20T06:45:56.546 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-20T06:45:56.546 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-20T06:45:56.546 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-vx855.ko 2023-11-20T06:45:56.546 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-20T06:45:56.546 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/ 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-a4tech.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-apple.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-appleir.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-aureal.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-axff.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-belkin.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-cherry.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-chicony.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-cp2112.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-cypress.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-dr.ko 2023-11-20T06:45:56.547 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-elecom.ko 2023-11-20T06:45:56.548 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-elo.ko 2023-11-20T06:45:56.548 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-emsff.ko 2023-11-20T06:45:56.548 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-ezkey.ko 2023-11-20T06:45:56.548 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-gaff.ko 2023-11-20T06:45:56.548 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-generic.ko 2023-11-20T06:45:56.548 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-gt683r.ko 2023-11-20T06:45:56.548 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-gyration.ko 2023-11-20T06:45:56.548 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-20T06:45:56.548 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-20T06:45:56.548 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-holtekff.ko 2023-11-20T06:45:56.548 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-hyperv.ko 2023-11-20T06:45:56.548 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-icade.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-kensington.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-keytouch.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-kye.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-lcpower.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-led.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-lenovo.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-lg-g15.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-logitech.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-magicmouse.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-microsoft.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-monterey.ko 2023-11-20T06:45:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-multitouch.ko 2023-11-20T06:45:56.550 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-ntrig.ko 2023-11-20T06:45:56.550 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-ortek.ko 2023-11-20T06:45:56.550 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-penmount.ko 2023-11-20T06:45:56.550 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-petalynx.ko 2023-11-20T06:45:56.550 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-picolcd.ko 2023-11-20T06:45:56.550 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-pl.ko 2023-11-20T06:45:56.550 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-plantronics.ko 2023-11-20T06:45:56.550 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-primax.ko 2023-11-20T06:45:56.550 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-rmi.ko 2023-11-20T06:45:56.550 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-20T06:45:56.550 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-common.ko 2023-11-20T06:45:56.550 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-saitek.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-samsung.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-20T06:45:56.551 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sjoy.ko 2023-11-20T06:45:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sony.ko 2023-11-20T06:45:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-speedlink.ko 2023-11-20T06:45:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-steelseries.ko 2023-11-20T06:45:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sunplus.ko 2023-11-20T06:45:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-20T06:45:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-tivo.ko 2023-11-20T06:45:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-tmff.ko 2023-11-20T06:45:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-topseed.ko 2023-11-20T06:45:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-twinhan.ko 2023-11-20T06:45:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-uclogic.ko 2023-11-20T06:45:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-waltop.ko 2023-11-20T06:45:56.552 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 143473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-wiimote.ko 2023-11-20T06:45:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-xinmo.ko 2023-11-20T06:45:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-zpff.ko 2023-11-20T06:45:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-zydacron.ko 2023-11-20T06:45:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 267825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid.ko 2023-11-20T06:45:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/uhid.ko 2023-11-20T06:45:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/ 2023-11-20T06:45:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-20T06:45:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-20T06:45:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-20T06:45:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 217873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/wacom.ko 2023-11-20T06:45:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/ 2023-11-20T06:45:56.553 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/hv_balloon.ko 2023-11-20T06:45:56.554 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/hv_utils.ko 2023-11-20T06:45:56.554 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 305465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/hv_vmbus.ko 2023-11-20T06:45:56.589 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ 2023-11-20T06:45:56.589 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/abituguru.ko 2023-11-20T06:45:56.589 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/abituguru3.ko 2023-11-20T06:45:56.589 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-20T06:45:56.589 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ad7414.ko 2023-11-20T06:45:56.589 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ad7418.ko 2023-11-20T06:45:56.589 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adc128d818.ko 2023-11-20T06:45:56.589 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1025.ko 2023-11-20T06:45:56.590 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1026.ko 2023-11-20T06:45:56.590 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1029.ko 2023-11-20T06:45:56.590 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1031.ko 2023-11-20T06:45:56.590 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm9240.ko 2023-11-20T06:45:56.590 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ads7828.ko 2023-11-20T06:45:56.590 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7410.ko 2023-11-20T06:45:56.590 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7411.ko 2023-11-20T06:45:56.590 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 74433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7462.ko 2023-11-20T06:45:56.590 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7470.ko 2023-11-20T06:45:56.590 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7475.ko 2023-11-20T06:45:56.590 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7x10.ko 2023-11-20T06:45:56.590 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/amc6821.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/applesmc.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/asb100.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/asc7621.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/atxp1.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/coretemp.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 99601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/dme1737.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ds1621.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ds620.ko 2023-11-20T06:45:56.591 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/emc1403.ko 2023-11-20T06:45:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/emc2103.ko 2023-11-20T06:45:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/emc6w201.ko 2023-11-20T06:45:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/f71805f.ko 2023-11-20T06:45:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 94457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/f71882fg.ko 2023-11-20T06:45:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/f75375s.ko 2023-11-20T06:45:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/fam15h_power.ko 2023-11-20T06:45:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/fschmd.ko 2023-11-20T06:45:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/g760a.ko 2023-11-20T06:45:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/g762.ko 2023-11-20T06:45:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/gl518sm.ko 2023-11-20T06:45:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/gl520sm.ko 2023-11-20T06:45:56.592 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/hih6130.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/i5500_temp.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/i5k_amb.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ibmaem.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ibmpex.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ina209.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ina2xx.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 130449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/it87.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/jc42.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/k10temp.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/k8temp.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lineage-pem.ko 2023-11-20T06:45:56.593 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm63.ko 2023-11-20T06:45:56.594 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm73.ko 2023-11-20T06:45:56.594 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm75.ko 2023-11-20T06:45:56.594 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm77.ko 2023-11-20T06:45:56.594 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm78.ko 2023-11-20T06:45:56.594 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm80.ko 2023-11-20T06:45:56.594 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm83.ko 2023-11-20T06:45:56.594 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm85.ko 2023-11-20T06:45:56.594 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm87.ko 2023-11-20T06:45:56.594 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm90.ko 2023-11-20T06:45:56.594 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm92.ko 2023-11-20T06:45:56.594 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm93.ko 2023-11-20T06:45:56.594 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm95234.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm95241.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm95245.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc2945.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4151.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4215.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4222.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4245.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4260.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4261.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max16065.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max1619.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max1668.ko 2023-11-20T06:45:56.595 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max197.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max6639.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max6650.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max6697.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/mcp3021.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct6683.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 119817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct6775-core.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct6775.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct7802.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 82337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pc87360.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pc87427.ko 2023-11-20T06:45:56.596 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pcf8591.ko 2023-11-20T06:45:56.597 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ 2023-11-20T06:45:56.597 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-20T06:45:56.597 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-20T06:45:56.597 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-20T06:45:56.597 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-20T06:45:56.597 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-20T06:45:56.597 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-20T06:45:56.597 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-20T06:45:56.597 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 82577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-20T06:45:56.597 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-20T06:45:56.597 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-20T06:45:56.597 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-20T06:45:56.598 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-20T06:45:56.598 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/powr1220.ko 2023-11-20T06:45:56.598 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sch5627.ko 2023-11-20T06:45:56.598 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sch5636.ko 2023-11-20T06:45:56.598 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-20T06:45:56.598 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sht15.ko 2023-11-20T06:45:56.598 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sht21.ko 2023-11-20T06:45:56.598 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/shtc1.ko 2023-11-20T06:45:56.598 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sis5595.ko 2023-11-20T06:45:56.598 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/smsc47b397.ko 2023-11-20T06:45:56.598 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/smsc47m1.ko 2023-11-20T06:45:56.598 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/smsc47m192.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/thmc50.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp102.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp103.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp401.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp421.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/via-cputemp.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/via686a.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/vt1211.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/vt8231.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83627ehf.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83627hf.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83781d.ko 2023-11-20T06:45:56.599 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83791d.ko 2023-11-20T06:45:56.600 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83792d.ko 2023-11-20T06:45:56.600 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83793.ko 2023-11-20T06:45:56.600 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 119505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83795.ko 2023-11-20T06:45:56.600 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83l785ts.ko 2023-11-20T06:45:56.600 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83l786ng.ko 2023-11-20T06:45:56.600 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-20T06:45:56.600 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-20T06:45:56.600 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/ 2023-11-20T06:45:56.600 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/algos/ 2023-11-20T06:45:56.600 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-20T06:45:56.600 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-20T06:45:56.600 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/ 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 6929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-20T06:45:56.601 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-20T06:45:56.602 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-20T06:45:56.602 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-20T06:45:56.602 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-20T06:45:56.602 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-20T06:45:56.602 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-20T06:45:56.602 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-20T06:45:56.602 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-20T06:45:56.602 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-20T06:45:56.602 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-20T06:45:56.602 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-20T06:45:56.602 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-20T06:45:56.602 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-20T06:45:56.603 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-20T06:45:56.603 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-20T06:45:56.603 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-20T06:45:56.603 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-20T06:45:56.603 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-20T06:45:56.603 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-20T06:45:56.603 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-20T06:45:56.603 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-20T06:45:56.603 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-20T06:45:56.603 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-20T06:45:56.603 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-20T06:45:56.603 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/i2c-mux.ko 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/i2c-smbus.ko 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/i2c-stub.ko 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/ 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 273609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 879969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_core.ko 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-20T06:45:56.604 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 324217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 282273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/ 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 493073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx4/ 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 419737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx5/ 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 739025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mthca/ 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 296625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-20T06:45:56.605 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-20T06:45:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 153697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-20T06:45:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/usnic/ 2023-11-20T06:45:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 168969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-20T06:45:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/ 2023-11-20T06:45:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-20T06:45:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 263081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-20T06:45:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/iser/ 2023-11-20T06:45:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 100241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-20T06:45:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/isert/ 2023-11-20T06:45:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 111425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-20T06:45:56.606 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srp/ 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 128753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srpt/ 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 129529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/ 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/evbug.ko 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/ff-memless.ko 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/ 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/gameport.ko 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/joydev.ko 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/ 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-20T06:45:56.607 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-20T06:45:56.608 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-20T06:45:56.608 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-20T06:45:56.608 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-20T06:45:56.608 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-20T06:45:56.608 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-20T06:45:56.608 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/lm8323.ko 2023-11-20T06:45:56.608 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/lm8333.ko 2023-11-20T06:45:56.608 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-20T06:45:56.608 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-20T06:45:56.608 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-20T06:45:56.608 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-20T06:45:56.608 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/qt1070.ko 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/qt2160.ko 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/stowaway.ko 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/matrix-keymap.ko 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/ 2023-11-20T06:45:56.609 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/appletouch.ko 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/bcm5974.ko 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 123681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/cyapatp.ko 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 335929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/psmouse.ko 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/sermouse.ko 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/rmi4/ 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 109873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/ 2023-11-20T06:45:56.610 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/altera_ps2.ko 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/arc_ps2.ko 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/ct82c710.ko 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/parkbd.ko 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/pcips2.ko 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/ps2mult.ko 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/serio_raw.ko 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/serport.ko 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/sparse-keymap.ko 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/iommu/ 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/iommu/amd/ 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-20T06:45:56.611 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/ 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-88pm860x.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-adp5520.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-bd2802.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-blinkm.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-da903x.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-da9052.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-gpio.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm3530.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm3533.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm355x.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm3642.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lp3944.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lp8788.ko 2023-11-20T06:45:56.612 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-max8997.ko 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-mc13783.ko 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-pca9532.ko 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-pca955x.ko 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-pca963x.ko 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-ss4200.ko 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-tca6507.ko 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-wm8350.ko 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-20T06:45:56.613 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-20T06:45:56.614 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-20T06:45:56.614 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-20T06:45:56.614 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-20T06:45:56.614 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-20T06:45:56.614 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-20T06:45:56.614 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/ 2023-11-20T06:45:56.614 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/bcache/ 2023-11-20T06:45:56.614 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 654969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/bcache/bcache.ko 2023-11-20T06:45:56.614 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-bio-prison.ko 2023-11-20T06:45:56.614 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-bufio.ko 2023-11-20T06:45:56.614 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-cache-smq.ko 2023-11-20T06:45:56.614 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 156009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-cache.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 106897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-crypt.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-delay.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-era.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-flakey.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-log-userspace.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-log.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-mirror.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-multipath.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-queue-length.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-raid.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-region-hash.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-round-robin.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-service-time.ko 2023-11-20T06:45:56.615 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 109529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-snapshot.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-switch.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 181865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-thin-pool.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-verity.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-zero.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/faulty.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/linear.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/multipath.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/persistent-data/ 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 199937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid0.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 113073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid1.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 158681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid10.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 395721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid456.ko 2023-11-20T06:45:56.616 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/ 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/ 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 178137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptbase.ko 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptctl.ko 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptfc.ko 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptlan.ko 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 123321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptsas.ko 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 79041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptscsih.ko 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptspi.ko 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/ 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/88pm800.ko 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/88pm805.ko 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/88pm80x.ko 2023-11-20T06:45:56.617 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/arizona-i2c.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 123721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/arizona.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/bcm590xx.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/dln2.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/janz-cmodio.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/kempld-core.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lm3533-core.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lp3943.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lpc_ich.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lpc_sch.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/max8907.ko 2023-11-20T06:45:56.618 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/menf21bmc.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/pcf50633.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/retu-mfd.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/si476x-core.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/sm501.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/tps65010.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/tps6507x.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/viperboard.ko 2023-11-20T06:45:56.619 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/vx855.ko 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/wl1273-core.ko 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/wm8994.ko 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ad525x_dpot.ko 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/altera-stapl/ 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/apds9802als.ko 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/apds990x.ko 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/bh1770glc.ko 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/c2port/ 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/c2port/core.ko 2023-11-20T06:45:56.620 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/cb710/ 2023-11-20T06:45:56.621 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/cb710/cb710.ko 2023-11-20T06:45:56.621 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ds1682.ko 2023-11-20T06:45:56.621 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/dummy-irq.ko 2023-11-20T06:45:56.621 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/echo/ 2023-11-20T06:45:56.621 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/echo/echo.ko 2023-11-20T06:45:56.621 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/ 2023-11-20T06:45:56.621 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/at24.ko 2023-11-20T06:45:56.621 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-20T06:45:56.621 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-20T06:45:56.621 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/max6875.ko 2023-11-20T06:45:56.621 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/enclosure.ko 2023-11-20T06:45:56.621 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/genwqe/ 2023-11-20T06:45:56.622 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 152201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-20T06:45:56.622 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/hmc6352.ko 2023-11-20T06:45:56.622 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/hpilo.ko 2023-11-20T06:45:56.622 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ibmasm/ 2023-11-20T06:45:56.622 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-20T06:45:56.622 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ics932s401.ko 2023-11-20T06:45:56.622 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/isl29003.ko 2023-11-20T06:45:56.622 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/isl29020.ko 2023-11-20T06:45:56.622 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/lis3lv02d/ 2023-11-20T06:45:56.622 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-20T06:45:56.622 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-20T06:45:56.622 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/ 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/mei-me.ko 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/mei-txe.ko 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 310113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/mei.ko 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/phantom.ko 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ti-st/ 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 74265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/tifm_7xx1.ko 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/tifm_core.ko 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/tsl2550.ko 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/vmw_balloon.ko 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/vmw_vmci/ 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 183609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-20T06:45:56.623 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ 2023-11-20T06:45:56.624 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/bonding/ 2023-11-20T06:45:56.624 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 490129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/bonding/bonding.ko 2023-11-20T06:45:56.624 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/ 2023-11-20T06:45:56.624 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/b53/ 2023-11-20T06:45:56.624 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 106033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-20T06:45:56.624 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-20T06:45:56.624 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-20T06:45:56.624 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-20T06:45:56.624 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 453737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-20T06:45:56.624 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dummy.ko 2023-11-20T06:45:56.624 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/eql.ko 2023-11-20T06:45:56.624 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/ 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 130553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/ 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 99049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/adaptec/ 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/agere/ 2023-11-20T06:45:56.625 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-20T06:45:56.626 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/alteon/ 2023-11-20T06:45:56.626 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-20T06:45:56.626 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/altera/ 2023-11-20T06:45:56.626 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-20T06:45:56.626 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/ 2023-11-20T06:45:56.626 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-20T06:45:56.626 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-20T06:45:56.626 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-20T06:45:56.626 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/ 2023-11-20T06:45:56.626 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-20T06:45:56.626 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 104673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/ 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 176761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1421497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-20T06:45:56.627 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 128569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 132089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 312081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/brocade/ 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 323513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/ 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 193497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 347417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-20T06:45:56.628 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1044497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 166193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/cisco/ 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 204345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/ 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 141225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-20T06:45:56.629 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-20T06:45:56.630 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-20T06:45:56.630 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-20T06:45:56.630 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dlink/ 2023-11-20T06:45:56.630 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-20T06:45:56.630 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-20T06:45:56.630 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dnet.ko 2023-11-20T06:45:56.630 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-20T06:45:56.630 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/emulex/ 2023-11-20T06:45:56.630 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-20T06:45:56.630 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 281137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-20T06:45:56.630 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ethoc.ko 2023-11-20T06:45:56.630 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/fealnx.ko 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/fujitsu/ 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 295577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 584497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 246209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 925825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-20T06:45:56.631 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 302937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igb/ 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 514641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 93593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 734305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 151769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 86921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/jme.ko 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/ 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-20T06:45:56.632 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-20T06:45:56.633 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 122649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-20T06:45:56.633 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/ 2023-11-20T06:45:56.633 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-20T06:45:56.633 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 727601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-20T06:45:56.633 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 278937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-20T06:45:56.633 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-20T06:45:56.633 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-20T06:45:56.633 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1113681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-20T06:45:56.689 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ 2023-11-20T06:45:56.689 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-20T06:45:56.689 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-20T06:45:56.689 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-20T06:45:56.689 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 95665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-20T06:45:56.689 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/myricom/ 2023-11-20T06:45:56.689 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-20T06:45:56.689 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-20T06:45:56.689 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/natsemi/ 2023-11-20T06:45:56.689 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-20T06:45:56.690 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-20T06:45:56.690 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/neterion/ 2023-11-20T06:45:56.690 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 150905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-20T06:45:56.690 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/nvidia/ 2023-11-20T06:45:56.690 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 136721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-20T06:45:56.690 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/packetengines/ 2023-11-20T06:45:56.690 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-20T06:45:56.690 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-20T06:45:56.690 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/ 2023-11-20T06:45:56.690 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-20T06:45:56.690 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 227897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-20T06:45:56.690 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-20T06:45:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-20T06:45:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 672049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-20T06:45:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/rdc/ 2023-11-20T06:45:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-20T06:45:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/ 2023-11-20T06:45:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-20T06:45:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-20T06:45:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-20T06:45:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 189801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-20T06:45:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/samsung/ 2023-11-20T06:45:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-20T06:45:56.691 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 104241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-20T06:45:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sfc/ 2023-11-20T06:45:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1052497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-20T06:45:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/silan/ 2023-11-20T06:45:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-20T06:45:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sis/ 2023-11-20T06:45:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-20T06:45:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-20T06:45:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/ 2023-11-20T06:45:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-20T06:45:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-20T06:45:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-20T06:45:56.692 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/ 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 487025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/ 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 166097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/tehuti/ 2023-11-20T06:45:56.693 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-20T06:45:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ti/ 2023-11-20T06:45:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 86529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-20T06:45:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/via/ 2023-11-20T06:45:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-20T06:45:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-20T06:45:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/wiznet/ 2023-11-20T06:45:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-20T06:45:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-20T06:45:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/xircom/ 2023-11-20T06:45:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-20T06:45:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/ 2023-11-20T06:45:56.694 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/defxx.ko 2023-11-20T06:45:56.695 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/skfp/ 2023-11-20T06:45:56.695 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 216985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-20T06:45:56.695 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/geneve.ko 2023-11-20T06:45:56.695 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/hyperv/ 2023-11-20T06:45:56.695 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 235521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-20T06:45:56.695 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ieee802154/ 2023-11-20T06:45:56.695 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-20T06:45:56.695 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ifb.ko 2023-11-20T06:45:56.695 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ipvlan/ 2023-11-20T06:45:56.695 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 83769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-20T06:45:56.695 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/macvlan.ko 2023-11-20T06:45:56.695 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/macvtap.ko 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/ 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio.ko 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mii.ko 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/netconsole.ko 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/nlmon.ko 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/pcs/ 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-20T06:45:56.696 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/ 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/amd.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/bcm87xx.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/broadcom.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/cicada.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/davicom.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/et1011c.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/icplus.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/lxt.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 82049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/marvell.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 76113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/micrel.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/national.ko 2023-11-20T06:45:56.697 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/phylink.ko 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/qsemi.ko 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/realtek.ko 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/smsc.ko 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/ste10Xp.ko 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/vitesse.ko 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/plip/ 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/plip/plip.ko 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_async.ko 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-20T06:45:56.698 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-20T06:45:56.699 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/pppoe.ko 2023-11-20T06:45:56.699 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/pppox.ko 2023-11-20T06:45:56.699 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/pptp.ko 2023-11-20T06:45:56.699 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/sb1000.ko 2023-11-20T06:45:56.699 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/slip/ 2023-11-20T06:45:56.699 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/slip/slip.ko 2023-11-20T06:45:56.699 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/sungem_phy.ko 2023-11-20T06:45:56.699 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/tap.ko 2023-11-20T06:45:56.699 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/ 2023-11-20T06:45:56.699 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 106169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team.ko 2023-11-20T06:45:56.699 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-20T06:45:56.699 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_random.ko 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/veth.ko 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vmxnet3/ 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 144297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vxlan/ 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 297329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vxlan/vxlan.ko 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/xen-netback/ 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 144585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ntb/ 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ntb/ntb.ko 2023-11-20T06:45:56.700 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/ 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/host/ 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 265121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/host/nvme-core.ko 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/host/nvme.ko 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/ 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 133841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport.ko 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport_cs.ko 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 84465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport_pc.ko 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport_serial.ko 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/ 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/ 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-20T06:45:56.701 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/pci-stub.ko 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/xen-pcifront.ko 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/ 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/i82092.ko 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 145809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pcmcia.ko 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pd6729.ko 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 112889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/ 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/broadcom/ 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-20T06:45:56.702 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/samsung/ 2023-11-20T06:45:56.703 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-20T06:45:56.703 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pinctrl/ 2023-11-20T06:45:56.703 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pinctrl/intel/ 2023-11-20T06:45:56.703 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-20T06:45:56.703 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/ 2023-11-20T06:45:56.703 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/ 2023-11-20T06:45:56.703 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-20T06:45:56.703 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-20T06:45:56.703 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-20T06:45:56.703 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-20T06:45:56.703 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-20T06:45:56.703 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/ 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/acerhdf.ko 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 127441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-20T06:45:56.704 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/hdaps.ko 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel/ 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel_ips.ko 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-20T06:45:56.705 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-20T06:45:56.706 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-20T06:45:56.706 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-20T06:45:56.706 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/wmi.ko 2023-11-20T06:45:56.706 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/ 2023-11-20T06:45:56.706 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ 2023-11-20T06:45:56.706 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-20T06:45:56.706 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-20T06:45:56.706 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-20T06:45:56.706 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-20T06:45:56.706 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-20T06:45:56.706 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-20T06:45:56.706 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/da9030_battery.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/da9052-battery.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/gpio-charger.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max14577_charger.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max17040_battery.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max17042_battery.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max8903_charger.ko 2023-11-20T06:45:56.707 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max8925_power.ko 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/sbs-battery.ko 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/test_power.ko 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/wm831x_power.ko 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/wm8350_power.ko 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/powercap/ 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/ 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/ 2023-11-20T06:45:56.708 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/pps_parport.ko 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/pps_core.ko 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ptp/ 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ptp/ptp.ko 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ptp/ptp_kvm.ko 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/ 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-da9052.ko 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-da9055.ko 2023-11-20T06:45:56.709 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-da9063.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-em3027.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-20T06:45:56.710 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max6900.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8907.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8925.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8997.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8998.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-20T06:45:56.711 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-palmas.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-20T06:45:56.712 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-x1205.ko 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/3w-9xxx.ko 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/3w-sas.ko 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/3w-xxxx.ko 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 135185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/BusLogic.ko 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/a100u2w.ko 2023-11-20T06:45:56.713 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aacraid/ 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 272305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 100617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/advansys.ko 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic7xxx/ 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 356201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 295801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic94xx/ 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 189185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/am53c974.ko 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/arcmsr/ 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 106881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/atp870u.ko 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/be2iscsi/ 2023-11-20T06:45:56.714 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 246985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-20T06:45:56.715 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bfa/ 2023-11-20T06:45:56.715 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1171945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bfa/bfa.ko 2023-11-20T06:45:56.715 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2fc/ 2023-11-20T06:45:56.715 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 237273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-20T06:45:56.715 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2i/ 2023-11-20T06:45:56.715 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 115369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-20T06:45:56.715 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ch.ko 2023-11-20T06:45:56.715 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/csiostor/ 2023-11-20T06:45:56.715 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 308921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-20T06:45:56.715 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/ 2023-11-20T06:45:56.715 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-20T06:45:56.715 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 76145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 146689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 75553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/dc395x.ko 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/dmx3191d.ko 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/esas2r/ 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 212425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/esp_scsi.ko 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fcoe/ 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 158505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fdomain.ko 2023-11-20T06:45:56.716 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fnic/ 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 263489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fnic/fnic.ko 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 201817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/hpsa.ko 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/hptiop.ko 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/hv_storvsc.ko 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/imm.ko 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/initio.ko 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 266537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ipr.ko 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ips.ko 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/isci/ 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 317153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/isci/isci.ko 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-20T06:45:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libfc/ 2023-11-20T06:45:56.718 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 314865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libfc/libfc.ko 2023-11-20T06:45:56.718 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 145585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libiscsi.ko 2023-11-20T06:45:56.718 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-20T06:45:56.718 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libsas/ 2023-11-20T06:45:56.718 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 216665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libsas/libsas.ko 2023-11-20T06:45:56.718 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/lpfc/ 2023-11-20T06:45:56.718 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2197249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-20T06:45:56.718 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/ 2023-11-20T06:45:56.718 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-20T06:45:56.718 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-20T06:45:56.718 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 310617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-20T06:45:56.718 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 84721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid.ko 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mpt3sas/ 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 659825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mvsas/ 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 119561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mvumi.ko 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/ 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pm8001/ 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 364105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-20T06:45:56.719 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 123617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pmcraid.ko 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ppa.ko 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla1280.ko 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla2xxx/ 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1876689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla4xxx/ 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 559033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qlogicfas408.ko 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/raid_class.ko 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 238761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_debug.ko 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 173937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 279313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-20T06:45:56.720 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 97729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-20T06:45:56.721 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-20T06:45:56.721 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-20T06:45:56.721 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ses.ko 2023-11-20T06:45:56.721 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 115889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/st.ko 2023-11-20T06:45:56.721 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/stex.ko 2023-11-20T06:45:56.721 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-20T06:45:56.721 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 162121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-20T06:45:56.721 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/virtio_scsi.ko 2023-11-20T06:45:56.721 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-20T06:45:56.721 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/wd719x.ko 2023-11-20T06:45:56.721 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/xen-scsifront.ko 2023-11-20T06:45:56.721 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ssb/ 2023-11-20T06:45:56.722 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 129441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ssb/ssb.ko 2023-11-20T06:45:56.722 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/ 2023-11-20T06:45:56.722 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/iscsi/ 2023-11-20T06:45:56.722 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 736601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-20T06:45:56.722 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/loopback/ 2023-11-20T06:45:56.722 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-20T06:45:56.722 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_file.ko 2023-11-20T06:45:56.722 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_iblock.ko 2023-11-20T06:45:56.722 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 930257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_mod.ko 2023-11-20T06:45:56.722 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_pscsi.ko 2023-11-20T06:45:56.722 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 122521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_user.ko 2023-11-20T06:45:56.722 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/tcm_fc/ 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 75593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/ 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/ 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-20T06:45:56.723 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-20T06:45:56.724 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-20T06:45:56.724 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-20T06:45:56.724 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-20T06:45:56.724 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-20T06:45:56.724 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-20T06:45:56.724 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-20T06:45:56.724 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-20T06:45:56.724 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/ 2023-11-20T06:45:56.724 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/ipwireless/ 2023-11-20T06:45:56.724 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-20T06:45:56.724 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/moxa.ko 2023-11-20T06:45:56.724 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 50953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/mxser.ko 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/n_gsm.ko 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/n_hdlc.ko 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/nozomi.ko 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/ 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/8250/ 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/altera_uart.ko 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/arc_uart.ko 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/jsm/ 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-20T06:45:56.725 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/rp2.ko 2023-11-20T06:45:56.726 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-20T06:45:56.726 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/ 2023-11-20T06:45:56.726 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/core/ 2023-11-20T06:45:56.726 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 531265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-20T06:45:56.726 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/host/ 2023-11-20T06:45:56.726 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-20T06:45:56.726 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-20T06:45:56.726 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/ 2023-11-20T06:45:56.726 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio.ko 2023-11-20T06:45:56.726 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_aec.ko 2023-11-20T06:45:56.726 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_cif.ko 2023-11-20T06:45:56.726 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-20T06:45:56.727 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_mf624.ko 2023-11-20T06:45:56.727 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_netx.ko 2023-11-20T06:45:56.727 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_pci_generic.ko 2023-11-20T06:45:56.727 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-20T06:45:56.727 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_sercos3.ko 2023-11-20T06:45:56.727 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/ 2023-11-20T06:45:56.727 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/c67x00/ 2023-11-20T06:45:56.727 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-20T06:45:56.727 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ 2023-11-20T06:45:56.727 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 144377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-20T06:45:56.727 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-20T06:45:56.727 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/ 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/cdc-acm.ko 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/usblp.ko 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/usbtmc.ko 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/common/ 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/common/ulpi.ko 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc2/ 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/ 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-20T06:45:56.728 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-20T06:45:56.729 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 448505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-20T06:45:56.729 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/ 2023-11-20T06:45:56.729 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/ 2023-11-20T06:45:56.729 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-20T06:45:56.729 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-20T06:45:56.729 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-20T06:45:56.729 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-20T06:45:56.729 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-20T06:45:56.729 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-20T06:45:56.729 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 92489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-20T06:45:56.729 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-20T06:45:56.729 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 122081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/ 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-20T06:45:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 62185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 161225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/ 2023-11-20T06:45:56.731 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-20T06:45:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-20T06:45:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 157681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-20T06:45:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-20T06:45:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-20T06:45:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 69705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-20T06:45:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-20T06:45:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 76057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-20T06:45:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 75073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-20T06:45:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 73169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-20T06:45:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 65809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-20T06:45:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-20T06:45:56.732 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 156073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/ 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 87353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/sl811_cs.ko 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/image/ 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/image/mdc800.ko 2023-11-20T06:45:56.733 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/image/microtek.ko 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/adutux.ko 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/appledisplay.ko 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/cytherm.ko 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ehset.ko 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/emi26.ko 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/emi62.ko 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ezusb.ko 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/idmouse.ko 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/iowarrior.ko 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-20T06:45:56.734 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ldusb.ko 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/legousbtower.ko 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/lvstest.ko 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/sisusbvga/ 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usb3503.ko 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usblcd.ko 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usbtest.ko 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/uss720.ko 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/yurex.ko 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/mon/ 2023-11-20T06:45:56.735 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/mon/usbmon.ko 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/musb/ 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 301697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/ 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-generic.ko 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/aircable.ko 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ark3116.ko 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ch341.ko 2023-11-20T06:45:56.736 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/cp210x.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/cyberjack.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/empeg.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/f81232.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 175137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 137081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 124833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/io_ti.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ipaq.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ipw.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ir-usb.ko 2023-11-20T06:45:56.737 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 107521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/keyspan.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mct_u232.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/metro-usb.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mos7720.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 78217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mos7840.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mxuport.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/navman.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/omninet.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/opticon.ko 2023-11-20T06:45:56.738 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 191137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/option.ko 2023-11-20T06:45:56.739 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/oti6858.ko 2023-11-20T06:45:56.739 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/pl2303.ko 2023-11-20T06:45:56.739 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/qcaux.ko 2023-11-20T06:45:56.739 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/qcserial.ko 2023-11-20T06:45:56.739 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/quatech2.ko 2023-11-20T06:45:56.739 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/safe_serial.ko 2023-11-20T06:45:56.739 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 51625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/sierra.ko 2023-11-20T06:45:56.739 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-20T06:45:56.739 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ssu100.ko 2023-11-20T06:45:56.739 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/symbolserial.ko 2023-11-20T06:45:56.739 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-20T06:45:56.739 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usb_debug.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usbserial.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/visor.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/whiteheat.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 52913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/uas.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-20T06:45:56.740 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-karma.ko 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 179969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/usb-storage.ko 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/ 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-20T06:45:56.741 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 107001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-20T06:45:56.742 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/ 2023-11-20T06:45:56.742 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/pci/ 2023-11-20T06:45:56.742 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 154297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-20T06:45:56.742 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-20T06:45:56.742 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/vfio.ko 2023-11-20T06:45:56.742 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 77609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-20T06:45:56.742 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/ 2023-11-20T06:45:56.742 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 113785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost.ko 2023-11-20T06:45:56.742 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-20T06:45:56.742 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 58089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost_net.ko 2023-11-20T06:45:56.742 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost_scsi.ko 2023-11-20T06:45:56.742 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/ 2023-11-20T06:45:56.743 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/ 2023-11-20T06:45:56.743 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-20T06:45:56.743 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-20T06:45:56.743 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-20T06:45:56.743 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-20T06:45:56.743 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-20T06:45:56.743 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/apple_bl.ko 2023-11-20T06:45:56.743 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-20T06:45:56.743 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/bd6107.ko 2023-11-20T06:45:56.743 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-20T06:45:56.743 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-20T06:45:56.743 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lcd.ko 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/ 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/ 2023-11-20T06:45:56.744 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/ds2482.ko 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/ds2490.ko 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/ 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-20T06:45:56.745 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 56425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/wire.ko 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/acquirewdt.ko 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/advantechwdt.ko 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-20T06:45:56.746 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/dw_wdt.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/hpwdt.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/i6300esb.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ib700wdt.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ibmasr.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/it87_wdt.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-20T06:45:56.747 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/machzwd.ko 2023-11-20T06:45:56.748 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-20T06:45:56.748 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-20T06:45:56.748 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/nv_tco.ko 2023-11-20T06:45:56.748 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-20T06:45:56.748 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-20T06:45:56.748 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-20T06:45:56.748 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-20T06:45:56.748 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/retu_wdt.ko 2023-11-20T06:45:56.748 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-20T06:45:56.748 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/softdog.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/via_wdt.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wdt_pci.ko 2023-11-20T06:45:56.749 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-20T06:45:56.750 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-20T06:45:56.750 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/xen_wdt.ko 2023-11-20T06:45:56.750 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/ 2023-11-20T06:45:56.750 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-evtchn.ko 2023-11-20T06:45:56.750 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-gntalloc.ko 2023-11-20T06:45:56.750 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-gntdev.ko 2023-11-20T06:45:56.750 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-pciback/ 2023-11-20T06:45:56.750 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 176377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-20T06:45:56.750 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-privcmd.ko 2023-11-20T06:45:56.750 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 71249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-scsiback.ko 2023-11-20T06:45:56.750 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xenfs/ 2023-11-20T06:45:56.750 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/9p/ 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 166425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/9p/9p.ko 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/adfs/ 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/adfs/adfs.ko 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/affs/ 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 163593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/affs/affs.ko 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/afs/ 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 932817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/afs/kafs.ko 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/autofs/ 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/autofs/autofs4.ko 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/befs/ 2023-11-20T06:45:56.751 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 64545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/befs/befs.ko 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/bfs/ 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/bfs/bfs.ko 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/binfmt_misc.ko 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/btrfs/ 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 3402729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/btrfs/btrfs.ko 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cachefiles/ 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 306009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cachefiles/cachefiles.ko 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ceph/ 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1332449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ceph/ceph.ko 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/coda/ 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 100801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/coda/coda.ko 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/configfs/ 2023-11-20T06:45:56.752 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 108393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/configfs/configfs.ko 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cramfs/ 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 29625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cramfs/cramfs.ko 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/dlm/ 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 642513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/dlm/dlm.ko 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/efs/ 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/efs/efs.ko 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/f2fs/ 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1505025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/f2fs/f2fs.ko 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fat/ 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fat/msdos.ko 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/freevxfs/ 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/freevxfs/freevxfs.ko 2023-11-20T06:45:56.753 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fscache/ 2023-11-20T06:45:56.754 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 226481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fscache/fscache.ko 2023-11-20T06:45:56.754 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fuse/ 2023-11-20T06:45:56.754 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fuse/cuse.ko 2023-11-20T06:45:56.754 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/gfs2/ 2023-11-20T06:45:56.754 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1231529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/gfs2/gfs2.ko 2023-11-20T06:45:56.795 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfs/ 2023-11-20T06:45:56.795 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 141209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfs/hfs.ko 2023-11-20T06:45:56.796 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfsplus/ 2023-11-20T06:45:56.796 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 222817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfsplus/hfsplus.ko 2023-11-20T06:45:56.796 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hpfs/ 2023-11-20T06:45:56.796 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 192329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hpfs/hpfs.ko 2023-11-20T06:45:56.796 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/isofs/ 2023-11-20T06:45:56.796 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 74065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/isofs/isofs.ko 2023-11-20T06:45:56.796 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/jfs/ 2023-11-20T06:45:56.796 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 419497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/jfs/jfs.ko 2023-11-20T06:45:56.796 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/lockd/ 2023-11-20T06:45:56.796 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 280313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/lockd/lockd.ko 2023-11-20T06:45:56.796 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/minix/ 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/minix/minix.ko 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/netfs/ 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 124649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/netfs/netfs.ko 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/ 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/blocklayout/ 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/filelayout/ 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 59449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/flexfilelayout/ 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 117465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1055721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfs.ko 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfsv2.ko 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 120177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfsv3.ko 2023-11-20T06:45:56.797 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2042137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfsv4.ko 2023-11-20T06:45:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs_common/ 2023-11-20T06:45:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs_common/grace.ko 2023-11-20T06:45:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs_common/nfs_acl.ko 2023-11-20T06:45:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfsd/ 2023-11-20T06:45:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1516873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfsd/nfsd.ko 2023-11-20T06:45:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nilfs2/ 2023-11-20T06:45:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 592833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nilfs2/nilfs2.ko 2023-11-20T06:45:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/ 2023-11-20T06:45:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-celtic.ko 2023-11-20T06:45:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-centeuro.ko 2023-11-20T06:45:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-croatian.ko 2023-11-20T06:45:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-cyrillic.ko 2023-11-20T06:45:56.799 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-gaelic.ko 2023-11-20T06:45:56.799 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-greek.ko 2023-11-20T06:45:56.799 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-iceland.ko 2023-11-20T06:45:56.799 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-inuit.ko 2023-11-20T06:45:56.799 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-roman.ko 2023-11-20T06:45:56.799 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-romanian.ko 2023-11-20T06:45:56.799 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-turkish.ko 2023-11-20T06:45:56.799 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_ascii.ko 2023-11-20T06:45:56.799 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp1250.ko 2023-11-20T06:45:56.799 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp1251.ko 2023-11-20T06:45:56.799 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp1255.ko 2023-11-20T06:45:56.799 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp737.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp775.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp850.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp852.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp855.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp857.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp860.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp861.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp862.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp863.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp864.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp865.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp866.ko 2023-11-20T06:45:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp869.ko 2023-11-20T06:45:56.801 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp874.ko 2023-11-20T06:45:56.801 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 94137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp932.ko 2023-11-20T06:45:56.801 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 142673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp936.ko 2023-11-20T06:45:56.801 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 165745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp949.ko 2023-11-20T06:45:56.801 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 118121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp950.ko 2023-11-20T06:45:56.801 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_euc-jp.ko 2023-11-20T06:45:56.801 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-1.ko 2023-11-20T06:45:56.801 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-13.ko 2023-11-20T06:45:56.801 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-14.ko 2023-11-20T06:45:56.801 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-15.ko 2023-11-20T06:45:56.801 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-2.ko 2023-11-20T06:45:56.801 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-3.ko 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-4.ko 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-5.ko 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-6.ko 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-7.ko 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-9.ko 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_koi8-r.ko 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_koi8-ru.ko 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_koi8-u.ko 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_utf8.ko 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ntfs/ 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 219417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ntfs/ntfs.ko 2023-11-20T06:45:56.802 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/cluster/ 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 244409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlm/ 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 440737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlmfs/ 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2592433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2.ko 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/omfs/ 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/omfs/omfs.ko 2023-11-20T06:45:56.803 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/overlayfs/ 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 352161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/overlayfs/overlay.ko 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/pstore/ 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/pstore/ramoops.ko 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx4/ 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx4/qnx4.ko 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx6/ 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 46689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx6/qnx6.ko 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/ 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/quota_tree.ko 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/quota_v1.ko 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/quota_v2.ko 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/reiserfs/ 2023-11-20T06:45:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 532673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/reiserfs/reiserfs.ko 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/romfs/ 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/romfs/romfs.ko 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/ 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/client/ 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 2668401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/client/cifs.ko 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/common/ 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/common/cifs_arc4.ko 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/common/cifs_md4.ko 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/squashfs/ 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 134641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/squashfs/squashfs.ko 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/sysv/ 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 90721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/sysv/sysv.ko 2023-11-20T06:45:56.805 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/udf/ 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 247737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/udf/udf.ko 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ufs/ 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 162497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ufs/ufs.ko 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/xfs/ 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 4011017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/xfs/xfs.ko 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/ 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/locking/ 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 75489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/locking/locktorture.ko 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/time/ 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/time/test_udelay.ko 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/torture.ko 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ 2023-11-20T06:45:56.806 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 6833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crc-itu-t.ko 2023-11-20T06:45:56.807 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 6529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crc7.ko 2023-11-20T06:45:56.807 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crc8.ko 2023-11-20T06:45:56.807 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crypto/ 2023-11-20T06:45:56.807 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crypto/libarc4.ko 2023-11-20T06:45:56.807 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crypto/libdes.ko 2023-11-20T06:45:56.807 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/interval_tree_test.ko 2023-11-20T06:45:56.807 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/libcrc32c.ko 2023-11-20T06:45:56.807 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lru_cache.ko 2023-11-20T06:45:56.807 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lz4/ 2023-11-20T06:45:56.807 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lz4/lz4_compress.ko 2023-11-20T06:45:56.807 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lz4/lz4hc_compress.ko 2023-11-20T06:45:56.807 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/math/ 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 6617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/math/cordic.ko 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/memory-notifier-error-inject.ko 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/notifier-error-inject.ko 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/percpu_test.ko 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/pm-notifier-error-inject.ko 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/raid6/ 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 143433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/raid6/raid6_pq.ko 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/rbtree_test.ko 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/reed_solomon/ 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test-kstrtox.ko 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test-string_helpers.ko 2023-11-20T06:45:56.808 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 4760425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_bpf.ko 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_firmware.ko 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 6369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_module.ko 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_user_copy.ko 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ts_bm.ko 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ts_fsm.ko 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ts_kmp.ko 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/xz/ 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/xz/xz_dec_test.ko 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/mm/ 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/mm/hwpoison-inject.ko 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/ 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/6lowpan.ko 2023-11-20T06:45:56.809 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_dest.ko 2023-11-20T06:45:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_fragment.ko 2023-11-20T06:45:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_hop.ko 2023-11-20T06:45:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 6985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-20T06:45:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_mobility.ko 2023-11-20T06:45:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_routing.ko 2023-11-20T06:45:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_udp.ko 2023-11-20T06:45:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/ 2023-11-20T06:45:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/garp.ko 2023-11-20T06:45:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/mrp.ko 2023-11-20T06:45:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/p8022.ko 2023-11-20T06:45:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/psnap.ko 2023-11-20T06:45:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/stp.ko 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/8021q/ 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 81737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/8021q/8021q.ko 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/ 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 198337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet.ko 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet_fd.ko 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet_rdma.ko 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet_virtio.ko 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/batman-adv/ 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 649297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/batman-adv/batman-adv.ko 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/ 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 63809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/br_netfilter.ko 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 777689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/bridge.ko 2023-11-20T06:45:56.811 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-20T06:45:56.812 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 55929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtables.ko 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ceph/ 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1046833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ceph/libceph.ko 2023-11-20T06:45:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/core/ 2023-11-20T06:45:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/core/pktgen.ko 2023-11-20T06:45:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/ 2023-11-20T06:45:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 194209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp.ko 2023-11-20T06:45:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp_diag.ko 2023-11-20T06:45:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 57881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp_ipv4.ko 2023-11-20T06:45:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp_ipv6.ko 2023-11-20T06:45:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/ 2023-11-20T06:45:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 390473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/dsa_core.ko 2023-11-20T06:45:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_brcm.ko 2023-11-20T06:45:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_dsa.ko 2023-11-20T06:45:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_none.ko 2023-11-20T06:45:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_trailer.ko 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/hsr/ 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 99729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/hsr/hsr.ko 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/ 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/6lowpan/ 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 45233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 254625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/ieee802154.ko 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ah4.ko 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/esp4.ko 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/fou.ko 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/gre.ko 2023-11-20T06:45:56.815 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/inet_diag.ko 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ip_gre.ko 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ip_tunnel.ko 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ip_vti.ko 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ipcomp.ko 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ipip.ko 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-20T06:45:56.816 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-20T06:45:56.817 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_bic.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_dctcp.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_diag.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_highspeed.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_htcp.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_hybla.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_illinois.ko 2023-11-20T06:45:56.818 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_lp.ko 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_scalable.ko 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_vegas.ko 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_veno.ko 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_westwood.ko 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_yeah.ko 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tunnel4.ko 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/udp_diag.ko 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 41665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/udp_tunnel.ko 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ah6.ko 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/esp6.ko 2023-11-20T06:45:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/fou6.ko 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 80897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_gre.ko 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 93577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_tunnel.ko 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_vti.ko 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ipcomp6.ko 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/mip6.ko 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-20T06:45:56.820 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-20T06:45:56.821 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-20T06:45:56.822 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-20T06:45:56.822 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-20T06:45:56.822 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-20T06:45:56.822 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-20T06:45:56.822 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-20T06:45:56.822 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-20T06:45:56.822 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 74073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/sit.ko 2023-11-20T06:45:56.822 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/tunnel6.ko 2023-11-20T06:45:56.822 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-20T06:45:56.822 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/key/ 2023-11-20T06:45:56.822 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 82833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/key/af_key.ko 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/ 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_core.ko 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 25953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_eth.ko 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_ip.ko 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_ip6.ko 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_netlink.ko 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 53241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_ppp.ko 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/lapb/ 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 47977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/lapb/lapb.ko 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/llc/ 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/llc/llc.ko 2023-11-20T06:45:56.823 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 267913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/llc/llc2.ko 2023-11-20T06:45:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mac802154/ 2023-11-20T06:45:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 290417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mac802154/mac802154.ko 2023-11-20T06:45:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mpls/ 2023-11-20T06:45:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mpls/mpls_gso.ko 2023-11-20T06:45:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ 2023-11-20T06:45:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ 2023-11-20T06:45:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 119585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set.ko 2023-11-20T06:45:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-20T06:45:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-20T06:45:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-20T06:45:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 100297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-20T06:45:56.824 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 101441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 103417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 112849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 60329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 109593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 113129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 112585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 111585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 114465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 411729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-20T06:45:56.825 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-20T06:45:56.826 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-20T06:45:56.826 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-20T06:45:56.826 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-20T06:45:56.826 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-20T06:45:56.826 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-20T06:45:56.826 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-20T06:45:56.826 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-20T06:45:56.826 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-20T06:45:56.826 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-20T06:45:56.826 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-20T06:45:56.826 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-20T06:45:56.826 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conncount.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 408257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 118145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 107233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-20T06:45:56.827 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_flow_table.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 37129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_log_syslog.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 95353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_irc.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_sip.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 44065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 615649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_tables.ko 2023-11-20T06:45:56.828 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 42561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 39785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_log.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_chain_nat.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_compat.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 40721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_ct.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_fib.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_hash.ko 2023-11-20T06:45:56.829 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_limit.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_log.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_masq.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_nat.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_numgen.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_osf.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_queue.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_redir.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_reject.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_reject_inet.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_socket.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_synproxy.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_tproxy.ko 2023-11-20T06:45:56.830 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 89313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/x_tables.ko 2023-11-20T06:45:56.831 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_AUDIT.ko 2023-11-20T06:45:56.831 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-20T06:45:56.831 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-20T06:45:56.831 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-20T06:45:56.831 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 18169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CT.ko 2023-11-20T06:45:56.831 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_DSCP.ko 2023-11-20T06:45:56.831 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_HL.ko 2023-11-20T06:45:56.831 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_HMARK.ko 2023-11-20T06:45:56.831 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-20T06:45:56.831 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_LED.ko 2023-11-20T06:45:56.831 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_LOG.ko 2023-11-20T06:45:56.831 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_NETMAP.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_NFLOG.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_RATEEST.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 14337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_SECMARK.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TEE.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TPROXY.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TRACE.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_addrtype.ko 2023-11-20T06:45:56.832 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_bpf.ko 2023-11-20T06:45:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_cgroup.ko 2023-11-20T06:45:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_cluster.ko 2023-11-20T06:45:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_comment.ko 2023-11-20T06:45:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connbytes.ko 2023-11-20T06:45:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connlabel.ko 2023-11-20T06:45:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connlimit.ko 2023-11-20T06:45:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connmark.ko 2023-11-20T06:45:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_conntrack.ko 2023-11-20T06:45:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_cpu.ko 2023-11-20T06:45:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_dccp.ko 2023-11-20T06:45:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_devgroup.ko 2023-11-20T06:45:56.833 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_dscp.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_ecn.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_esp.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_hashlimit.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_helper.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_hl.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_ipcomp.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_iprange.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_ipvs.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_l2tp.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_length.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_limit.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_mac.ko 2023-11-20T06:45:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_mark.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_multiport.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_nat.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_nfacct.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_osf.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_owner.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_physdev.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_pkttype.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_policy.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_quota.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_rateest.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_realm.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_recent.ko 2023-11-20T06:45:56.835 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_sctp.ko 2023-11-20T06:45:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_set.ko 2023-11-20T06:45:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 16089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_socket.ko 2023-11-20T06:45:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_state.ko 2023-11-20T06:45:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_statistic.ko 2023-11-20T06:45:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_string.ko 2023-11-20T06:45:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 8553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_tcpmss.ko 2023-11-20T06:45:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_tcpudp.ko 2023-11-20T06:45:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_time.ko 2023-11-20T06:45:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_u32.ko 2023-11-20T06:45:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netlink/ 2023-11-20T06:45:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netlink/netlink_diag.ko 2023-11-20T06:45:56.836 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/nsh/ 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 12425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/nsh/nsh.ko 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/ 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 380033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/openvswitch.ko 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/vport-geneve.ko 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/vport-gre.ko 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 11793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/vport-vxlan.ko 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/packet/ 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/packet/af_packet_diag.ko 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/phonet/ 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 110201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/phonet/phonet.ko 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/phonet/pn_pep.ko 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/ 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 251481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/rds.ko 2023-11-20T06:45:56.837 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 164937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/rds_rdma.ko 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 67377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/rds_tcp.ko 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rxrpc/ 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 819657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rxrpc/rxrpc.ko 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/ 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_csum.ko 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_gact.ko 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_ipt.ko 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_mirred.ko 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_nat.ko 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 43449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_pedit.ko 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_police.ko 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_simple.ko 2023-11-20T06:45:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_skbedit.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_vlan.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_basic.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_bpf.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_cgroup.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_flow.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_fw.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 38425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_route.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 61409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_u32.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_cmp.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 13409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_ipset.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_meta.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_nbyte.ko 2023-11-20T06:45:56.839 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_text.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_u32.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 21649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_choke.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_codel.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 34633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_drr.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 33609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_fq.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_fq_codel.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 35433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_gred.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 49817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_hfsc.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_hhf.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 66393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_htb.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_ingress.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 30273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_mqprio.ko 2023-11-20T06:45:56.840 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_mqprio_lib.ko 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_multiq.ko 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 36137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_netem.ko 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 27497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_pie.ko 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_plug.ko 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 24729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_prio.ko 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 48729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_qfq.ko 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 32905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_red.ko 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 26881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_sfb.ko 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 31353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_sfq.ko 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_tbf.ko 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 28105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_teql.ko 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sctp/ 2023-11-20T06:45:56.841 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 929745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sctp/sctp.ko 2023-11-20T06:45:56.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 19033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sctp/sctp_diag.ko 2023-11-20T06:45:56.842 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/ 2023-11-20T06:45:56.842 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/auth_gss/ 2023-11-20T06:45:56.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 336529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-20T06:45:56.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 54737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-20T06:45:56.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 1520097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/sunrpc.ko 2023-11-20T06:45:56.842 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/xprtrdma/ 2023-11-20T06:45:56.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 707657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-20T06:45:56.842 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/tipc/ 2023-11-20T06:45:56.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/tipc/diag.ko 2023-11-20T06:45:56.842 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 862665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/tipc/tipc.ko 2023-11-20T06:45:56.842 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/unix/ 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/unix/unix_diag.ko 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/ 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 85409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 68049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 96193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vsock.ko 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 10705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 17521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/x25/ 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 125177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/x25/x25.ko 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/ 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 22657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/xfrm_algo.ko 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 20649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-20T06:45:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 102257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/xfrm_user.ko 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/virt/ 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/virt/lib/ 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 15537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/virt/lib/irqbypass.ko 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 640081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.alias 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 624107 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.alias.bin 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 7663 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 23428 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin.alias.bin 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 9821 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin.bin 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 70004 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin.modinfo 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 146313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.dep 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 232548 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.dep.bin 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 210 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.devname 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 72606 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.order 2023-11-20T06:45:56.844 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 879 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.softdep 2023-11-20T06:45:56.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 254438 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.symbols 2023-11-20T06:45:56.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 309363 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.symbols.bin 2023-11-20T06:45:56.845 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/ 2023-11-20T06:45:56.845 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/share/ 2023-11-20T06:45:56.845 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/share/doc/ 2023-11-20T06:45:56.845 INFO:teuthology.orchestra.run.smithi088.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/share/doc/linux-image-6.6.0-g7678e1afe51c/ 2023-11-20T06:45:56.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 171 2023-11-20 01:52 ./usr/share/doc/linux-image-6.6.0-g7678e1afe51c/changelog.Debian.gz 2023-11-20T06:45:56.845 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r-- root/root 691 2023-11-20 01:52 ./usr/share/doc/linux-image-6.6.0-g7678e1afe51c/copyright 2023-11-20T06:45:56.846 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g7678e1afe51c 2023-11-20T06:45:56.846 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g7678e1afe51c 2023-11-20T06:45:56.846 DEBUG:teuthology.orchestra.run.smithi088:> egrep '(submenu|menuentry.*6.6.0-g7678e1afe51c).*{' /boot/grub/grub.cfg 2023-11-20T06:45:56.853 INFO:teuthology.orchestra.run.smithi088.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-20T06:45:56.853 INFO:teuthology.orchestra.run.smithi088.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g7678e1afe51c' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g7678e1afe51c-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-20T06:45:56.853 INFO:teuthology.orchestra.run.smithi088.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g7678e1afe51c (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g7678e1afe51c-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-20T06:45:56.854 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-20T06:45:56.854 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g7678e1afe51c 2023-11-20T06:45:56.854 DEBUG:teuthology.orchestra.run.smithi088:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-20T06:45:56.895 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi088.front.sepia.ceph.com to complete... 2023-11-20T06:45:57.364 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub' 2023-11-20T06:45:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-20T06:45:57.389 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2023-11-20T06:45:57.645 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-6.6.0-g7678e1afe51c 2023-11-20T06:45:57.652 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-6.6.0-g7678e1afe51c 2023-11-20T06:45:57.961 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-20T06:45:57.967 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-20T06:45:58.010 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-20T06:45:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-20T06:45:58.144 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-20T06:45:58.144 INFO:teuthology.orchestra.run.smithi088.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-20T06:45:58.144 INFO:teuthology.orchestra.run.smithi088.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-20T06:45:58.165 INFO:teuthology.orchestra.run.smithi088.stderr:done 2023-11-20T06:46:00.038 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub' 2023-11-20T06:46:00.050 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-20T06:46:00.079 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2023-11-20T06:46:00.402 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-6.6.0-g7678e1afe51c 2023-11-20T06:46:00.419 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-6.6.0-g7678e1afe51c 2023-11-20T06:46:00.694 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-20T06:46:00.711 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-20T06:46:00.780 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-20T06:46:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-20T06:46:00.923 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-20T06:46:00.923 INFO:teuthology.orchestra.run.smithi175.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-20T06:46:00.923 INFO:teuthology.orchestra.run.smithi175.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-20T06:46:00.959 INFO:teuthology.orchestra.run.smithi175.stderr:done 2023-11-20T06:46:01.166 DEBUG:teuthology.orchestra.run.smithi175:> dpkg-deb -c /tmp/linux-image.deb 2023-11-20T06:46:01.173 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./ 2023-11-20T06:46:01.174 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./boot/ 2023-11-20T06:46:01.174 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 4415617 2023-11-20 01:52 ./boot/System.map-6.6.0-g7678e1afe51c 2023-11-20T06:46:01.183 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 169214 2023-11-20 01:52 ./boot/config-6.6.0-g7678e1afe51c 2023-11-20T06:46:01.184 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11352928 2023-11-20 01:52 ./boot/vmlinuz-6.6.0-g7678e1afe51c 2023-11-20T06:46:01.201 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/ 2023-11-20T06:46:01.202 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/ 2023-11-20T06:46:01.202 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/postinst.d/ 2023-11-20T06:46:01.202 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/postrm.d/ 2023-11-20T06:46:01.202 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/preinst.d/ 2023-11-20T06:46:01.202 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./etc/kernel/prerm.d/ 2023-11-20T06:46:01.202 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/ 2023-11-20T06:46:01.202 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/ 2023-11-20T06:46:01.203 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/ 2023-11-20T06:46:01.203 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/ 2023-11-20T06:46:01.203 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/ 2023-11-20T06:46:01.203 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/ 2023-11-20T06:46:01.203 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/ 2023-11-20T06:46:01.203 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 490233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-20T06:46:01.205 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-20T06:46:01.206 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-20T06:46:01.206 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-20T06:46:01.206 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 93113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-20T06:46:01.206 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 106729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-20T06:46:01.206 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 152241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-20T06:46:01.206 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-20T06:46:01.206 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-20T06:46:01.206 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 83889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-20T06:46:01.206 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-20T06:46:01.206 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-20T06:46:01.206 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 58585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/ 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpu/ 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpu/mce/ 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/cpuid.ko 2023-11-20T06:46:01.207 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kernel/msr.ko 2023-11-20T06:46:01.208 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/ 2023-11-20T06:46:01.208 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 354433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-20T06:46:01.208 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 881625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-20T06:46:01.208 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 2275865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/arch/x86/kvm/kvm.ko 2023-11-20T06:46:01.216 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/ 2023-11-20T06:46:01.216 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/af_alg.ko 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/algif_hash.ko 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/algif_skcipher.ko 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/ansi_cprng.ko 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/anubis.ko 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/arc4.ko 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/asymmetric_keys/ 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/ 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_memcpy.ko 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_pq.ko 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_tx.ko 2023-11-20T06:46:01.217 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/async_xor.ko 2023-11-20T06:46:01.218 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/async_tx/raid6test.ko 2023-11-20T06:46:01.218 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/authenc.ko 2023-11-20T06:46:01.218 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/authencesn.ko 2023-11-20T06:46:01.218 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/blake2b_generic.ko 2023-11-20T06:46:01.218 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/blowfish_common.ko 2023-11-20T06:46:01.218 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/blowfish_generic.ko 2023-11-20T06:46:01.218 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/camellia_generic.ko 2023-11-20T06:46:01.218 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cast5_generic.ko 2023-11-20T06:46:01.218 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cast6_generic.ko 2023-11-20T06:46:01.218 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cast_common.ko 2023-11-20T06:46:01.218 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/ccm.ko 2023-11-20T06:46:01.219 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cmac.ko 2023-11-20T06:46:01.219 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crc32_generic.ko 2023-11-20T06:46:01.219 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cryptd.ko 2023-11-20T06:46:01.219 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crypto_engine.ko 2023-11-20T06:46:01.219 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crypto_simd.ko 2023-11-20T06:46:01.219 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/crypto_user.ko 2023-11-20T06:46:01.219 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/cts.ko 2023-11-20T06:46:01.219 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/des_generic.ko 2023-11-20T06:46:01.219 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/dh_generic.ko 2023-11-20T06:46:01.219 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/echainiv.ko 2023-11-20T06:46:01.219 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/essiv.ko 2023-11-20T06:46:01.219 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/fcrypt.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/khazad.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/lrw.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/lz4.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/lz4hc.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/md4.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/michael_mic.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/pcbc.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/pcrypt.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/rmd160.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/seed.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/serpent_generic.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 149193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/tcrypt.ko 2023-11-20T06:46:01.220 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/tea.ko 2023-11-20T06:46:01.221 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/twofish_common.ko 2023-11-20T06:46:01.221 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/twofish_generic.ko 2023-11-20T06:46:01.221 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/vmac.ko 2023-11-20T06:46:01.221 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/wp512.ko 2023-11-20T06:46:01.221 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xcbc.ko 2023-11-20T06:46:01.221 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xor.ko 2023-11-20T06:46:01.221 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xts.ko 2023-11-20T06:46:01.221 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/crypto/xxhash_generic.ko 2023-11-20T06:46:01.221 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ 2023-11-20T06:46:01.221 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/ 2023-11-20T06:46:01.221 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/acpi_extlog.ko 2023-11-20T06:46:01.221 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-20T06:46:01.222 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/acpi_pad.ko 2023-11-20T06:46:01.222 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/apei/ 2023-11-20T06:46:01.222 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/apei/einj.ko 2023-11-20T06:46:01.222 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/ec_sys.ko 2023-11-20T06:46:01.222 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/platform_profile.ko 2023-11-20T06:46:01.222 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/sbs.ko 2023-11-20T06:46:01.222 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/sbshc.ko 2023-11-20T06:46:01.222 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 103025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/acpi/video.ko 2023-11-20T06:46:01.222 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/ 2023-11-20T06:46:01.222 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/acard-ahci.ko 2023-11-20T06:46:01.222 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 88865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/ahci.ko 2023-11-20T06:46:01.222 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/ahci_platform.ko 2023-11-20T06:46:01.223 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 88289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/libahci.ko 2023-11-20T06:46:01.223 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/libahci_platform.ko 2023-11-20T06:46:01.223 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_acpi.ko 2023-11-20T06:46:01.223 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ali.ko 2023-11-20T06:46:01.223 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_amd.ko 2023-11-20T06:46:01.223 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_artop.ko 2023-11-20T06:46:01.223 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_atiixp.ko 2023-11-20T06:46:01.223 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_atp867x.ko 2023-11-20T06:46:01.223 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_cmd640.ko 2023-11-20T06:46:01.223 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_cmd64x.ko 2023-11-20T06:46:01.223 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_cypress.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_efar.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt366.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt37x.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_it8213.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_it821x.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_jmicron.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_legacy.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_marvell.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_mpiix.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_netcell.ko 2023-11-20T06:46:01.224 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ninja32.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ns87410.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_ns87415.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_oldpiix.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_opti.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_optidma.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_pcmcia.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_piccolo.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_radisys.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_rdc.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_rz1000.ko 2023-11-20T06:46:01.225 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_sch.ko 2023-11-20T06:46:01.226 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_serverworks.ko 2023-11-20T06:46:01.226 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_sil680.ko 2023-11-20T06:46:01.226 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_sl82c105.ko 2023-11-20T06:46:01.226 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_triflex.ko 2023-11-20T06:46:01.226 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pata_via.ko 2023-11-20T06:46:01.226 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/pdc_adma.ko 2023-11-20T06:46:01.226 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_inic162x.ko 2023-11-20T06:46:01.226 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 83345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_mv.ko 2023-11-20T06:46:01.226 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_nv.ko 2023-11-20T06:46:01.226 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_promise.ko 2023-11-20T06:46:01.226 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_qstor.ko 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sil.ko 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sil24.ko 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sis.ko 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_svw.ko 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_sx4.ko 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_uli.ko 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_via.ko 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ata/sata_vsc.ko 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/auxdisplay/ 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/auxdisplay/ks0108.ko 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/bcma/ 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 124473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/bcma/bcma.ko 2023-11-20T06:46:01.227 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/ 2023-11-20T06:46:01.228 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/aoe/ 2023-11-20T06:46:01.228 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 113665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/aoe/aoe.ko 2023-11-20T06:46:01.228 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/drbd/ 2023-11-20T06:46:01.228 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 965585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/drbd/drbd.ko 2023-11-20T06:46:01.228 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 173225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/floppy.ko 2023-11-20T06:46:01.228 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/mtip32xx/ 2023-11-20T06:46:01.228 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 94297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-20T06:46:01.271 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 115793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/nbd.ko 2023-11-20T06:46:01.272 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/null_blk/ 2023-11-20T06:46:01.272 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 110385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/null_blk/null_blk.ko 2023-11-20T06:46:01.272 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 98193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/pktcdvd.ko 2023-11-20T06:46:01.272 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 263769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/rbd.ko 2023-11-20T06:46:01.272 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/xen-blkback/ 2023-11-20T06:46:01.272 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 98145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-20T06:46:01.272 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/zram/ 2023-11-20T06:46:01.272 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/block/zram/zram.ko 2023-11-20T06:46:01.272 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ 2023-11-20T06:46:01.272 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/applicom.ko 2023-11-20T06:46:01.272 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hangcheck-timer.ko 2023-11-20T06:46:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/ 2023-11-20T06:46:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-20T06:46:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-20T06:46:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-20T06:46:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/via-rng.ko 2023-11-20T06:46:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-20T06:46:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ 2023-11-20T06:46:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-20T06:46:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 148601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-20T06:46:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-20T06:46:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 139313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-20T06:46:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-20T06:46:01.274 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-20T06:46:01.274 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/lp.ko 2023-11-20T06:46:01.274 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/mwave/ 2023-11-20T06:46:01.274 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 84097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/mwave/mwave.ko 2023-11-20T06:46:01.274 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/nvram.ko 2023-11-20T06:46:01.274 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/ppdev.ko 2023-11-20T06:46:01.274 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tlclk.ko 2023-11-20T06:46:01.274 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/ 2023-11-20T06:46:01.274 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-20T06:46:01.274 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-20T06:46:01.274 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/ 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/ 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-palmas.ko 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-si5351.ko 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-twl6040.ko 2023-11-20T06:46:01.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/clk/clk-wm831x.ko 2023-11-20T06:46:01.276 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/ 2023-11-20T06:46:01.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-20T06:46:01.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-20T06:46:01.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-20T06:46:01.276 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ 2023-11-20T06:46:01.276 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ccp/ 2023-11-20T06:46:01.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-20T06:46:01.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 243025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/ccp/ccp.ko 2023-11-20T06:46:01.276 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/ 2023-11-20T06:46:01.276 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/ 2023-11-20T06:46:01.276 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-20T06:46:01.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 438761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-20T06:46:01.277 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-20T06:46:01.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-20T06:46:01.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/padlock-aes.ko 2023-11-20T06:46:01.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/padlock-sha.ko 2023-11-20T06:46:01.277 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/virtio/ 2023-11-20T06:46:01.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-20T06:46:01.277 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dca/ 2023-11-20T06:46:01.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dca/dca.ko 2023-11-20T06:46:01.277 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/ 2023-11-20T06:46:01.277 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/dw/ 2023-11-20T06:46:01.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-20T06:46:01.278 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/ioat/ 2023-11-20T06:46:01.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 122569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-20T06:46:01.278 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/ 2023-11-20T06:46:01.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 79953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/amd64_edac.ko 2023-11-20T06:46:01.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/e752x_edac.ko 2023-11-20T06:46:01.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 63617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/edac_mce_amd.ko 2023-11-20T06:46:01.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i3000_edac.ko 2023-11-20T06:46:01.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i3200_edac.ko 2023-11-20T06:46:01.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i5100_edac.ko 2023-11-20T06:46:01.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i5400_edac.ko 2023-11-20T06:46:01.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i7300_edac.ko 2023-11-20T06:46:01.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i7core_edac.ko 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/i82975x_edac.ko 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/ie31200_edac.ko 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 56825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/sb_edac.ko 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/edac/x38_edac.ko 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/ 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-gpio.ko 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-max14577.ko 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-max77693.ko 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-max8997.ko 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-palmas.ko 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-20T06:46:01.279 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/ 2023-11-20T06:46:01.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-20T06:46:01.280 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/efi/ 2023-11-20T06:46:01.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-20T06:46:01.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-20T06:46:01.280 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/ 2023-11-20T06:46:01.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-20T06:46:01.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-20T06:46:01.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-arizona.ko 2023-11-20T06:46:01.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-da9052.ko 2023-11-20T06:46:01.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-da9055.ko 2023-11-20T06:46:01.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-dln2.ko 2023-11-20T06:46:01.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 77849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-20T06:46:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-generic.ko 2023-11-20T06:46:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-ich.ko 2023-11-20T06:46:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-20T06:46:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-kempld.ko 2023-11-20T06:46:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-20T06:46:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-max7300.ko 2023-11-20T06:46:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-max730x.ko 2023-11-20T06:46:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-max732x.ko 2023-11-20T06:46:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-20T06:46:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-20T06:46:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-20T06:46:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-sch.ko 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-vx855.ko 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/ 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-a4tech.ko 2023-11-20T06:46:01.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-apple.ko 2023-11-20T06:46:01.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-appleir.ko 2023-11-20T06:46:01.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-aureal.ko 2023-11-20T06:46:01.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-axff.ko 2023-11-20T06:46:01.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-belkin.ko 2023-11-20T06:46:01.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-cherry.ko 2023-11-20T06:46:01.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-chicony.ko 2023-11-20T06:46:01.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-cp2112.ko 2023-11-20T06:46:01.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-cypress.ko 2023-11-20T06:46:01.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-dr.ko 2023-11-20T06:46:01.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-elecom.ko 2023-11-20T06:46:01.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-elo.ko 2023-11-20T06:46:01.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-emsff.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-ezkey.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-gaff.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-generic.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-gt683r.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-gyration.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-holtekff.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-hyperv.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-icade.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-kensington.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-keytouch.ko 2023-11-20T06:46:01.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-kye.ko 2023-11-20T06:46:01.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-lcpower.ko 2023-11-20T06:46:01.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-led.ko 2023-11-20T06:46:01.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-lenovo.ko 2023-11-20T06:46:01.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-lg-g15.ko 2023-11-20T06:46:01.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 58185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-20T06:46:01.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 101481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-20T06:46:01.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 80993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-logitech.ko 2023-11-20T06:46:01.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-magicmouse.ko 2023-11-20T06:46:01.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-microsoft.ko 2023-11-20T06:46:01.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-monterey.ko 2023-11-20T06:46:01.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-multitouch.ko 2023-11-20T06:46:01.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-ntrig.ko 2023-11-20T06:46:01.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-ortek.ko 2023-11-20T06:46:01.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-penmount.ko 2023-11-20T06:46:01.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-petalynx.ko 2023-11-20T06:46:01.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 72937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-picolcd.ko 2023-11-20T06:46:01.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-pl.ko 2023-11-20T06:46:01.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-plantronics.ko 2023-11-20T06:46:01.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-primax.ko 2023-11-20T06:46:01.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-rmi.ko 2023-11-20T06:46:01.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-20T06:46:01.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-common.ko 2023-11-20T06:46:01.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-20T06:46:01.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-roccat.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-saitek.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-samsung.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sjoy.ko 2023-11-20T06:46:01.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sony.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-speedlink.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-steelseries.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-sunplus.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-tivo.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-tmff.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-topseed.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-twinhan.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 71073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-uclogic.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-waltop.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 143473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-wiimote.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-xinmo.ko 2023-11-20T06:46:01.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-zpff.ko 2023-11-20T06:46:01.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid-zydacron.ko 2023-11-20T06:46:01.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 267825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/hid.ko 2023-11-20T06:46:01.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/uhid.ko 2023-11-20T06:46:01.289 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/ 2023-11-20T06:46:01.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 125721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-20T06:46:01.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-20T06:46:01.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-20T06:46:01.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 217873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hid/wacom.ko 2023-11-20T06:46:01.289 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/ 2023-11-20T06:46:01.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 64201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/hv_balloon.ko 2023-11-20T06:46:01.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 89625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/hv_utils.ko 2023-11-20T06:46:01.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 305465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hv/hv_vmbus.ko 2023-11-20T06:46:01.290 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ 2023-11-20T06:46:01.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/abituguru.ko 2023-11-20T06:46:01.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/abituguru3.ko 2023-11-20T06:46:01.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-20T06:46:01.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ad7414.ko 2023-11-20T06:46:01.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ad7418.ko 2023-11-20T06:46:01.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adc128d818.ko 2023-11-20T06:46:01.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1025.ko 2023-11-20T06:46:01.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 97977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1026.ko 2023-11-20T06:46:01.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1029.ko 2023-11-20T06:46:01.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm1031.ko 2023-11-20T06:46:01.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adm9240.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ads7828.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7410.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7411.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 74433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7462.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7470.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7475.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/adt7x10.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/amc6821.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/applesmc.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/asb100.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 58617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/asc7621.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-20T06:46:01.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/atxp1.ko 2023-11-20T06:46:01.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/coretemp.ko 2023-11-20T06:46:01.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-20T06:46:01.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-20T06:46:01.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-20T06:46:01.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 99601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/dme1737.ko 2023-11-20T06:46:01.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ds1621.ko 2023-11-20T06:46:01.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ds620.ko 2023-11-20T06:46:01.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/emc1403.ko 2023-11-20T06:46:01.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/emc2103.ko 2023-11-20T06:46:01.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/emc6w201.ko 2023-11-20T06:46:01.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/f71805f.ko 2023-11-20T06:46:01.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 94457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/f71882fg.ko 2023-11-20T06:46:01.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/f75375s.ko 2023-11-20T06:46:01.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/fam15h_power.ko 2023-11-20T06:46:01.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/fschmd.ko 2023-11-20T06:46:01.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/g760a.ko 2023-11-20T06:46:01.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/g762.ko 2023-11-20T06:46:01.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/gl518sm.ko 2023-11-20T06:46:01.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/gl520sm.ko 2023-11-20T06:46:01.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/hih6130.ko 2023-11-20T06:46:01.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-20T06:46:01.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/i5500_temp.ko 2023-11-20T06:46:01.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/i5k_amb.ko 2023-11-20T06:46:01.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ibmaem.ko 2023-11-20T06:46:01.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ibmpex.ko 2023-11-20T06:46:01.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ina209.ko 2023-11-20T06:46:01.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ina2xx.ko 2023-11-20T06:46:01.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 130449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/it87.ko 2023-11-20T06:46:01.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/jc42.ko 2023-11-20T06:46:01.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/k10temp.ko 2023-11-20T06:46:01.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/k8temp.ko 2023-11-20T06:46:01.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lineage-pem.ko 2023-11-20T06:46:01.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm63.ko 2023-11-20T06:46:01.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm73.ko 2023-11-20T06:46:01.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm75.ko 2023-11-20T06:46:01.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm77.ko 2023-11-20T06:46:01.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm78.ko 2023-11-20T06:46:01.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm80.ko 2023-11-20T06:46:01.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm83.ko 2023-11-20T06:46:01.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 72833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm85.ko 2023-11-20T06:46:01.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm87.ko 2023-11-20T06:46:01.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm90.ko 2023-11-20T06:46:01.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm92.ko 2023-11-20T06:46:01.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 108841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm93.ko 2023-11-20T06:46:01.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm95234.ko 2023-11-20T06:46:01.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm95241.ko 2023-11-20T06:46:01.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/lm95245.ko 2023-11-20T06:46:01.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc2945.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4151.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4215.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4222.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4245.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4260.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/ltc4261.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max16065.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max1619.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max1668.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max197.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max6639.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max6650.ko 2023-11-20T06:46:01.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/max6697.ko 2023-11-20T06:46:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-20T06:46:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/mcp3021.ko 2023-11-20T06:46:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-20T06:46:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct6683.ko 2023-11-20T06:46:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 119817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct6775-core.ko 2023-11-20T06:46:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct6775.ko 2023-11-20T06:46:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/nct7802.ko 2023-11-20T06:46:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 82337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pc87360.ko 2023-11-20T06:46:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pc87427.ko 2023-11-20T06:46:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pcf8591.ko 2023-11-20T06:46:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ 2023-11-20T06:46:01.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-20T06:46:01.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-20T06:46:01.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-20T06:46:01.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-20T06:46:01.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-20T06:46:01.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-20T06:46:01.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-20T06:46:01.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 82577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-20T06:46:01.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-20T06:46:01.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-20T06:46:01.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-20T06:46:01.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-20T06:46:01.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/powr1220.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sch5627.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sch5636.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sht15.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sht21.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/shtc1.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/sis5595.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/smsc47b397.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/smsc47m1.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/smsc47m192.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/thmc50.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp102.ko 2023-11-20T06:46:01.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp103.ko 2023-11-20T06:46:01.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp401.ko 2023-11-20T06:46:01.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/tmp421.ko 2023-11-20T06:46:01.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/via-cputemp.ko 2023-11-20T06:46:01.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/via686a.ko 2023-11-20T06:46:01.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/vt1211.ko 2023-11-20T06:46:01.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/vt8231.ko 2023-11-20T06:46:01.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83627ehf.ko 2023-11-20T06:46:01.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83627hf.ko 2023-11-20T06:46:01.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 71345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83781d.ko 2023-11-20T06:46:01.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 63225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83791d.ko 2023-11-20T06:46:01.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 71321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83792d.ko 2023-11-20T06:46:01.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 101473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83793.ko 2023-11-20T06:46:01.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 119505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83795.ko 2023-11-20T06:46:01.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83l785ts.ko 2023-11-20T06:46:01.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/w83l786ng.ko 2023-11-20T06:46:01.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-20T06:46:01.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-20T06:46:01.301 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/ 2023-11-20T06:46:01.301 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/algos/ 2023-11-20T06:46:01.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-20T06:46:01.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-20T06:46:01.301 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/ 2023-11-20T06:46:01.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-20T06:46:01.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-20T06:46:01.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-20T06:46:01.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-20T06:46:01.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-20T06:46:01.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-20T06:46:01.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-20T06:46:01.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 6929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-20T06:46:01.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-20T06:46:01.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-20T06:46:01.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-20T06:46:01.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-20T06:46:01.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-20T06:46:01.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-20T06:46:01.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-20T06:46:01.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-20T06:46:01.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-20T06:46:01.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-20T06:46:01.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-20T06:46:01.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-20T06:46:01.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-20T06:46:01.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-20T06:46:01.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-20T06:46:01.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-20T06:46:01.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-20T06:46:01.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/i2c-mux.ko 2023-11-20T06:46:01.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/i2c-smbus.ko 2023-11-20T06:46:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/i2c-stub.ko 2023-11-20T06:46:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/ 2023-11-20T06:46:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-20T06:46:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-20T06:46:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-20T06:46:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ 2023-11-20T06:46:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ 2023-11-20T06:46:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 273609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-20T06:46:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 879969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_core.ko 2023-11-20T06:46:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 69273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-20T06:46:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 324217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-20T06:46:01.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 97985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-20T06:46:01.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 282273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-20T06:46:01.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-20T06:46:01.306 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/ 2023-11-20T06:46:01.306 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-20T06:46:01.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 493073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-20T06:46:01.306 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx4/ 2023-11-20T06:46:01.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 419737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-20T06:46:01.306 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx5/ 2023-11-20T06:46:01.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 739025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-20T06:46:01.306 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mthca/ 2023-11-20T06:46:01.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 296625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-20T06:46:01.306 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 153697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/usnic/ 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 168969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/ 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 263081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/iser/ 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 100241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/isert/ 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 111425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srp/ 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 128753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-20T06:46:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srpt/ 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 129529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/ 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/evbug.ko 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/ff-memless.ko 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/ 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/gameport/gameport.ko 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/joydev.ko 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/ 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-20T06:46:01.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/lm8323.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/lm8333.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-20T06:46:01.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/qt1070.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/qt2160.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/stowaway.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/matrix-keymap.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/ 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/appletouch.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/bcm5974.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 123681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/cyapatp.ko 2023-11-20T06:46:01.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 89449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 335929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/psmouse.ko 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/sermouse.ko 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/rmi4/ 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 109873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/ 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/altera_ps2.ko 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/arc_ps2.ko 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/ct82c710.ko 2023-11-20T06:46:01.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-20T06:46:01.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/parkbd.ko 2023-11-20T06:46:01.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/pcips2.ko 2023-11-20T06:46:01.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/ps2mult.ko 2023-11-20T06:46:01.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/serio_raw.ko 2023-11-20T06:46:01.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/serio/serport.ko 2023-11-20T06:46:01.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/input/sparse-keymap.ko 2023-11-20T06:46:01.312 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/iommu/ 2023-11-20T06:46:01.312 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/iommu/amd/ 2023-11-20T06:46:01.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-20T06:46:01.312 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/ 2023-11-20T06:46:01.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-88pm860x.ko 2023-11-20T06:46:01.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-adp5520.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-bd2802.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-blinkm.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-da903x.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-da9052.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-gpio.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm3530.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm3533.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm355x.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lm3642.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lp3944.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-lp8788.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-max8997.ko 2023-11-20T06:46:01.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-mc13783.ko 2023-11-20T06:46:01.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-20T06:46:01.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-pca9532.ko 2023-11-20T06:46:01.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-pca955x.ko 2023-11-20T06:46:01.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-pca963x.ko 2023-11-20T06:46:01.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-ss4200.ko 2023-11-20T06:46:01.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-tca6507.ko 2023-11-20T06:46:01.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-20T06:46:01.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/leds-wm8350.ko 2023-11-20T06:46:01.314 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ 2023-11-20T06:46:01.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-20T06:46:01.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-20T06:46:01.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/ 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/bcache/ 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 654969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/bcache/bcache.ko 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-bio-prison.ko 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 89601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-bufio.ko 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-cache-smq.ko 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 156009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-cache.ko 2023-11-20T06:46:01.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 106897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-crypt.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-delay.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-era.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-flakey.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-log-userspace.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-log.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-mirror.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-multipath.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-queue-length.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-raid.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-region-hash.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-round-robin.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-service-time.ko 2023-11-20T06:46:01.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 109529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-snapshot.ko 2023-11-20T06:46:01.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-switch.ko 2023-11-20T06:46:01.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 181865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-thin-pool.ko 2023-11-20T06:46:01.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-verity.ko 2023-11-20T06:46:01.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/dm-zero.ko 2023-11-20T06:46:01.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/faulty.ko 2023-11-20T06:46:01.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/linear.ko 2023-11-20T06:46:01.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/multipath.ko 2023-11-20T06:46:01.317 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/persistent-data/ 2023-11-20T06:46:01.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 199937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-20T06:46:01.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid0.ko 2023-11-20T06:46:01.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 113073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid1.ko 2023-11-20T06:46:01.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 158681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid10.ko 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 395721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/md/raid456.ko 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/ 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/ 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 178137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptbase.ko 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 63385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptctl.ko 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptfc.ko 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptlan.ko 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 123321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptsas.ko 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 79041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptscsih.ko 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/message/fusion/mptspi.ko 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/ 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/88pm800.ko 2023-11-20T06:46:01.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/88pm805.ko 2023-11-20T06:46:01.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/88pm80x.ko 2023-11-20T06:46:01.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/arizona-i2c.ko 2023-11-20T06:46:01.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 123721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/arizona.ko 2023-11-20T06:46:01.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/bcm590xx.ko 2023-11-20T06:46:01.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-20T06:46:01.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/dln2.ko 2023-11-20T06:46:01.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/janz-cmodio.ko 2023-11-20T06:46:01.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/kempld-core.ko 2023-11-20T06:46:01.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lm3533-core.ko 2023-11-20T06:46:01.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-20T06:46:01.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lp3943.ko 2023-11-20T06:46:01.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lpc_ich.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/lpc_sch.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/max8907.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/menf21bmc.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/pcf50633.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/retu-mfd.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 80425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/si476x-core.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/sm501.ko 2023-11-20T06:46:01.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/tps65010.ko 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/tps6507x.ko 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/viperboard.ko 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/vx855.ko 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/wl1273-core.ko 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/mfd/wm8994.ko 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ad525x_dpot.ko 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/altera-stapl/ 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/apds9802als.ko 2023-11-20T06:46:01.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/apds990x.ko 2023-11-20T06:46:01.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/bh1770glc.ko 2023-11-20T06:46:01.322 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/c2port/ 2023-11-20T06:46:01.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-20T06:46:01.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/c2port/core.ko 2023-11-20T06:46:01.322 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/cb710/ 2023-11-20T06:46:01.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/cb710/cb710.ko 2023-11-20T06:46:01.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ds1682.ko 2023-11-20T06:46:01.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/dummy-irq.ko 2023-11-20T06:46:01.322 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/echo/ 2023-11-20T06:46:01.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/echo/echo.ko 2023-11-20T06:46:01.322 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/ 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/at24.ko 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/eeprom/max6875.ko 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/enclosure.ko 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/genwqe/ 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 152201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/hmc6352.ko 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/hpilo.ko 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ibmasm/ 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 72129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ics932s401.ko 2023-11-20T06:46:01.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/isl29003.ko 2023-11-20T06:46:01.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/isl29020.ko 2023-11-20T06:46:01.324 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/lis3lv02d/ 2023-11-20T06:46:01.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-20T06:46:01.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-20T06:46:01.324 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/ 2023-11-20T06:46:01.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 125209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/mei-me.ko 2023-11-20T06:46:01.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 56521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/mei-txe.ko 2023-11-20T06:46:01.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 310113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/mei/mei.ko 2023-11-20T06:46:01.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/phantom.ko 2023-11-20T06:46:01.324 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ti-st/ 2023-11-20T06:46:01.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 74265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-20T06:46:01.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/tifm_7xx1.ko 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/tifm_core.ko 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/tsl2550.ko 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/vmw_balloon.ko 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/vmw_vmci/ 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 183609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/bonding/ 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 490129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/bonding/bonding.ko 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/ 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/b53/ 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 106033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-20T06:46:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-20T06:46:01.326 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-20T06:46:01.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 453737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-20T06:46:01.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/dummy.ko 2023-11-20T06:46:01.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/eql.ko 2023-11-20T06:46:01.326 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ 2023-11-20T06:46:01.326 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/ 2023-11-20T06:46:01.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-20T06:46:01.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-20T06:46:01.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 130553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-20T06:46:01.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 68849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-20T06:46:01.326 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/ 2023-11-20T06:46:01.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-20T06:46:01.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-20T06:46:01.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-20T06:46:01.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 99049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-20T06:46:01.327 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/adaptec/ 2023-11-20T06:46:01.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-20T06:46:01.327 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/agere/ 2023-11-20T06:46:01.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 69137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-20T06:46:01.327 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/alteon/ 2023-11-20T06:46:01.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-20T06:46:01.327 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/altera/ 2023-11-20T06:46:01.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-20T06:46:01.327 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/ 2023-11-20T06:46:01.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-20T06:46:01.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-20T06:46:01.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 87297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-20T06:46:01.328 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/ 2023-11-20T06:46:01.328 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-20T06:46:01.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 97337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-20T06:46:01.328 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-20T06:46:01.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 104673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-20T06:46:01.328 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-20T06:46:01.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 90257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-20T06:46:01.328 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-20T06:46:01.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 81569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 69729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/ 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 176761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1421497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 128569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 132089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 312081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/brocade/ 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-20T06:46:01.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 323513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-20T06:46:01.409 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/ 2023-11-20T06:46:01.409 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-20T06:46:01.409 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 193497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-20T06:46:01.409 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-20T06:46:01.409 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 347417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-20T06:46:01.409 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-20T06:46:01.409 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1044497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-20T06:46:01.409 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-20T06:46:01.409 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 166193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-20T06:46:01.409 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-20T06:46:01.410 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-20T06:46:01.410 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/cisco/ 2023-11-20T06:46:01.410 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-20T06:46:01.410 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 204345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-20T06:46:01.410 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/ 2023-11-20T06:46:01.410 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-20T06:46:01.410 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 69449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-20T06:46:01.410 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-20T06:46:01.410 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 141225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-20T06:46:01.410 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-20T06:46:01.410 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-20T06:46:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-20T06:46:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dlink/ 2023-11-20T06:46:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-20T06:46:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-20T06:46:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/dnet.ko 2023-11-20T06:46:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-20T06:46:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/emulex/ 2023-11-20T06:46:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-20T06:46:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 281137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-20T06:46:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ethoc.ko 2023-11-20T06:46:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/fealnx.ko 2023-11-20T06:46:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/fujitsu/ 2023-11-20T06:46:01.412 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-20T06:46:01.412 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ 2023-11-20T06:46:01.412 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 90465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-20T06:46:01.412 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-20T06:46:01.412 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 295577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-20T06:46:01.412 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-20T06:46:01.412 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 584497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-20T06:46:01.412 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-20T06:46:01.412 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 246209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-20T06:46:01.412 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-20T06:46:01.412 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 925825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-20T06:46:01.412 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-20T06:46:01.413 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 302937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-20T06:46:01.413 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igb/ 2023-11-20T06:46:01.413 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 514641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-20T06:46:01.413 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-20T06:46:01.413 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 93593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-20T06:46:01.413 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-20T06:46:01.413 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 734305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-20T06:46:01.413 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-20T06:46:01.413 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 151769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-20T06:46:01.413 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 86921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/jme.ko 2023-11-20T06:46:01.413 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/ 2023-11-20T06:46:01.413 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-20T06:46:01.414 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 102289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-20T06:46:01.414 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 122649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-20T06:46:01.414 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/ 2023-11-20T06:46:01.414 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-20T06:46:01.414 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 727601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-20T06:46:01.414 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 278937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-20T06:46:01.414 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-20T06:46:01.414 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-20T06:46:01.414 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1113681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-20T06:46:01.414 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ 2023-11-20T06:46:01.414 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 95665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/myricom/ 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 108649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/natsemi/ 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 73441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/neterion/ 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 150905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/nvidia/ 2023-11-20T06:46:01.415 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 136721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-20T06:46:01.416 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/packetengines/ 2023-11-20T06:46:01.416 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-20T06:46:01.416 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-20T06:46:01.416 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/ 2023-11-20T06:46:01.416 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-20T06:46:01.416 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 227897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-20T06:46:01.416 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 87081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-20T06:46:01.416 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-20T06:46:01.416 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 672049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-20T06:46:01.416 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/rdc/ 2023-11-20T06:46:01.416 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-20T06:46:01.416 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/ 2023-11-20T06:46:01.417 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-20T06:46:01.417 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 83985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-20T06:46:01.417 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-20T06:46:01.417 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 189801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-20T06:46:01.417 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/samsung/ 2023-11-20T06:46:01.417 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-20T06:46:01.417 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 104241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-20T06:46:01.417 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sfc/ 2023-11-20T06:46:01.417 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1052497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-20T06:46:01.417 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/silan/ 2023-11-20T06:46:01.417 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-20T06:46:01.417 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sis/ 2023-11-20T06:46:01.418 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-20T06:46:01.418 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 63337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-20T06:46:01.418 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/ 2023-11-20T06:46:01.418 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-20T06:46:01.418 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-20T06:46:01.418 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 73409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-20T06:46:01.418 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 68177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-20T06:46:01.418 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/ 2023-11-20T06:46:01.418 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-20T06:46:01.418 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-20T06:46:01.418 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-20T06:46:01.418 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 487025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/ 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 103337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 166097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/tehuti/ 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ti/ 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 86529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/via/ 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 80273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-20T06:46:01.419 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 83633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-20T06:46:01.420 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/wiznet/ 2023-11-20T06:46:01.420 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-20T06:46:01.420 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-20T06:46:01.420 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/xircom/ 2023-11-20T06:46:01.420 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-20T06:46:01.420 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/ 2023-11-20T06:46:01.420 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/defxx.ko 2023-11-20T06:46:01.420 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/skfp/ 2023-11-20T06:46:01.420 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 216985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-20T06:46:01.420 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 77345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/geneve.ko 2023-11-20T06:46:01.420 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/hyperv/ 2023-11-20T06:46:01.420 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 235521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ieee802154/ 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ifb.ko 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ipvlan/ 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 83769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/macvlan.ko 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/macvtap.ko 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/ 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-20T06:46:01.421 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mdio.ko 2023-11-20T06:46:01.422 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/mii.ko 2023-11-20T06:46:01.422 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/netconsole.ko 2023-11-20T06:46:01.422 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/nlmon.ko 2023-11-20T06:46:01.422 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/pcs/ 2023-11-20T06:46:01.422 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-20T06:46:01.422 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-20T06:46:01.422 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/ 2023-11-20T06:46:01.422 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/amd.ko 2023-11-20T06:46:01.422 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-20T06:46:01.422 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-20T06:46:01.422 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/bcm87xx.ko 2023-11-20T06:46:01.422 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/broadcom.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/cicada.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/davicom.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/et1011c.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/icplus.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/lxt.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 82049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/marvell.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 76113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/micrel.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/national.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 97857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/phylink.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/qsemi.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/realtek.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/smsc.ko 2023-11-20T06:46:01.423 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/ste10Xp.ko 2023-11-20T06:46:01.424 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/phy/vitesse.ko 2023-11-20T06:46:01.424 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/plip/ 2023-11-20T06:46:01.424 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/plip/plip.ko 2023-11-20T06:46:01.424 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ 2023-11-20T06:46:01.424 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-20T06:46:01.424 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_async.ko 2023-11-20T06:46:01.424 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-20T06:46:01.424 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-20T06:46:01.424 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-20T06:46:01.424 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/pppoe.ko 2023-11-20T06:46:01.424 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/pppox.ko 2023-11-20T06:46:01.424 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/ppp/pptp.ko 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/sb1000.ko 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/slip/ 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/slip/slip.ko 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/sungem_phy.ko 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 64449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/tap.ko 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/ 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 106169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team.ko 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_random.ko 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-20T06:46:01.425 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 87017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/veth.ko 2023-11-20T06:46:01.426 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vmxnet3/ 2023-11-20T06:46:01.426 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 144297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-20T06:46:01.426 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vxlan/ 2023-11-20T06:46:01.426 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 297329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/vxlan/vxlan.ko 2023-11-20T06:46:01.426 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/xen-netback/ 2023-11-20T06:46:01.426 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 144585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-20T06:46:01.426 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ntb/ 2023-11-20T06:46:01.426 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ntb/ntb.ko 2023-11-20T06:46:01.426 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/ 2023-11-20T06:46:01.426 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/host/ 2023-11-20T06:46:01.426 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 265121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/host/nvme-core.ko 2023-11-20T06:46:01.426 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 102209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/nvme/host/nvme.ko 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/ 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 133841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport.ko 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport_cs.ko 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 84465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport_pc.ko 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/parport/parport_serial.ko 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/ 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/ 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/pci-stub.ko 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pci/xen-pcifront.ko 2023-11-20T06:46:01.427 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/ 2023-11-20T06:46:01.428 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/i82092.ko 2023-11-20T06:46:01.428 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 145809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pcmcia.ko 2023-11-20T06:46:01.428 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-20T06:46:01.428 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-20T06:46:01.428 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/pd6729.ko 2023-11-20T06:46:01.428 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 112889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-20T06:46:01.428 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/ 2023-11-20T06:46:01.428 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/broadcom/ 2023-11-20T06:46:01.428 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-20T06:46:01.428 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/samsung/ 2023-11-20T06:46:01.428 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-20T06:46:01.428 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pinctrl/ 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pinctrl/intel/ 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/ 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/ 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/ 2023-11-20T06:46:01.429 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/acerhdf.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 127441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/hdaps.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-20T06:46:01.430 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel/ 2023-11-20T06:46:01.431 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-20T06:46:01.431 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-20T06:46:01.431 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/intel_ips.ko 2023-11-20T06:46:01.431 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-20T06:46:01.431 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-20T06:46:01.431 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-20T06:46:01.431 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-20T06:46:01.431 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-20T06:46:01.431 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-20T06:46:01.431 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-20T06:46:01.431 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-20T06:46:01.431 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/platform/x86/wmi.ko 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/ 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/da9030_battery.ko 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/da9052-battery.ko 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-20T06:46:01.432 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/gpio-charger.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max14577_charger.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max17040_battery.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max17042_battery.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max8903_charger.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/max8925_power.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/sbs-battery.ko 2023-11-20T06:46:01.433 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/test_power.ko 2023-11-20T06:46:01.434 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-20T06:46:01.434 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-20T06:46:01.434 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/wm831x_power.ko 2023-11-20T06:46:01.434 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/power/supply/wm8350_power.ko 2023-11-20T06:46:01.434 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/powercap/ 2023-11-20T06:46:01.434 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-20T06:46:01.434 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-20T06:46:01.434 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/ 2023-11-20T06:46:01.434 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/ 2023-11-20T06:46:01.434 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-20T06:46:01.434 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-20T06:46:01.434 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/clients/pps_parport.ko 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/pps/pps_core.ko 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ptp/ 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ptp/ptp.ko 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ptp/ptp_kvm.ko 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/ 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-da9052.ko 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-da9055.ko 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-da9063.ko 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-20T06:46:01.435 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 68577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-em3027.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-20T06:46:01.436 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max6900.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8907.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8925.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8997.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-max8998.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-palmas.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-20T06:46:01.437 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-20T06:46:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-20T06:46:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-20T06:46:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-20T06:46:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-20T06:46:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-20T06:46:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-20T06:46:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-20T06:46:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-20T06:46:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-20T06:46:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-20T06:46:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-20T06:46:01.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/rtc/rtc-x1205.ko 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 77617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/3w-9xxx.ko 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/3w-sas.ko 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/3w-xxxx.ko 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 135185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/BusLogic.ko 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/a100u2w.ko 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aacraid/ 2023-11-20T06:46:01.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 272305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 100617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/advansys.ko 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic7xxx/ 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 356201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 295801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic94xx/ 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 189185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/am53c974.ko 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/arcmsr/ 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 106881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/atp870u.ko 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/be2iscsi/ 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 246985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-20T06:46:01.440 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bfa/ 2023-11-20T06:46:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1171945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bfa/bfa.ko 2023-11-20T06:46:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2fc/ 2023-11-20T06:46:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 237273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-20T06:46:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2i/ 2023-11-20T06:46:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 115369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-20T06:46:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ch.ko 2023-11-20T06:46:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/csiostor/ 2023-11-20T06:46:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 308921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-20T06:46:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/ 2023-11-20T06:46:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-20T06:46:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 76145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-20T06:46:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-20T06:46:01.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 101449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-20T06:46:01.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 146689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-20T06:46:01.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 75553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/dc395x.ko 2023-11-20T06:46:01.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/dmx3191d.ko 2023-11-20T06:46:01.442 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/esas2r/ 2023-11-20T06:46:01.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 212425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-20T06:46:01.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/esp_scsi.ko 2023-11-20T06:46:01.442 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fcoe/ 2023-11-20T06:46:01.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-20T06:46:01.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 158505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-20T06:46:01.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fdomain.ko 2023-11-20T06:46:01.442 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fnic/ 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 263489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/fnic/fnic.ko 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 201817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/hpsa.ko 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/hptiop.ko 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/hv_storvsc.ko 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/imm.ko 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/initio.ko 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 266537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ipr.ko 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 101881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ips.ko 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/isci/ 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 317153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/isci/isci.ko 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-20T06:46:01.443 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libfc/ 2023-11-20T06:46:01.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 314865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libfc/libfc.ko 2023-11-20T06:46:01.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 145585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libiscsi.ko 2023-11-20T06:46:01.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-20T06:46:01.444 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libsas/ 2023-11-20T06:46:01.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 216665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/libsas/libsas.ko 2023-11-20T06:46:01.444 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/lpfc/ 2023-11-20T06:46:01.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 2197249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-20T06:46:01.444 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/ 2023-11-20T06:46:01.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 73569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-20T06:46:01.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-20T06:46:01.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 310617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-20T06:46:01.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 84721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/megaraid.ko 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mpt3sas/ 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 659825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mvsas/ 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 119561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/mvumi.ko 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/ 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 81625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pm8001/ 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 364105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-20T06:46:01.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 123617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/pmcraid.ko 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ppa.ko 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla1280.ko 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla2xxx/ 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1876689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla4xxx/ 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 559033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/qlogicfas408.ko 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/raid_class.ko 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 238761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_debug.ko 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 173937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 279313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-20T06:46:01.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 97729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-20T06:46:01.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 73881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-20T06:46:01.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-20T06:46:01.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/ses.ko 2023-11-20T06:46:01.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 115889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/st.ko 2023-11-20T06:46:01.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/stex.ko 2023-11-20T06:46:01.447 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-20T06:46:01.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 162121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-20T06:46:01.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/virtio_scsi.ko 2023-11-20T06:46:01.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-20T06:46:01.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/wd719x.ko 2023-11-20T06:46:01.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/scsi/xen-scsifront.ko 2023-11-20T06:46:01.447 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ssb/ 2023-11-20T06:46:01.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 129441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ssb/ssb.ko 2023-11-20T06:46:01.448 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/ 2023-11-20T06:46:01.448 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/iscsi/ 2023-11-20T06:46:01.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 736601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-20T06:46:01.448 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/loopback/ 2023-11-20T06:46:01.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-20T06:46:01.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_file.ko 2023-11-20T06:46:01.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_iblock.ko 2023-11-20T06:46:01.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 930257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_mod.ko 2023-11-20T06:46:01.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_pscsi.ko 2023-11-20T06:46:01.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 122521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/target_core_user.ko 2023-11-20T06:46:01.448 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/tcm_fc/ 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 75593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/ 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/ 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-20T06:46:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-20T06:46:01.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-20T06:46:01.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-20T06:46:01.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-20T06:46:01.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-20T06:46:01.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-20T06:46:01.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-20T06:46:01.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-20T06:46:01.450 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/ 2023-11-20T06:46:01.450 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/ipwireless/ 2023-11-20T06:46:01.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-20T06:46:01.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/moxa.ko 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/mxser.ko 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 108601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/n_gsm.ko 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/n_hdlc.ko 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/nozomi.ko 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/ 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/8250/ 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/altera_uart.ko 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/arc_uart.ko 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 72425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-20T06:46:01.451 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/jsm/ 2023-11-20T06:46:01.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 103073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-20T06:46:01.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/rp2.ko 2023-11-20T06:46:01.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-20T06:46:01.452 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/ 2023-11-20T06:46:01.452 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/core/ 2023-11-20T06:46:01.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 531265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-20T06:46:01.452 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/host/ 2023-11-20T06:46:01.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-20T06:46:01.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-20T06:46:01.452 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/ 2023-11-20T06:46:01.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio.ko 2023-11-20T06:46:01.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_aec.ko 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_cif.ko 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_mf624.ko 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_netx.ko 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_pci_generic.ko 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/uio/uio_sercos3.ko 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/ 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/c67x00/ 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 73297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 144377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-20T06:46:01.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-20T06:46:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-20T06:46:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-20T06:46:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/ 2023-11-20T06:46:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 87089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/cdc-acm.ko 2023-11-20T06:46:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-20T06:46:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/usblp.ko 2023-11-20T06:46:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 89857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/class/usbtmc.ko 2023-11-20T06:46:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/common/ 2023-11-20T06:46:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/common/ulpi.ko 2023-11-20T06:46:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc2/ 2023-11-20T06:46:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-20T06:46:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/ 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 448505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/ 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/ 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 92489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-20T06:46:01.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 122081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 58113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/ 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-20T06:46:01.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-20T06:46:01.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-20T06:46:01.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-20T06:46:01.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-20T06:46:01.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-20T06:46:01.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-20T06:46:01.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-20T06:46:01.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-20T06:46:01.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-20T06:46:01.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-20T06:46:01.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-20T06:46:01.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-20T06:46:01.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 161225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/ 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 157681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 69705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 56033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 76057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 75073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 73169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-20T06:46:01.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-20T06:46:01.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 81505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-20T06:46:01.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 156073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-20T06:46:01.459 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/ 2023-11-20T06:46:01.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-20T06:46:01.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 80113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-20T06:46:01.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 87353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-20T06:46:01.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-20T06:46:01.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-20T06:46:01.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/sl811_cs.ko 2023-11-20T06:46:01.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-20T06:46:01.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-20T06:46:01.459 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/image/ 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/image/mdc800.ko 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/image/microtek.ko 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/adutux.ko 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/appledisplay.ko 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/cytherm.ko 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ehset.ko 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/emi26.ko 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/emi62.ko 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ezusb.ko 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/idmouse.ko 2023-11-20T06:46:01.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/iowarrior.ko 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/ldusb.ko 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/legousbtower.ko 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/lvstest.ko 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/sisusbvga/ 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 64841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usb3503.ko 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usblcd.ko 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/usbtest.ko 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/uss720.ko 2023-11-20T06:46:01.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/misc/yurex.ko 2023-11-20T06:46:01.462 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/mon/ 2023-11-20T06:46:01.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 72953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/mon/usbmon.ko 2023-11-20T06:46:01.462 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/musb/ 2023-11-20T06:46:01.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 301697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-20T06:46:01.462 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/ 2023-11-20T06:46:01.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-generic.ko 2023-11-20T06:46:01.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-20T06:46:01.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-20T06:46:01.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-20T06:46:01.462 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ 2023-11-20T06:46:01.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/aircable.ko 2023-11-20T06:46:01.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ark3116.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ch341.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/cp210x.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/cyberjack.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 58217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/empeg.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/f81232.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 175137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 137081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 124833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/io_ti.ko 2023-11-20T06:46:01.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ipaq.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ipw.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ir-usb.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 58233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 107521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/keyspan.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mct_u232.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/metro-usb.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mos7720.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mos7840.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 56337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/mxuport.ko 2023-11-20T06:46:01.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/navman.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/omninet.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/opticon.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 191137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/option.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/oti6858.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/pl2303.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/qcaux.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/qcserial.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/quatech2.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/safe_serial.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/sierra.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ssu100.ko 2023-11-20T06:46:01.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/symbolserial.ko 2023-11-20T06:46:01.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-20T06:46:01.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-20T06:46:01.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usb_debug.ko 2023-11-20T06:46:01.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-20T06:46:01.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 125609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/usbserial.ko 2023-11-20T06:46:01.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/visor.ko 2023-11-20T06:46:01.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/whiteheat.ko 2023-11-20T06:46:01.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-20T06:46:01.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-20T06:46:01.466 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ 2023-11-20T06:46:01.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/uas.ko 2023-11-20T06:46:01.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-karma.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-20T06:46:01.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 179969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/storage/usb-storage.ko 2023-11-20T06:46:01.468 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/ 2023-11-20T06:46:01.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-20T06:46:01.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 72177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-20T06:46:01.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 107001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-20T06:46:01.468 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/ 2023-11-20T06:46:01.468 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/pci/ 2023-11-20T06:46:01.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 154297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-20T06:46:01.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-20T06:46:01.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 108737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/vfio.ko 2023-11-20T06:46:01.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 77609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-20T06:46:01.468 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/ 2023-11-20T06:46:01.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 113785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost.ko 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 58089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost_net.ko 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 89249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/vhost/vhost_scsi.ko 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/ 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/ 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/apple_bl.ko 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-20T06:46:01.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/bd6107.ko 2023-11-20T06:46:01.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-20T06:46:01.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-20T06:46:01.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-20T06:46:01.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-20T06:46:01.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lcd.ko 2023-11-20T06:46:01.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-20T06:46:01.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-20T06:46:01.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-20T06:46:01.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-20T06:46:01.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-20T06:46:01.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-20T06:46:01.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/ 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/ 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/ds2482.ko 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/ds2490.ko 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/ 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14153 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-20T06:46:01.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-20T06:46:01.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-20T06:46:01.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-20T06:46:01.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-20T06:46:01.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-20T06:46:01.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 56425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-20T06:46:01.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 102673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/w1/wire.ko 2023-11-20T06:46:01.472 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ 2023-11-20T06:46:01.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/acquirewdt.ko 2023-11-20T06:46:01.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/advantechwdt.ko 2023-11-20T06:46:01.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-20T06:46:01.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-20T06:46:01.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-20T06:46:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-20T06:46:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-20T06:46:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-20T06:46:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/dw_wdt.ko 2023-11-20T06:46:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-20T06:46:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-20T06:46:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/hpwdt.ko 2023-11-20T06:46:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/i6300esb.ko 2023-11-20T06:46:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-20T06:46:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-20T06:46:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ib700wdt.ko 2023-11-20T06:46:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ibmasr.ko 2023-11-20T06:46:01.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-20T06:46:01.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-20T06:46:01.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/it87_wdt.ko 2023-11-20T06:46:01.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-20T06:46:01.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/machzwd.ko 2023-11-20T06:46:01.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-20T06:46:01.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-20T06:46:01.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/nv_tco.ko 2023-11-20T06:46:01.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-20T06:46:01.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22265 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-20T06:46:01.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-20T06:46:01.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-20T06:46:01.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/retu_wdt.ko 2023-11-20T06:46:01.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-20T06:46:01.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-20T06:46:01.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-20T06:46:01.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-20T06:46:01.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-20T06:46:01.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-20T06:46:01.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/softdog.ko 2023-11-20T06:46:01.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-20T06:46:01.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-20T06:46:01.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/via_wdt.ko 2023-11-20T06:46:01.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-20T06:46:01.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-20T06:46:01.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-20T06:46:01.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-20T06:46:01.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wdt_pci.ko 2023-11-20T06:46:01.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-20T06:46:01.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-20T06:46:01.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/watchdog/xen_wdt.ko 2023-11-20T06:46:01.478 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/ 2023-11-20T06:46:01.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-evtchn.ko 2023-11-20T06:46:01.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-gntalloc.ko 2023-11-20T06:46:01.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-gntdev.ko 2023-11-20T06:46:01.478 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-pciback/ 2023-11-20T06:46:01.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 176377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-20T06:46:01.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-privcmd.ko 2023-11-20T06:46:01.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 71249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xen-scsiback.ko 2023-11-20T06:46:01.478 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xenfs/ 2023-11-20T06:46:01.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/9p/ 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 166425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/9p/9p.ko 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/adfs/ 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/adfs/adfs.ko 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/affs/ 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 163593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/affs/affs.ko 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/afs/ 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 932817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/afs/kafs.ko 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/autofs/ 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 101057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/autofs/autofs4.ko 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/befs/ 2023-11-20T06:46:01.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 64545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/befs/befs.ko 2023-11-20T06:46:01.480 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/bfs/ 2023-11-20T06:46:01.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/bfs/bfs.ko 2023-11-20T06:46:01.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/binfmt_misc.ko 2023-11-20T06:46:01.480 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/btrfs/ 2023-11-20T06:46:01.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 3402729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/btrfs/btrfs.ko 2023-11-20T06:46:01.480 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cachefiles/ 2023-11-20T06:46:01.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 306009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cachefiles/cachefiles.ko 2023-11-20T06:46:01.480 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ceph/ 2023-11-20T06:46:01.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1332449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ceph/ceph.ko 2023-11-20T06:46:01.480 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/coda/ 2023-11-20T06:46:01.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 100801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/coda/coda.ko 2023-11-20T06:46:01.480 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/configfs/ 2023-11-20T06:46:01.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 108393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/configfs/configfs.ko 2023-11-20T06:46:01.481 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cramfs/ 2023-11-20T06:46:01.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/cramfs/cramfs.ko 2023-11-20T06:46:01.481 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/dlm/ 2023-11-20T06:46:01.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 642513 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/dlm/dlm.ko 2023-11-20T06:46:01.481 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/efs/ 2023-11-20T06:46:01.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/efs/efs.ko 2023-11-20T06:46:01.481 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/f2fs/ 2023-11-20T06:46:01.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1505025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/f2fs/f2fs.ko 2023-11-20T06:46:01.481 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fat/ 2023-11-20T06:46:01.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fat/msdos.ko 2023-11-20T06:46:01.481 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/freevxfs/ 2023-11-20T06:46:01.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/freevxfs/freevxfs.ko 2023-11-20T06:46:01.482 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fscache/ 2023-11-20T06:46:01.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 226481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fscache/fscache.ko 2023-11-20T06:46:01.482 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fuse/ 2023-11-20T06:46:01.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/fuse/cuse.ko 2023-11-20T06:46:01.482 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/gfs2/ 2023-11-20T06:46:01.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1231529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/gfs2/gfs2.ko 2023-11-20T06:46:01.482 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfs/ 2023-11-20T06:46:01.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 141209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfs/hfs.ko 2023-11-20T06:46:01.482 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfsplus/ 2023-11-20T06:46:01.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 222817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hfsplus/hfsplus.ko 2023-11-20T06:46:01.482 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hpfs/ 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 192329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/hpfs/hpfs.ko 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/isofs/ 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 74065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/isofs/isofs.ko 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/jfs/ 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 419497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/jfs/jfs.ko 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/lockd/ 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 280313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/lockd/lockd.ko 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/minix/ 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 89193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/minix/minix.ko 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/netfs/ 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 124649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/netfs/netfs.ko 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/ 2023-11-20T06:46:01.483 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/blocklayout/ 2023-11-20T06:46:01.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 81449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-20T06:46:01.484 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/filelayout/ 2023-11-20T06:46:01.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-20T06:46:01.484 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/flexfilelayout/ 2023-11-20T06:46:01.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 117465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-20T06:46:01.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1055721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfs.ko 2023-11-20T06:46:01.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfsv2.ko 2023-11-20T06:46:01.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 120177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfsv3.ko 2023-11-20T06:46:01.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 2042137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs/nfsv4.ko 2023-11-20T06:46:01.484 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs_common/ 2023-11-20T06:46:01.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs_common/grace.ko 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfs_common/nfs_acl.ko 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfsd/ 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1516873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nfsd/nfsd.ko 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nilfs2/ 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 592833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nilfs2/nilfs2.ko 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/ 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-celtic.ko 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-centeuro.ko 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-croatian.ko 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-cyrillic.ko 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-gaelic.ko 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-greek.ko 2023-11-20T06:46:01.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-iceland.ko 2023-11-20T06:46:01.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-inuit.ko 2023-11-20T06:46:01.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-roman.ko 2023-11-20T06:46:01.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-romanian.ko 2023-11-20T06:46:01.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/mac-turkish.ko 2023-11-20T06:46:01.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_ascii.ko 2023-11-20T06:46:01.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp1250.ko 2023-11-20T06:46:01.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp1251.ko 2023-11-20T06:46:01.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp1255.ko 2023-11-20T06:46:01.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp737.ko 2023-11-20T06:46:01.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp775.ko 2023-11-20T06:46:01.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp850.ko 2023-11-20T06:46:01.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp852.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp855.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp857.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp860.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp861.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp862.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp863.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp864.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp865.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp866.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp869.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp874.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 94137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp932.ko 2023-11-20T06:46:01.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 142673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp936.ko 2023-11-20T06:46:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 165745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp949.ko 2023-11-20T06:46:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 118121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_cp950.ko 2023-11-20T06:46:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_euc-jp.ko 2023-11-20T06:46:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-1.ko 2023-11-20T06:46:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-13.ko 2023-11-20T06:46:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-14.ko 2023-11-20T06:46:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-15.ko 2023-11-20T06:46:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-2.ko 2023-11-20T06:46:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-3.ko 2023-11-20T06:46:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-4.ko 2023-11-20T06:46:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-5.ko 2023-11-20T06:46:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-6.ko 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-7.ko 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_iso8859-9.ko 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_koi8-r.ko 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_koi8-ru.ko 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_koi8-u.ko 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/nls/nls_utf8.ko 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ntfs/ 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 219417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ntfs/ntfs.ko 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/cluster/ 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 244409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-20T06:46:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlm/ 2023-11-20T06:46:01.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 440737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-20T06:46:01.490 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlmfs/ 2023-11-20T06:46:01.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-20T06:46:01.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 2592433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2.ko 2023-11-20T06:46:01.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-20T06:46:01.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-20T06:46:01.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-20T06:46:01.490 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/omfs/ 2023-11-20T06:46:01.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/omfs/omfs.ko 2023-11-20T06:46:01.490 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/overlayfs/ 2023-11-20T06:46:01.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 352161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/overlayfs/overlay.ko 2023-11-20T06:46:01.490 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/pstore/ 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/pstore/ramoops.ko 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx4/ 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx4/qnx4.ko 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx6/ 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/qnx6/qnx6.ko 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/ 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/quota_tree.ko 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/quota_v1.ko 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/quota/quota_v2.ko 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/reiserfs/ 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 532673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/reiserfs/reiserfs.ko 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/romfs/ 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/romfs/romfs.ko 2023-11-20T06:46:01.491 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/ 2023-11-20T06:46:01.492 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/client/ 2023-11-20T06:46:01.492 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 2668401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/client/cifs.ko 2023-11-20T06:46:01.530 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/common/ 2023-11-20T06:46:01.530 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/common/cifs_arc4.ko 2023-11-20T06:46:01.530 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/smb/common/cifs_md4.ko 2023-11-20T06:46:01.530 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/squashfs/ 2023-11-20T06:46:01.530 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 134641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/squashfs/squashfs.ko 2023-11-20T06:46:01.530 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/sysv/ 2023-11-20T06:46:01.530 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 90721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/sysv/sysv.ko 2023-11-20T06:46:01.530 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/udf/ 2023-11-20T06:46:01.530 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 247737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/udf/udf.ko 2023-11-20T06:46:01.530 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ufs/ 2023-11-20T06:46:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 162497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/ufs/ufs.ko 2023-11-20T06:46:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/xfs/ 2023-11-20T06:46:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 4011017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/fs/xfs/xfs.ko 2023-11-20T06:46:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/ 2023-11-20T06:46:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/locking/ 2023-11-20T06:46:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 75489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/locking/locktorture.ko 2023-11-20T06:46:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/time/ 2023-11-20T06:46:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/time/test_udelay.ko 2023-11-20T06:46:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/kernel/torture.ko 2023-11-20T06:46:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ 2023-11-20T06:46:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 6833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crc-itu-t.ko 2023-11-20T06:46:01.531 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 6529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crc7.ko 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crc8.ko 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crypto/ 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crypto/libarc4.ko 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/crypto/libdes.ko 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/interval_tree_test.ko 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/libcrc32c.ko 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lru_cache.ko 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lz4/ 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lz4/lz4_compress.ko 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/lz4/lz4hc_compress.ko 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/math/ 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 6617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/math/cordic.ko 2023-11-20T06:46:01.532 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/memory-notifier-error-inject.ko 2023-11-20T06:46:01.533 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/notifier-error-inject.ko 2023-11-20T06:46:01.533 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/percpu_test.ko 2023-11-20T06:46:01.533 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/pm-notifier-error-inject.ko 2023-11-20T06:46:01.533 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/raid6/ 2023-11-20T06:46:01.533 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 143433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/raid6/raid6_pq.ko 2023-11-20T06:46:01.533 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/rbtree_test.ko 2023-11-20T06:46:01.533 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/reed_solomon/ 2023-11-20T06:46:01.533 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-20T06:46:01.533 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test-kstrtox.ko 2023-11-20T06:46:01.533 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test-string_helpers.ko 2023-11-20T06:46:01.533 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 4760425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_bpf.ko 2023-11-20T06:46:01.533 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_firmware.ko 2023-11-20T06:46:01.534 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 6369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_module.ko 2023-11-20T06:46:01.534 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/test_user_copy.ko 2023-11-20T06:46:01.534 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ts_bm.ko 2023-11-20T06:46:01.534 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ts_fsm.ko 2023-11-20T06:46:01.534 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/ts_kmp.ko 2023-11-20T06:46:01.534 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/xz/ 2023-11-20T06:46:01.534 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/lib/xz/xz_dec_test.ko 2023-11-20T06:46:01.534 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/mm/ 2023-11-20T06:46:01.534 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/mm/hwpoison-inject.ko 2023-11-20T06:46:01.534 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ 2023-11-20T06:46:01.534 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/ 2023-11-20T06:46:01.534 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/6lowpan.ko 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_dest.ko 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_fragment.ko 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_hop.ko 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 6985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_mobility.ko 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_routing.ko 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/6lowpan/nhc_udp.ko 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/ 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/garp.ko 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/mrp.ko 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/p8022.ko 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/psnap.ko 2023-11-20T06:46:01.535 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/802/stp.ko 2023-11-20T06:46:01.536 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/8021q/ 2023-11-20T06:46:01.536 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 81737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/8021q/8021q.ko 2023-11-20T06:46:01.536 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/ 2023-11-20T06:46:01.536 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 198337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet.ko 2023-11-20T06:46:01.536 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet_fd.ko 2023-11-20T06:46:01.536 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26345 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet_rdma.ko 2023-11-20T06:46:01.536 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/9p/9pnet_virtio.ko 2023-11-20T06:46:01.536 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/batman-adv/ 2023-11-20T06:46:01.536 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 649297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/batman-adv/batman-adv.ko 2023-11-20T06:46:01.536 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/ 2023-11-20T06:46:01.536 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 63809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/br_netfilter.ko 2023-11-20T06:46:01.536 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 777689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/bridge.ko 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13217 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-20T06:46:01.537 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8385 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-20T06:46:01.538 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-20T06:46:01.538 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-20T06:46:01.538 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-20T06:46:01.538 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-20T06:46:01.538 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-20T06:46:01.538 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-20T06:46:01.538 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-20T06:46:01.538 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-20T06:46:01.538 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/ebtables.ko 2023-11-20T06:46:01.538 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-20T06:46:01.538 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-20T06:46:01.538 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ceph/ 2023-11-20T06:46:01.539 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1046833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ceph/libceph.ko 2023-11-20T06:46:01.539 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/core/ 2023-11-20T06:46:01.539 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 125993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/core/pktgen.ko 2023-11-20T06:46:01.539 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/ 2023-11-20T06:46:01.539 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 194209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp.ko 2023-11-20T06:46:01.539 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp_diag.ko 2023-11-20T06:46:01.539 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp_ipv4.ko 2023-11-20T06:46:01.539 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dccp/dccp_ipv6.ko 2023-11-20T06:46:01.539 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/ 2023-11-20T06:46:01.539 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 390473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/dsa_core.ko 2023-11-20T06:46:01.539 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_brcm.ko 2023-11-20T06:46:01.539 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_dsa.ko 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_none.ko 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/dsa/tag_trailer.ko 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/hsr/ 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 99729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/hsr/hsr.ko 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/ 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/6lowpan/ 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 254625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/ieee802154.ko 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ah4.ko 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/esp4.ko 2023-11-20T06:46:01.540 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/fou.ko 2023-11-20T06:46:01.541 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/gre.ko 2023-11-20T06:46:01.541 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/inet_diag.ko 2023-11-20T06:46:01.541 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ip_gre.ko 2023-11-20T06:46:01.541 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61225 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ip_tunnel.ko 2023-11-20T06:46:01.541 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ip_vti.ko 2023-11-20T06:46:01.541 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ipcomp.ko 2023-11-20T06:46:01.541 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/ipip.ko 2023-11-20T06:46:01.541 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ 2023-11-20T06:46:01.541 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-20T06:46:01.541 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-20T06:46:01.541 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-20T06:46:01.541 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-20T06:46:01.542 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-20T06:46:01.542 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-20T06:46:01.542 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-20T06:46:01.542 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-20T06:46:01.542 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-20T06:46:01.542 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11305 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-20T06:46:01.542 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-20T06:46:01.542 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-20T06:46:01.542 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-20T06:46:01.542 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-20T06:46:01.542 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-20T06:46:01.542 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-20T06:46:01.543 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-20T06:46:01.543 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18161 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-20T06:46:01.543 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-20T06:46:01.543 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-20T06:46:01.543 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-20T06:46:01.543 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-20T06:46:01.543 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-20T06:46:01.543 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-20T06:46:01.543 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-20T06:46:01.543 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_bic.ko 2023-11-20T06:46:01.543 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_dctcp.ko 2023-11-20T06:46:01.543 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_diag.ko 2023-11-20T06:46:01.544 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_highspeed.ko 2023-11-20T06:46:01.544 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_htcp.ko 2023-11-20T06:46:01.544 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_hybla.ko 2023-11-20T06:46:01.544 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_illinois.ko 2023-11-20T06:46:01.544 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_lp.ko 2023-11-20T06:46:01.544 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_scalable.ko 2023-11-20T06:46:01.544 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_vegas.ko 2023-11-20T06:46:01.544 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_veno.ko 2023-11-20T06:46:01.544 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_westwood.ko 2023-11-20T06:46:01.544 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tcp_yeah.ko 2023-11-20T06:46:01.544 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/tunnel4.ko 2023-11-20T06:46:01.544 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/udp_diag.ko 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/udp_tunnel.ko 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ah6.ko 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/esp6.ko 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/fou6.ko 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 80897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_gre.ko 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 93577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_tunnel.ko 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ip6_vti.ko 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/ipcomp6.ko 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19017 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/mip6.ko 2023-11-20T06:46:01.545 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ 2023-11-20T06:46:01.546 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-20T06:46:01.546 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-20T06:46:01.546 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-20T06:46:01.546 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-20T06:46:01.546 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-20T06:46:01.546 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-20T06:46:01.546 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-20T06:46:01.546 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-20T06:46:01.546 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-20T06:46:01.546 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-20T06:46:01.546 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-20T06:46:01.546 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-20T06:46:01.547 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-20T06:46:01.547 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11121 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-20T06:46:01.547 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-20T06:46:01.547 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-20T06:46:01.547 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-20T06:46:01.547 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-20T06:46:01.547 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-20T06:46:01.547 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25945 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-20T06:46:01.547 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-20T06:46:01.547 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-20T06:46:01.547 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9009 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 74073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/sit.ko 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/tunnel6.ko 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/key/ 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 82833 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/key/af_key.ko 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/ 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 125281 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_core.ko 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25953 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_eth.ko 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_ip.ko 2023-11-20T06:46:01.548 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36713 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_ip6.ko 2023-11-20T06:46:01.549 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_netlink.ko 2023-11-20T06:46:01.549 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/l2tp/l2tp_ppp.ko 2023-11-20T06:46:01.549 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/lapb/ 2023-11-20T06:46:01.549 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47977 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/lapb/lapb.ko 2023-11-20T06:46:01.549 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/llc/ 2023-11-20T06:46:01.549 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/llc/llc.ko 2023-11-20T06:46:01.549 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 267913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/llc/llc2.ko 2023-11-20T06:46:01.549 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mac802154/ 2023-11-20T06:46:01.549 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 290417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mac802154/mac802154.ko 2023-11-20T06:46:01.549 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mpls/ 2023-11-20T06:46:01.549 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/mpls/mpls_gso.ko 2023-11-20T06:46:01.549 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ 2023-11-20T06:46:01.550 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ 2023-11-20T06:46:01.550 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 119585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set.ko 2023-11-20T06:46:01.550 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-20T06:46:01.550 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26913 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-20T06:46:01.550 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-20T06:46:01.550 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 100297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-20T06:46:01.550 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 101441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-20T06:46:01.550 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 102817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-20T06:46:01.550 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 103417 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-20T06:46:01.550 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 112849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-20T06:46:01.550 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-20T06:46:01.550 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 109593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-20T06:46:01.551 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 113129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-20T06:46:01.551 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 112585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-20T06:46:01.551 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 111585 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-20T06:46:01.551 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 114465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-20T06:46:01.551 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-20T06:46:01.551 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ 2023-11-20T06:46:01.551 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 411729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-20T06:46:01.551 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-20T06:46:01.551 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-20T06:46:01.551 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-20T06:46:01.551 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-20T06:46:01.551 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-20T06:46:01.552 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-20T06:46:01.552 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7689 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-20T06:46:01.552 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10681 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-20T06:46:01.552 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-20T06:46:01.552 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-20T06:46:01.552 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-20T06:46:01.552 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7697 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-20T06:46:01.552 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10993 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-20T06:46:01.552 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conncount.ko 2023-11-20T06:46:01.552 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 408257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack.ko 2023-11-20T06:46:01.552 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-20T06:46:01.552 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-20T06:46:01.553 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33761 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-20T06:46:01.553 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 118145 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-20T06:46:01.553 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-20T06:46:01.553 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-20T06:46:01.553 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 107233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-20T06:46:01.553 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-20T06:46:01.553 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-20T06:46:01.553 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66641 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-20T06:46:01.553 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-20T06:46:01.553 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-20T06:46:01.553 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10113 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-20T06:46:01.553 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 89425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_flow_table.ko 2023-11-20T06:46:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9593 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-20T06:46:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_log_syslog.ko 2023-11-20T06:46:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 95353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat.ko 2023-11-20T06:46:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-20T06:46:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-20T06:46:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11857 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_irc.ko 2023-11-20T06:46:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28929 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_sip.ko 2023-11-20T06:46:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-20T06:46:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-20T06:46:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 615649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nf_tables.ko 2023-11-20T06:46:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42561 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink.ko 2023-11-20T06:46:01.554 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30233 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-20T06:46:01.555 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30569 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-20T06:46:01.555 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_log.ko 2023-11-20T06:46:01.555 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-20T06:46:01.555 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-20T06:46:01.555 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10457 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_chain_nat.ko 2023-11-20T06:46:01.555 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_compat.ko 2023-11-20T06:46:01.555 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_ct.ko 2023-11-20T06:46:01.555 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9601 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-20T06:46:01.555 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_fib.ko 2023-11-20T06:46:01.555 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-20T06:46:01.555 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14185 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_hash.ko 2023-11-20T06:46:01.555 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_limit.ko 2023-11-20T06:46:01.556 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_log.ko 2023-11-20T06:46:01.556 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_masq.ko 2023-11-20T06:46:01.556 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_nat.ko 2023-11-20T06:46:01.556 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13673 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_numgen.ko 2023-11-20T06:46:01.556 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11841 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_osf.ko 2023-11-20T06:46:01.556 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_queue.ko 2023-11-20T06:46:01.556 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_redir.ko 2023-11-20T06:46:01.556 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_reject.ko 2023-11-20T06:46:01.556 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_reject_inet.ko 2023-11-20T06:46:01.556 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_socket.ko 2023-11-20T06:46:01.556 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_synproxy.ko 2023-11-20T06:46:01.556 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/nft_tproxy.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 89313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/x_tables.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_AUDIT.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_CT.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_DSCP.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_HL.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13369 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_HMARK.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13889 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_LED.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11489 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_LOG.ko 2023-11-20T06:46:01.557 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11753 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-20T06:46:01.558 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_NETMAP.ko 2023-11-20T06:46:01.558 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_NFLOG.ko 2023-11-20T06:46:01.558 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-20T06:46:01.558 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_RATEEST.ko 2023-11-20T06:46:01.558 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-20T06:46:01.558 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14337 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_SECMARK.ko 2023-11-20T06:46:01.558 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-20T06:46:01.558 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-20T06:46:01.558 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17361 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TEE.ko 2023-11-20T06:46:01.558 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TPROXY.ko 2023-11-20T06:46:01.558 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8321 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_TRACE.ko 2023-11-20T06:46:01.558 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_addrtype.ko 2023-11-20T06:46:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_bpf.ko 2023-11-20T06:46:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_cgroup.ko 2023-11-20T06:46:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_cluster.ko 2023-11-20T06:46:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_comment.ko 2023-11-20T06:46:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10465 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connbytes.ko 2023-11-20T06:46:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connlabel.ko 2023-11-20T06:46:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connlimit.ko 2023-11-20T06:46:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13129 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_connmark.ko 2023-11-20T06:46:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_conntrack.ko 2023-11-20T06:46:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_cpu.ko 2023-11-20T06:46:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_dccp.ko 2023-11-20T06:46:01.559 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_devgroup.ko 2023-11-20T06:46:01.560 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8801 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_dscp.ko 2023-11-20T06:46:01.560 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_ecn.ko 2023-11-20T06:46:01.560 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_esp.ko 2023-11-20T06:46:01.560 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_hashlimit.ko 2023-11-20T06:46:01.560 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_helper.ko 2023-11-20T06:46:01.560 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7865 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_hl.ko 2023-11-20T06:46:01.560 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11921 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_ipcomp.ko 2023-11-20T06:46:01.560 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_iprange.ko 2023-11-20T06:46:01.560 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11785 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_ipvs.ko 2023-11-20T06:46:01.560 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16041 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_l2tp.ko 2023-11-20T06:46:01.560 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8001 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_length.ko 2023-11-20T06:46:01.560 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10209 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_limit.ko 2023-11-20T06:46:01.561 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7545 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_mac.ko 2023-11-20T06:46:01.561 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_mark.ko 2023-11-20T06:46:01.561 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11825 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_multiport.ko 2023-11-20T06:46:01.561 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_nat.ko 2023-11-20T06:46:01.561 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_nfacct.ko 2023-11-20T06:46:01.561 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_osf.ko 2023-11-20T06:46:01.561 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_owner.ko 2023-11-20T06:46:01.561 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_physdev.ko 2023-11-20T06:46:01.561 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_pkttype.ko 2023-11-20T06:46:01.561 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11985 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_policy.ko 2023-11-20T06:46:01.561 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_quota.ko 2023-11-20T06:46:01.561 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_rateest.ko 2023-11-20T06:46:01.562 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_realm.ko 2023-11-20T06:46:01.562 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_recent.ko 2023-11-20T06:46:01.562 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13329 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_sctp.ko 2023-11-20T06:46:01.562 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_set.ko 2023-11-20T06:46:01.562 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_socket.ko 2023-11-20T06:46:01.562 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9505 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_state.ko 2023-11-20T06:46:01.562 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9473 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_statistic.ko 2023-11-20T06:46:01.562 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8809 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_string.ko 2023-11-20T06:46:01.562 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8553 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_tcpmss.ko 2023-11-20T06:46:01.562 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15777 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_tcpudp.ko 2023-11-20T06:46:01.562 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_time.ko 2023-11-20T06:46:01.562 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netfilter/xt_u32.ko 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netlink/ 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13969 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/netlink/netlink_diag.ko 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/nsh/ 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/nsh/nsh.ko 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/ 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 380033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/openvswitch.ko 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/vport-geneve.ko 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/vport-gre.ko 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/openvswitch/vport-vxlan.ko 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/packet/ 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13057 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/packet/af_packet_diag.ko 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/phonet/ 2023-11-20T06:46:01.563 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 110201 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/phonet/phonet.ko 2023-11-20T06:46:01.564 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54721 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/phonet/pn_pep.ko 2023-11-20T06:46:01.564 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/ 2023-11-20T06:46:01.564 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 251481 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/rds.ko 2023-11-20T06:46:01.564 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 164937 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/rds_rdma.ko 2023-11-20T06:46:01.564 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67377 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rds/rds_tcp.ko 2023-11-20T06:46:01.564 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rxrpc/ 2023-11-20T06:46:01.564 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 819657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/rxrpc/rxrpc.ko 2023-11-20T06:46:01.564 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/ 2023-11-20T06:46:01.564 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32241 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_csum.ko 2023-11-20T06:46:01.564 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23577 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_gact.ko 2023-11-20T06:46:01.564 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26873 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_ipt.ko 2023-11-20T06:46:01.564 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_mirred.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_nat.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43449 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_pedit.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_police.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_simple.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35297 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_skbedit.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/act_vlan.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_basic.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33961 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_bpf.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19169 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_cgroup.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31401 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_flow.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31769 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_fw.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38425 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_route.ko 2023-11-20T06:46:01.565 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/cls_u32.ko 2023-11-20T06:46:01.566 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7441 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_cmp.ko 2023-11-20T06:46:01.566 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_ipset.ko 2023-11-20T06:46:01.566 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33289 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_meta.ko 2023-11-20T06:46:01.566 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_nbyte.ko 2023-11-20T06:46:01.566 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_text.ko 2023-11-20T06:46:01.566 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7249 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/em_u32.ko 2023-11-20T06:46:01.566 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_choke.ko 2023-11-20T06:46:01.566 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20849 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_codel.ko 2023-11-20T06:46:01.566 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34633 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_drr.ko 2023-11-20T06:46:01.566 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33609 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_fq.ko 2023-11-20T06:46:01.566 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31617 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_fq_codel.ko 2023-11-20T06:46:01.566 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35433 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_gred.ko 2023-11-20T06:46:01.567 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49817 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_hfsc.ko 2023-11-20T06:46:01.567 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22089 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_hhf.ko 2023-11-20T06:46:01.567 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66393 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_htb.ko 2023-11-20T06:46:01.567 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26073 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_ingress.ko 2023-11-20T06:46:01.567 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30273 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_mqprio.ko 2023-11-20T06:46:01.567 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10793 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_mqprio_lib.ko 2023-11-20T06:46:01.567 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26065 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_multiq.ko 2023-11-20T06:46:01.567 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36137 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_netem.ko 2023-11-20T06:46:01.567 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27497 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_pie.ko 2023-11-20T06:46:01.567 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10625 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_plug.ko 2023-11-20T06:46:01.567 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_prio.ko 2023-11-20T06:46:01.567 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_qfq.ko 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32905 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_red.ko 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26881 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_sfb.ko 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31353 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_sfq.ko 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28897 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_tbf.ko 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28105 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sched/sch_teql.ko 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sctp/ 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 929745 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sctp/sctp.ko 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19033 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sctp/sctp_diag.ko 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/ 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/auth_gss/ 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 336529 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54737 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-20T06:46:01.568 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1520097 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/sunrpc.ko 2023-11-20T06:46:01.569 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/xprtrdma/ 2023-11-20T06:46:01.569 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 707657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-20T06:46:01.569 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/tipc/ 2023-11-20T06:46:01.569 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10025 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/tipc/diag.ko 2023-11-20T06:46:01.569 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 862665 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/tipc/tipc.ko 2023-11-20T06:46:01.569 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/unix/ 2023-11-20T06:46:01.569 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15729 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/unix/unix_diag.ko 2023-11-20T06:46:01.569 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/ 2023-11-20T06:46:01.569 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85409 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-20T06:46:01.569 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 68049 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-20T06:46:01.569 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 96193 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vsock.ko 2023-11-20T06:46:01.569 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10705 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-20T06:46:01.570 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17521 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-20T06:46:01.570 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/x25/ 2023-11-20T06:46:01.570 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 125177 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/x25/x25.ko 2023-11-20T06:46:01.570 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/ 2023-11-20T06:46:01.570 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22657 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/xfrm_algo.ko 2023-11-20T06:46:01.570 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20649 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-20T06:46:01.570 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 102257 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/net/xfrm/xfrm_user.ko 2023-11-20T06:46:01.570 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/virt/ 2023-11-20T06:46:01.570 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/virt/lib/ 2023-11-20T06:46:01.570 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15537 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/kernel/virt/lib/irqbypass.ko 2023-11-20T06:46:01.570 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 640081 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.alias 2023-11-20T06:46:01.570 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 624107 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.alias.bin 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7663 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23428 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin.alias.bin 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9821 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin.bin 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70004 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.builtin.modinfo 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 146313 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.dep 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 232548 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.dep.bin 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 210 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.devname 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 72606 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.order 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 879 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.softdep 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 254438 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.symbols 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 309363 2023-11-20 01:52 ./lib/modules/6.6.0-g7678e1afe51c/modules.symbols.bin 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/ 2023-11-20T06:46:01.571 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/share/ 2023-11-20T06:46:01.572 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/share/doc/ 2023-11-20T06:46:01.572 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2023-11-20 01:52 ./usr/share/doc/linux-image-6.6.0-g7678e1afe51c/ 2023-11-20T06:46:01.572 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 171 2023-11-20 01:52 ./usr/share/doc/linux-image-6.6.0-g7678e1afe51c/changelog.Debian.gz 2023-11-20T06:46:01.572 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 691 2023-11-20 01:52 ./usr/share/doc/linux-image-6.6.0-g7678e1afe51c/copyright 2023-11-20T06:46:01.573 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g7678e1afe51c 2023-11-20T06:46:01.573 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g7678e1afe51c 2023-11-20T06:46:01.573 DEBUG:teuthology.orchestra.run.smithi175:> egrep '(submenu|menuentry.*6.6.0-g7678e1afe51c).*{' /boot/grub/grub.cfg 2023-11-20T06:46:01.579 INFO:teuthology.orchestra.run.smithi175.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-20T06:46:01.580 INFO:teuthology.orchestra.run.smithi175.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g7678e1afe51c' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g7678e1afe51c-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-20T06:46:01.580 INFO:teuthology.orchestra.run.smithi175.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g7678e1afe51c (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g7678e1afe51c-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-20T06:46:01.580 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-20T06:46:01.580 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g7678e1afe51c 2023-11-20T06:46:01.580 DEBUG:teuthology.orchestra.run.smithi175:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-20T06:46:01.623 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi175.front.sepia.ceph.com to complete... 2023-11-20T06:46:02.047 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub' 2023-11-20T06:46:02.048 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-20T06:46:02.063 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2023-11-20T06:46:02.244 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-6.6.0-g7678e1afe51c 2023-11-20T06:46:02.251 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-6.6.0-g7678e1afe51c 2023-11-20T06:46:02.475 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-20T06:46:02.481 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-20T06:46:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-20T06:46:02.526 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-20T06:46:02.680 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-20T06:46:02.680 INFO:teuthology.orchestra.run.smithi175.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-20T06:46:02.680 INFO:teuthology.orchestra.run.smithi175.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-20T06:46:02.696 INFO:teuthology.orchestra.run.smithi175.stderr:done 2023-11-20T06:46:29.295 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-20T06:46:29.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-20T06:46:29.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:46:33.808 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-20T06:46:33.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-11-20T06:46:33.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:46:47.650 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-20T06:46:52.258 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-11-20T06:46:56.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-20T06:46:56.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:46:59.714 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-20T06:47:01.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-11-20T06:47:01.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:47:04.323 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-11-20T06:47:11.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-20T06:47:11.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:47:14.790 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-20T06:47:16.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-11-20T06:47:16.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:47:29.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-20T06:47:29.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:47:34.754 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-11-20T06:47:48.322 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-20T06:47:49.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-11-20T06:47:49.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:47:50.065 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-11-20T06:47:50.790 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-11-20T06:47:50.790 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-g7678e1afe51c"... 2023-11-20T06:47:50.791 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2023-11-20T06:47:50.841 INFO:teuthology.orchestra.run.smithi175.stdout:6.6.0-g7678e1afe51c 2023-11-20T06:47:50.841 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g7678e1afe51c vs 6.6.0-g7678e1afe51c 2023-11-20T06:47:50.841 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-20T06:47:50.841 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-20T06:47:51.842 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-20T06:47:51.843 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-20T06:47:51.918 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2023-11-20T06:47:51.976 DEBUG:teuthology.parallel:result is None 2023-11-20T06:48:06.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-20T06:48:06.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:48:06.618 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-11-20T06:48:07.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-20T06:48:07.284 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-g7678e1afe51c"... 2023-11-20T06:48:07.284 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-11-20T06:48:07.339 INFO:teuthology.orchestra.run.smithi088.stdout:6.6.0-g7678e1afe51c 2023-11-20T06:48:07.339 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g7678e1afe51c vs 6.6.0-g7678e1afe51c 2023-11-20T06:48:07.339 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-20T06:48:07.339 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-20T06:48:08.340 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-20T06:48:08.340 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-20T06:48:08.425 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2023-11-20T06:48:08.486 DEBUG:teuthology.parallel:result is None 2023-11-20T06:48:08.487 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-20T06:48:08.494 INFO:teuthology.task.internal:Creating test directory... 2023-11-20T06:48:08.494 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-20T06:48:08.498 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-20T06:48:08.507 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-20T06:48:08.514 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-20T06:48:08.523 INFO:teuthology.task.internal:Creating archive directory... 2023-11-20T06:48:08.523 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-20T06:48:08.554 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-20T06:48:08.588 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-20T06:48:08.595 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-20T06:48:08.595 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-20T06:48:08.626 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-20T06:48:08.666 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-20T06:48:08.671 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-20T06:48:08.680 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-20T06:48:08.685 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-20T06:48:08.688 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-20T06:48:08.695 INFO:teuthology.task.internal:Configuring sudo... 2023-11-20T06:48:08.695 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-20T06:48:08.698 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-20T06:48:08.750 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-20T06:48:08.758 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-20T06:48:08.759 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-20T06:48:08.762 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-20T06:48:08.805 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-20T06:48:08.824 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-20T06:48:08.880 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:48:08.880 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-20T06:48:08.950 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-20T06:48:08.959 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-20T06:48:09.013 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T06:48:09.014 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-20T06:48:09.079 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2023-11-20T06:48:09.082 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2023-11-20T06:48:09.203 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-20T06:48:09.210 INFO:teuthology.task.internal:Starting timer... 2023-11-20T06:48:09.211 INFO:teuthology.run_tasks:Running task pcp... 2023-11-20T06:48:09.220 INFO:teuthology.run_tasks:Running task selinux... 2023-11-20T06:48:09.228 DEBUG:teuthology.task.selinux:Excluding smithi088: OS 'ubuntu' does not support SELinux 2023-11-20T06:48:09.228 DEBUG:teuthology.task.selinux:Excluding smithi175: OS 'ubuntu' does not support SELinux 2023-11-20T06:48:09.229 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-20T06:48:09.229 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-20T06:48:09.229 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-20T06:48:09.229 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-20T06:48:09.237 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-20T06:48:09.340 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-20T06:48:09.857 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-20T06:48:10.024 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-20T06:48:10.105 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-20T06:57:01.599 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2023-11-20T06:57:01.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-20T06:57:01.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:57:01.682 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-11-20T06:57:01.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-20T06:57:01.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-11-20T06:57:01.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-20T06:57:01.874 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-11-20T06:57:02.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-11-20T06:57:02.013 INFO:teuthology.run_tasks:Running task clock... 2023-11-20T06:57:02.023 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-20T06:57:02.024 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-20T06:57:02.024 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-20T06:57:02.027 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-20T06:57:02.028 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-20T06:57:02.063 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-20T06:57:02.063 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: Command line: ntpd -gq 2023-11-20T06:57:02.063 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: ---------------------------------------------------- 2023-11-20T06:57:02.064 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: ntp-4 is maintained by Network Time Foundation, 2023-11-20T06:57:02.064 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-20T06:57:02.064 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: corporation. Support and training for ntp-4 are 2023-11-20T06:57:02.064 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: available at https://www.nwtime.org/support 2023-11-20T06:57:02.064 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: ---------------------------------------------------- 2023-11-20T06:57:02.064 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: proto: precision = 0.041 usec (-24) 2023-11-20T06:57:02.065 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: basedate set to 2022-02-04 2023-11-20T06:57:02.065 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: gps base set to 2022-02-06 (week 2196) 2023-11-20T06:57:02.065 INFO:teuthology.orchestra.run.smithi088.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-20T06:57:02.065 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-20T06:57:02.066 INFO:teuthology.orchestra.run.smithi088.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-20T06:57:02.066 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: restrict ::: KOD does nothing without LIMITED. 2023-11-20T06:57:02.067 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: Listen and drop on 0 v6wildcard [::]:123 2023-11-20T06:57:02.067 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-20T06:57:02.067 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: Listen normally on 2 lo 127.0.0.1:123 2023-11-20T06:57:02.067 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: Listen normally on 3 enp3s0f1 172.21.15.88:123 2023-11-20T06:57:02.067 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: Listen normally on 4 lo [::1]:123 2023-11-20T06:57:02.067 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d42d%5]:123 2023-11-20T06:57:02.067 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:02 ntpd[27984]: Listening on routing socket on fd #22 for interface updates 2023-11-20T06:57:02.095 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-20T06:57:02.095 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: Command line: ntpd -gq 2023-11-20T06:57:02.096 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: ---------------------------------------------------- 2023-11-20T06:57:02.096 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: ntp-4 is maintained by Network Time Foundation, 2023-11-20T06:57:02.096 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-20T06:57:02.096 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: corporation. Support and training for ntp-4 are 2023-11-20T06:57:02.096 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: available at https://www.nwtime.org/support 2023-11-20T06:57:02.096 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: ---------------------------------------------------- 2023-11-20T06:57:02.096 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: proto: precision = 0.042 usec (-24) 2023-11-20T06:57:02.097 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: basedate set to 2022-02-04 2023-11-20T06:57:02.097 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: gps base set to 2022-02-06 (week 2196) 2023-11-20T06:57:02.097 INFO:teuthology.orchestra.run.smithi175.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-20T06:57:02.097 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-20T06:57:02.098 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: restrict ::: KOD does nothing without LIMITED. 2023-11-20T06:57:02.098 INFO:teuthology.orchestra.run.smithi175.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-20T06:57:02.099 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: Listen and drop on 0 v6wildcard [::]:123 2023-11-20T06:57:02.099 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-20T06:57:02.099 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: Listen normally on 2 lo 127.0.0.1:123 2023-11-20T06:57:02.099 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: Listen normally on 3 enp3s0f1 172.21.15.175:123 2023-11-20T06:57:02.099 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: Listen normally on 4 lo [::1]:123 2023-11-20T06:57:02.099 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:71f1%5]:123 2023-11-20T06:57:02.099 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:02 ntpd[28020]: Listening on routing socket on fd #22 for interface updates 2023-11-20T06:57:03.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:03 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:03.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:03 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:03.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:03 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:03.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:03 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:03.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:03 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:03.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:03 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:03.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:03 ntpd[27984]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:03.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:03 ntpd[27984]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:03.096 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:03 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:03.096 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:03 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:03.096 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:03 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:03.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:03 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:03.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:03 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:03.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:03 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:04.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:04 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:04.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:04 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:04.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:04 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:04.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:04 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:04.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:04 ntpd[27984]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:04.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:04 ntpd[27984]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:04.096 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:04 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:04.096 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:04 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:04.096 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:04 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:04.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:04 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:04.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:04 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:04.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:04 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:05 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:05 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:05 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:05 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:05 ntpd[27984]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:05 ntpd[27984]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:05.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:05 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:05.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:05 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:05.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:05 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:05.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:05 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:05.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:05 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:05.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:05 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:05.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:05 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:05.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:05 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:05.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:05 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:05.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:05 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:05.098 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:05 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:05.098 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:05 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:06 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:06 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:06 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:06 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:06 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:06 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:06 ntpd[27984]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:06 ntpd[27984]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:06 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:06 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:06 ntpd[27984]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:06 ntpd[27984]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:06.096 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:06 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:06.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:06 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:06.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:06 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:06.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:06 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:06.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:06 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:06.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:06 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:06.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:06 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:06.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:06 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:07.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:07 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:07.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:07 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:07.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:07 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:07.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:07 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:07.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:07 ntpd[27984]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:07.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:07 ntpd[27984]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:07.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:07 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:07.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:07 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:07.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:07 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:07.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:07 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:07.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:07 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:07.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:07 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:07.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:07 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:07.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:07 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:07.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:07 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:07.098 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:07 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:07.098 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:07 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:07.098 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:07 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:08 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:08 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:08 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:08 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:08 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:08 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:08 ntpd[27984]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:08 ntpd[27984]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:08 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:08.066 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:08 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:08.066 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:08 ntpd[27984]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:08.066 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:08 ntpd[27984]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:08.096 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:08 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:08.096 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:08 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:08.096 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:08 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:08.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:08 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:08.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:08 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:08.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:08 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:09.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:09 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:09.064 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:09 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:09.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:09 ntpd[27984]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:09.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:09 ntpd[27984]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:09.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:09 ntpd[27984]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:09.065 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:09 ntpd[27984]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:09.065 INFO:teuthology.orchestra.run.smithi088.stdout:20 Nov 06:57:09 ntpd[27984]: ntpd: time slew -0.002654 s 2023-11-20T06:57:09.065 INFO:teuthology.orchestra.run.smithi088.stdout:ntpd: time slew -0.002654s 2023-11-20T06:57:09.066 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:09 ntpd[27984]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-20T06:57:09.066 INFO:teuthology.orchestra.run.smithi088.stderr:20 Nov 06:57:09 ntpd[27984]: can't open /var/log/ntpstats/loopstats.20231120: Permission denied 2023-11-20T06:57:09.096 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:09 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:09.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:09 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:09.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:09 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:09.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:09 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:09.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:09 ntpd[28020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-20T06:57:09.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:09 ntpd[28020]: can't open /var/log/ntpstats/rawstats.20231120: Permission denied 2023-11-20T06:57:09.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:09 ntpd[28020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-20T06:57:09.097 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:09 ntpd[28020]: can't open /var/log/ntpstats/peerstats.20231120: Permission denied 2023-11-20T06:57:09.097 INFO:teuthology.orchestra.run.smithi175.stdout:20 Nov 06:57:09 ntpd[28020]: ntpd: time slew -0.000695 s 2023-11-20T06:57:09.098 INFO:teuthology.orchestra.run.smithi175.stdout:ntpd: time slew -0.000695s 2023-11-20T06:57:09.098 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:09 ntpd[28020]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-20T06:57:09.098 INFO:teuthology.orchestra.run.smithi175.stderr:20 Nov 06:57:09 ntpd[28020]: can't open /var/log/ntpstats/loopstats.20231120: Permission denied 2023-11-20T06:57:09.185 INFO:teuthology.orchestra.run.smithi088.stdout: remote refid st t when poll reach delay offset jitter 2023-11-20T06:57:09.185 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================== 2023-11-20T06:57:09.185 INFO:teuthology.orchestra.run.smithi088.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:57:09.185 INFO:teuthology.orchestra.run.smithi088.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:57:09.185 INFO:teuthology.orchestra.run.smithi088.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:57:09.185 INFO:teuthology.orchestra.run.smithi088.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:57:09.193 INFO:teuthology.orchestra.run.smithi175.stdout: remote refid st t when poll reach delay offset jitter 2023-11-20T06:57:09.193 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================== 2023-11-20T06:57:09.193 INFO:teuthology.orchestra.run.smithi175.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:57:09.193 INFO:teuthology.orchestra.run.smithi175.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:57:09.193 INFO:teuthology.orchestra.run.smithi175.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:57:09.193 INFO:teuthology.orchestra.run.smithi175.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T06:57:09.194 INFO:teuthology.run_tasks:Running task install... 2023-11-20T06:57:09.203 DEBUG:teuthology.task.install:project ceph 2023-11-20T06:57:09.203 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}} 2023-11-20T06:57:09.203 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'} 2023-11-20T06:57:09.203 INFO:teuthology.task.install:Using flavor: default 2023-11-20T06:57:09.211 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-20T06:57:09.211 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-20T06:57:09.211 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-key list | grep Ceph 2023-11-20T06:57:09.212 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-key list | grep Ceph 2023-11-20T06:57:09.338 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-20T06:57:09.341 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-20T06:57:09.391 INFO:teuthology.orchestra.run.smithi088.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-20T06:57:09.392 INFO:teuthology.orchestra.run.smithi088.stdout:uid [ unknown] Ceph.com (release key) 2023-11-20T06:57:09.393 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-20T06:57:09.393 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-20T06:57:09.393 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-20T06:57:09.398 INFO:teuthology.orchestra.run.smithi175.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-20T06:57:09.398 INFO:teuthology.orchestra.run.smithi175.stdout:uid [ unknown] Ceph.com (release key) 2023-11-20T06:57:09.398 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-20T06:57:09.399 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-20T06:57:09.399 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-20T06:57:09.539 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default/ 2023-11-20T06:57:09.539 INFO:teuthology.task.install.deb:Package version is 18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:57:09.557 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default/ 2023-11-20T06:57:09.557 INFO:teuthology.task.install.deb:Package version is 18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:57:09.707 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:57:09.707 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-20T06:57:09.720 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T06:57:09.720 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-20T06:57:09.727 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get update 2023-11-20T06:57:09.740 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2023-11-20T06:57:09.910 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-20T06:57:09.916 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-20T06:57:09.933 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-20T06:57:09.933 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-20T06:57:10.023 INFO:teuthology.orchestra.run.smithi088.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy InRelease 2023-11-20T06:57:10.030 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-20T06:57:10.039 INFO:teuthology.orchestra.run.smithi175.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy InRelease 2023-11-20T06:57:10.059 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-20T06:57:10.075 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-20T06:57:10.096 INFO:teuthology.orchestra.run.smithi088.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-20T06:57:10.112 INFO:teuthology.orchestra.run.smithi175.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-20T06:57:10.132 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-20T06:57:10.149 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-20T06:57:10.180 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-20T06:57:10.196 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-20T06:57:10.515 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 28.5 kB in 1s (50.2 kB/s) 2023-11-20T06:57:10.546 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-20T06:57:10.628 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-20T06:57:10.710 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-20T06:57:11.028 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 28.5 kB in 1s (26.8 kB/s) 2023-11-20T06:57:11.440 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2023-11-20T06:57:11.457 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6612-g895e5ada-1jammy cephadm=18.0.0-6612-g895e5ada-1jammy ceph-mds=18.0.0-6612-g895e5ada-1jammy ceph-mgr=18.0.0-6612-g895e5ada-1jammy ceph-common=18.0.0-6612-g895e5ada-1jammy ceph-fuse=18.0.0-6612-g895e5ada-1jammy ceph-test=18.0.0-6612-g895e5ada-1jammy ceph-volume=18.0.0-6612-g895e5ada-1jammy radosgw=18.0.0-6612-g895e5ada-1jammy python3-rados=18.0.0-6612-g895e5ada-1jammy python3-rgw=18.0.0-6612-g895e5ada-1jammy python3-cephfs=18.0.0-6612-g895e5ada-1jammy python3-rbd=18.0.0-6612-g895e5ada-1jammy libcephfs2=18.0.0-6612-g895e5ada-1jammy libcephfs-dev=18.0.0-6612-g895e5ada-1jammy librados2=18.0.0-6612-g895e5ada-1jammy librbd1=18.0.0-6612-g895e5ada-1jammy rbd-fuse=18.0.0-6612-g895e5ada-1jammy python3-cephfs=18.0.0-6612-g895e5ada-1jammy cephfs-shell=18.0.0-6612-g895e5ada-1jammy cephfs-top=18.0.0-6612-g895e5ada-1jammy cephfs-mirror=18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:57:11.531 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2023-11-20T06:57:11.696 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2023-11-20T06:57:11.697 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2023-11-20T06:57:11.848 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2023-11-20T06:57:11.848 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-20T06:57:11.848 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-20T06:57:11.848 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-20T06:57:11.848 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-20T06:57:11.849 INFO:teuthology.orchestra.run.smithi088.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-20T06:57:11.849 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-20T06:57:11.850 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2023-11-20T06:57:11.850 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-20T06:57:11.850 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-20T06:57:11.850 INFO:teuthology.orchestra.run.smithi088.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-20T06:57:11.850 INFO:teuthology.orchestra.run.smithi088.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-20T06:57:11.851 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-20T06:57:11.851 INFO:teuthology.orchestra.run.smithi088.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-20T06:57:11.851 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-20T06:57:11.851 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-20T06:57:11.851 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-20T06:57:11.851 INFO:teuthology.orchestra.run.smithi088.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-20T06:57:11.851 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-20T06:57:11.851 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-20T06:57:11.851 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-20T06:57:11.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-20T06:57:11.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-20T06:57:11.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-20T06:57:11.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-20T06:57:11.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-20T06:57:11.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-20T06:57:11.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-20T06:57:11.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-20T06:57:11.852 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-20T06:57:11.852 INFO:teuthology.orchestra.run.smithi088.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-20T06:57:11.852 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2023-11-20T06:57:11.853 INFO:teuthology.orchestra.run.smithi088.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-20T06:57:11.853 INFO:teuthology.orchestra.run.smithi088.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-20T06:57:11.853 INFO:teuthology.orchestra.run.smithi088.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-20T06:57:11.853 INFO:teuthology.orchestra.run.smithi088.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-20T06:57:11.853 INFO:teuthology.orchestra.run.smithi088.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-20T06:57:11.853 INFO:teuthology.orchestra.run.smithi088.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-20T06:57:11.853 INFO:teuthology.orchestra.run.smithi088.stdout: python3-watchdog 2023-11-20T06:57:11.853 INFO:teuthology.orchestra.run.smithi088.stdout:Recommended packages: 2023-11-20T06:57:11.853 INFO:teuthology.orchestra.run.smithi088.stdout: btrfs-tools 2023-11-20T06:57:11.952 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2023-11-20T06:57:11.970 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6612-g895e5ada-1jammy cephadm=18.0.0-6612-g895e5ada-1jammy ceph-mds=18.0.0-6612-g895e5ada-1jammy ceph-mgr=18.0.0-6612-g895e5ada-1jammy ceph-common=18.0.0-6612-g895e5ada-1jammy ceph-fuse=18.0.0-6612-g895e5ada-1jammy ceph-test=18.0.0-6612-g895e5ada-1jammy ceph-volume=18.0.0-6612-g895e5ada-1jammy radosgw=18.0.0-6612-g895e5ada-1jammy python3-rados=18.0.0-6612-g895e5ada-1jammy python3-rgw=18.0.0-6612-g895e5ada-1jammy python3-cephfs=18.0.0-6612-g895e5ada-1jammy python3-rbd=18.0.0-6612-g895e5ada-1jammy libcephfs2=18.0.0-6612-g895e5ada-1jammy libcephfs-dev=18.0.0-6612-g895e5ada-1jammy librados2=18.0.0-6612-g895e5ada-1jammy librbd1=18.0.0-6612-g895e5ada-1jammy rbd-fuse=18.0.0-6612-g895e5ada-1jammy python3-cephfs=18.0.0-6612-g895e5ada-1jammy cephfs-shell=18.0.0-6612-g895e5ada-1jammy cephfs-top=18.0.0-6612-g895e5ada-1jammy cephfs-mirror=18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:57:11.995 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2023-11-20T06:57:11.995 INFO:teuthology.orchestra.run.smithi088.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-20T06:57:11.995 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-20T06:57:11.995 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-20T06:57:11.996 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-20T06:57:11.996 INFO:teuthology.orchestra.run.smithi088.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-20T06:57:11.996 INFO:teuthology.orchestra.run.smithi088.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-20T06:57:11.996 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-11-20T06:57:11.997 INFO:teuthology.orchestra.run.smithi088.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-11-20T06:57:11.997 INFO:teuthology.orchestra.run.smithi088.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-20T06:57:11.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-20T06:57:11.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-20T06:57:11.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-20T06:57:11.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-20T06:57:11.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-20T06:57:11.999 INFO:teuthology.orchestra.run.smithi088.stdout: socat xmlstarlet 2023-11-20T06:57:12.044 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2023-11-20T06:57:12.146 INFO:teuthology.orchestra.run.smithi088.stdout:0 upgraded, 115 newly installed, 0 to remove and 263 not upgraded. 2023-11-20T06:57:12.146 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 184 MB of archives. 2023-11-20T06:57:12.146 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 825 MB of additional disk space will be used. 2023-11-20T06:57:12.146 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6612-g895e5ada-1jammy [3,449 kB] 2023-11-20T06:57:12.193 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-20T06:57:12.209 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2023-11-20T06:57:12.210 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2023-11-20T06:57:12.276 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-20T06:57:12.320 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-20T06:57:12.361 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2023-11-20T06:57:12.361 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-20T06:57:12.362 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-20T06:57:12.362 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-20T06:57:12.362 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-20T06:57:12.362 INFO:teuthology.orchestra.run.smithi175.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-20T06:57:12.362 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-20T06:57:12.363 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2023-11-20T06:57:12.363 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-20T06:57:12.363 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-20T06:57:12.363 INFO:teuthology.orchestra.run.smithi175.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-20T06:57:12.363 INFO:teuthology.orchestra.run.smithi175.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-20T06:57:12.364 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-20T06:57:12.364 INFO:teuthology.orchestra.run.smithi175.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-20T06:57:12.365 INFO:teuthology.orchestra.run.smithi175.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-20T06:57:12.366 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-20T06:57:12.366 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-20T06:57:12.366 INFO:teuthology.orchestra.run.smithi175.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-20T06:57:12.366 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2023-11-20T06:57:12.366 INFO:teuthology.orchestra.run.smithi175.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-20T06:57:12.366 INFO:teuthology.orchestra.run.smithi175.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-20T06:57:12.366 INFO:teuthology.orchestra.run.smithi175.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-20T06:57:12.367 INFO:teuthology.orchestra.run.smithi175.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-20T06:57:12.367 INFO:teuthology.orchestra.run.smithi175.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-20T06:57:12.367 INFO:teuthology.orchestra.run.smithi175.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-20T06:57:12.367 INFO:teuthology.orchestra.run.smithi175.stdout: python3-watchdog 2023-11-20T06:57:12.367 INFO:teuthology.orchestra.run.smithi175.stdout:Recommended packages: 2023-11-20T06:57:12.367 INFO:teuthology.orchestra.run.smithi175.stdout: btrfs-tools 2023-11-20T06:57:12.395 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6612-g895e5ada-1jammy [3,130 kB] 2023-11-20T06:57:12.491 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6612-g895e5ada-1jammy [689 kB] 2023-11-20T06:57:12.508 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2023-11-20T06:57:12.508 INFO:teuthology.orchestra.run.smithi175.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-20T06:57:12.508 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-20T06:57:12.508 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-20T06:57:12.510 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-20T06:57:12.510 INFO:teuthology.orchestra.run.smithi175.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-20T06:57:12.510 INFO:teuthology.orchestra.run.smithi175.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-20T06:57:12.510 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-11-20T06:57:12.510 INFO:teuthology.orchestra.run.smithi175.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-11-20T06:57:12.510 INFO:teuthology.orchestra.run.smithi175.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-20T06:57:12.510 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-20T06:57:12.510 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-20T06:57:12.510 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-20T06:57:12.510 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-20T06:57:12.511 INFO:teuthology.orchestra.run.smithi175.stdout: socat xmlstarlet 2023-11-20T06:57:12.513 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6612-g895e5ada-1jammy [356 kB] 2023-11-20T06:57:12.525 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6612-g895e5ada-1jammy [32.8 kB] 2023-11-20T06:57:12.526 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-11-20T06:57:12.526 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6612-g895e5ada-1jammy [180 kB] 2023-11-20T06:57:12.531 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6612-g895e5ada-1jammy [62.4 kB] 2023-11-20T06:57:12.533 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6612-g895e5ada-1jammy [329 kB] 2023-11-20T06:57:12.545 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6612-g895e5ada-1jammy [6,215 kB] 2023-11-20T06:57:12.570 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-20T06:57:12.645 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-20T06:57:12.656 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-20T06:57:12.703 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-20T06:57:12.706 INFO:teuthology.orchestra.run.smithi175.stdout:0 upgraded, 115 newly installed, 0 to remove and 263 not upgraded. 2023-11-20T06:57:12.706 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 184 MB of archives. 2023-11-20T06:57:12.706 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 825 MB of additional disk space will be used. 2023-11-20T06:57:12.706 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6612-g895e5ada-1jammy [3,449 kB] 2023-11-20T06:57:12.753 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6612-g895e5ada-1jammy [112 kB] 2023-11-20T06:57:12.755 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6612-g895e5ada-1jammy [439 kB] 2023-11-20T06:57:12.769 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6612-g895e5ada-1jammy [22.6 MB] 2023-11-20T06:57:12.868 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-20T06:57:12.876 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-20T06:57:12.903 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-20T06:57:13.076 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-20T06:57:13.268 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-20T06:57:13.557 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6612-g895e5ada-1jammy [6,851 kB] 2023-11-20T06:57:13.686 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-20T06:57:13.693 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-20T06:57:13.694 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-20T06:57:13.706 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-20T06:57:13.706 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-20T06:57:13.708 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-20T06:57:13.708 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-20T06:57:13.709 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-20T06:57:13.712 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-20T06:57:13.712 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-20T06:57:13.791 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6612-g895e5ada-1jammy [238 kB] 2023-11-20T06:57:13.791 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-20T06:57:13.796 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6612-g895e5ada-1jammy [128 kB] 2023-11-20T06:57:13.800 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6612-g895e5ada-1jammy [1,497 kB] 2023-11-20T06:57:13.836 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-20T06:57:13.853 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6612-g895e5ada-1jammy [9,861 kB] 2023-11-20T06:57:13.878 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-20T06:57:14.042 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-11-20T06:57:14.086 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-20T06:57:14.161 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-20T06:57:14.173 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-20T06:57:14.214 INFO:teuthology.orchestra.run.smithi088.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6612-g895e5ada-1jammy [31.7 MB] 2023-11-20T06:57:14.219 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-20T06:57:14.329 INFO:teuthology.orchestra.run.smithi088.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-20T06:57:14.340 INFO:teuthology.orchestra.run.smithi088.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-20T06:57:14.346 INFO:teuthology.orchestra.run.smithi088.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-20T06:57:14.350 INFO:teuthology.orchestra.run.smithi088.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-20T06:57:14.369 INFO:teuthology.orchestra.run.smithi088.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-20T06:57:14.373 INFO:teuthology.orchestra.run.smithi088.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-20T06:57:14.375 INFO:teuthology.orchestra.run.smithi088.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-20T06:57:14.384 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-20T06:57:14.393 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-20T06:57:14.413 INFO:teuthology.orchestra.run.smithi088.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-20T06:57:14.420 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-20T06:57:14.428 INFO:teuthology.orchestra.run.smithi088.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-20T06:57:14.433 INFO:teuthology.orchestra.run.smithi088.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-20T06:57:14.573 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6612-g895e5ada-1jammy [3,130 kB] 2023-11-20T06:57:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-20T06:57:14.687 INFO:teuthology.orchestra.run.smithi088.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-20T06:57:14.770 INFO:teuthology.orchestra.run.smithi088.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-20T06:57:14.784 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-20T06:57:14.860 INFO:teuthology.orchestra.run.smithi088.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-20T06:57:14.938 INFO:teuthology.orchestra.run.smithi088.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-20T06:57:15.041 INFO:teuthology.orchestra.run.smithi088.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-20T06:57:15.128 INFO:teuthology.orchestra.run.smithi088.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-20T06:57:15.147 INFO:teuthology.orchestra.run.smithi088.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-20T06:57:15.177 INFO:teuthology.orchestra.run.smithi088.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-20T06:57:15.189 INFO:teuthology.orchestra.run.smithi088.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-20T06:57:15.206 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-20T06:57:15.213 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-20T06:57:15.215 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-20T06:57:15.226 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-20T06:57:15.227 INFO:teuthology.orchestra.run.smithi088.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-20T06:57:15.227 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-20T06:57:15.228 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-20T06:57:15.230 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-20T06:57:15.232 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-20T06:57:15.234 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-20T06:57:15.234 INFO:teuthology.orchestra.run.smithi088.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-20T06:57:15.335 INFO:teuthology.orchestra.run.smithi088.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6612-g895e5ada-1jammy [14.0 kB] 2023-11-20T06:57:15.335 INFO:teuthology.orchestra.run.smithi088.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6612-g895e5ada-1jammy [839 kB] 2023-11-20T06:57:15.352 INFO:teuthology.orchestra.run.smithi088.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6612-g895e5ada-1jammy [2,146 kB] 2023-11-20T06:57:15.399 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-20T06:57:15.426 INFO:teuthology.orchestra.run.smithi088.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-20T06:57:15.431 INFO:teuthology.orchestra.run.smithi088.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6612-g895e5ada-1jammy [283 kB] 2023-11-20T06:57:15.439 INFO:teuthology.orchestra.run.smithi088.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6612-g895e5ada-1jammy [138 kB] 2023-11-20T06:57:15.444 INFO:teuthology.orchestra.run.smithi088.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6612-g895e5ada-1jammy [1,906 kB] 2023-11-20T06:57:15.511 INFO:teuthology.orchestra.run.smithi088.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6612-g895e5ada-1jammy [8,625 kB] 2023-11-20T06:57:15.818 INFO:teuthology.orchestra.run.smithi088.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6612-g895e5ada-1jammy [14.2 kB] 2023-11-20T06:57:15.818 INFO:teuthology.orchestra.run.smithi088.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6612-g895e5ada-1jammy [47.7 MB] 2023-11-20T06:57:15.844 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-20T06:57:15.855 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-20T06:57:15.861 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-20T06:57:15.864 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-20T06:57:15.883 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-20T06:57:15.887 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-20T06:57:15.889 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-20T06:57:15.929 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-20T06:57:15.944 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-20T06:57:15.949 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-20T06:57:16.027 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6612-g895e5ada-1jammy [689 kB] 2023-11-20T06:57:16.203 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-20T06:57:16.249 INFO:teuthology.orchestra.run.smithi088.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-20T06:57:16.250 INFO:teuthology.orchestra.run.smithi088.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-20T06:57:16.251 INFO:teuthology.orchestra.run.smithi088.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-20T06:57:16.252 INFO:teuthology.orchestra.run.smithi088.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-20T06:57:16.253 INFO:teuthology.orchestra.run.smithi088.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-20T06:57:16.254 INFO:teuthology.orchestra.run.smithi088.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-20T06:57:16.277 INFO:teuthology.orchestra.run.smithi088.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-20T06:57:16.279 INFO:teuthology.orchestra.run.smithi088.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-20T06:57:16.280 INFO:teuthology.orchestra.run.smithi088.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-20T06:57:16.286 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-20T06:57:16.348 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6612-g895e5ada-1jammy [356 kB] 2023-11-20T06:57:16.350 INFO:teuthology.orchestra.run.smithi088.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-20T06:57:16.379 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-20T06:57:16.456 INFO:teuthology.orchestra.run.smithi175.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-20T06:57:16.514 INFO:teuthology.orchestra.run.smithi088.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-20T06:57:16.544 INFO:teuthology.orchestra.run.smithi175.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6612-g895e5ada-1jammy [32.8 kB] 2023-11-20T06:57:16.545 INFO:teuthology.orchestra.run.smithi175.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6612-g895e5ada-1jammy [180 kB] 2023-11-20T06:57:16.563 INFO:teuthology.orchestra.run.smithi175.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-20T06:57:16.613 INFO:teuthology.orchestra.run.smithi175.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6612-g895e5ada-1jammy [62.4 kB] 2023-11-20T06:57:16.653 INFO:teuthology.orchestra.run.smithi175.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-20T06:57:16.672 INFO:teuthology.orchestra.run.smithi175.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-20T06:57:16.677 INFO:teuthology.orchestra.run.smithi175.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6612-g895e5ada-1jammy [329 kB] 2023-11-20T06:57:16.703 INFO:teuthology.orchestra.run.smithi175.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-20T06:57:16.715 INFO:teuthology.orchestra.run.smithi175.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-20T06:57:16.753 INFO:teuthology.orchestra.run.smithi175.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-20T06:57:16.761 INFO:teuthology.orchestra.run.smithi175.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-20T06:57:16.772 INFO:teuthology.orchestra.run.smithi088.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-20T06:57:16.805 INFO:teuthology.orchestra.run.smithi088.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-20T06:57:16.814 INFO:teuthology.orchestra.run.smithi175.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6612-g895e5ada-1jammy [6,215 kB] 2023-11-20T06:57:16.868 INFO:teuthology.orchestra.run.smithi088.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-20T06:57:16.902 INFO:teuthology.orchestra.run.smithi088.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-20T06:57:16.920 INFO:teuthology.orchestra.run.smithi088.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-20T06:57:16.948 INFO:teuthology.orchestra.run.smithi088.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-20T06:57:16.952 INFO:teuthology.orchestra.run.smithi175.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-20T06:57:17.081 INFO:teuthology.orchestra.run.smithi088.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-20T06:57:17.116 INFO:teuthology.orchestra.run.smithi088.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-20T06:57:17.137 INFO:teuthology.orchestra.run.smithi088.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-20T06:57:17.144 INFO:teuthology.orchestra.run.smithi088.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-20T06:57:17.347 INFO:teuthology.orchestra.run.smithi088.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-20T06:57:17.509 INFO:teuthology.orchestra.run.smithi088.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6612-g895e5ada-1jammy [120 kB] 2023-11-20T06:57:17.510 INFO:teuthology.orchestra.run.smithi088.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6612-g895e5ada-1jammy [227 kB] 2023-11-20T06:57:17.513 INFO:teuthology.orchestra.run.smithi088.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6612-g895e5ada-1jammy [33.9 kB] 2023-11-20T06:57:17.513 INFO:teuthology.orchestra.run.smithi088.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6612-g895e5ada-1jammy [23.4 kB] 2023-11-20T06:57:17.513 INFO:teuthology.orchestra.run.smithi088.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6612-g895e5ada-1jammy [38.3 kB] 2023-11-20T06:57:17.514 INFO:teuthology.orchestra.run.smithi088.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6612-g895e5ada-1jammy [12.3 MB] 2023-11-20T06:57:17.780 INFO:teuthology.orchestra.run.smithi175.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-20T06:57:17.781 INFO:teuthology.orchestra.run.smithi175.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-20T06:57:17.783 INFO:teuthology.orchestra.run.smithi175.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-20T06:57:17.783 INFO:teuthology.orchestra.run.smithi175.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-20T06:57:17.784 INFO:teuthology.orchestra.run.smithi175.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-20T06:57:17.785 INFO:teuthology.orchestra.run.smithi175.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-20T06:57:17.808 INFO:teuthology.orchestra.run.smithi175.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-20T06:57:17.811 INFO:teuthology.orchestra.run.smithi175.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-20T06:57:17.811 INFO:teuthology.orchestra.run.smithi175.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-20T06:57:17.822 INFO:teuthology.orchestra.run.smithi088.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-20T06:57:17.827 INFO:teuthology.orchestra.run.smithi088.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-20T06:57:17.881 INFO:teuthology.orchestra.run.smithi175.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-20T06:57:17.945 INFO:teuthology.orchestra.run.smithi088.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6612-g895e5ada-1jammy [91.6 kB] 2023-11-20T06:57:17.955 INFO:teuthology.orchestra.run.smithi088.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-20T06:57:18.003 INFO:teuthology.orchestra.run.smithi088.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-20T06:57:18.003 INFO:teuthology.orchestra.run.smithi088.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-20T06:57:18.008 INFO:teuthology.orchestra.run.smithi088.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-20T06:57:18.010 INFO:teuthology.orchestra.run.smithi088.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-20T06:57:18.026 INFO:teuthology.orchestra.run.smithi088.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-20T06:57:18.033 INFO:teuthology.orchestra.run.smithi088.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-20T06:57:18.046 INFO:teuthology.orchestra.run.smithi175.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-20T06:57:18.093 INFO:teuthology.orchestra.run.smithi088.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-20T06:57:18.261 INFO:teuthology.orchestra.run.smithi088.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-20T06:57:18.303 INFO:teuthology.orchestra.run.smithi175.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-20T06:57:18.336 INFO:teuthology.orchestra.run.smithi175.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-20T06:57:18.405 INFO:teuthology.orchestra.run.smithi175.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-20T06:57:18.424 INFO:teuthology.orchestra.run.smithi088.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-20T06:57:18.440 INFO:teuthology.orchestra.run.smithi175.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-20T06:57:18.458 INFO:teuthology.orchestra.run.smithi175.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-20T06:57:18.468 INFO:teuthology.orchestra.run.smithi175.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6612-g895e5ada-1jammy [112 kB] 2023-11-20T06:57:18.485 INFO:teuthology.orchestra.run.smithi175.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-20T06:57:18.486 INFO:teuthology.orchestra.run.smithi175.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6612-g895e5ada-1jammy [439 kB] 2023-11-20T06:57:18.529 INFO:teuthology.orchestra.run.smithi175.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6612-g895e5ada-1jammy [22.6 MB] 2023-11-20T06:57:18.624 INFO:teuthology.orchestra.run.smithi175.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-20T06:57:18.659 INFO:teuthology.orchestra.run.smithi175.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-20T06:57:18.679 INFO:teuthology.orchestra.run.smithi175.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-20T06:57:18.687 INFO:teuthology.orchestra.run.smithi175.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-20T06:57:18.712 INFO:teuthology.orchestra.run.smithi088.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-20T06:57:18.738 INFO:teuthology.orchestra.run.smithi088.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-20T06:57:18.889 INFO:teuthology.orchestra.run.smithi175.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-20T06:57:19.368 INFO:teuthology.orchestra.run.smithi175.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-20T06:57:19.373 INFO:teuthology.orchestra.run.smithi175.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-20T06:57:19.502 INFO:teuthology.orchestra.run.smithi175.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-20T06:57:19.549 INFO:teuthology.orchestra.run.smithi175.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-20T06:57:19.550 INFO:teuthology.orchestra.run.smithi175.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-20T06:57:19.550 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 184 MB in 7s (26.4 MB/s) 2023-11-20T06:57:19.555 INFO:teuthology.orchestra.run.smithi175.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-20T06:57:19.557 INFO:teuthology.orchestra.run.smithi175.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-20T06:57:19.573 INFO:teuthology.orchestra.run.smithi175.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-20T06:57:19.581 INFO:teuthology.orchestra.run.smithi175.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-20T06:57:19.641 INFO:teuthology.orchestra.run.smithi175.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-20T06:57:19.679 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-20T06:57:19.748 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-20T06:57:19.752 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-20T06:57:19.794 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-20T06:57:19.806 INFO:teuthology.orchestra.run.smithi175.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-20T06:57:19.972 INFO:teuthology.orchestra.run.smithi175.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-20T06:57:20.056 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-20T06:57:20.069 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-20T06:57:20.114 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-20T06:57:20.265 INFO:teuthology.orchestra.run.smithi175.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-20T06:57:20.292 INFO:teuthology.orchestra.run.smithi175.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-20T06:57:20.375 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cmd2. 2023-11-20T06:57:20.389 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-20T06:57:20.425 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-20T06:57:20.728 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libfmt8:amd64. 2023-11-20T06:57:20.741 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-11-20T06:57:20.816 INFO:teuthology.orchestra.run.smithi175.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6612-g895e5ada-1jammy [6,851 kB] 2023-11-20T06:57:20.828 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-20T06:57:21.148 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-20T06:57:21.161 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-20T06:57:21.206 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-20T06:57:21.360 INFO:teuthology.orchestra.run.smithi175.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6612-g895e5ada-1jammy [238 kB] 2023-11-20T06:57:21.378 INFO:teuthology.orchestra.run.smithi175.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6612-g895e5ada-1jammy [128 kB] 2023-11-20T06:57:21.398 INFO:teuthology.orchestra.run.smithi175.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6612-g895e5ada-1jammy [1,497 kB] 2023-11-20T06:57:21.511 INFO:teuthology.orchestra.run.smithi175.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6612-g895e5ada-1jammy [9,861 kB] 2023-11-20T06:57:21.534 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-20T06:57:21.549 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-20T06:57:21.618 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-20T06:57:21.904 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-20T06:57:21.919 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-20T06:57:21.954 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-20T06:57:22.244 INFO:teuthology.orchestra.run.smithi175.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6612-g895e5ada-1jammy [31.7 MB] 2023-11-20T06:57:22.391 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-20T06:57:22.406 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-20T06:57:22.458 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:57:22.877 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-20T06:57:22.892 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-20T06:57:22.927 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:57:23.189 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-20T06:57:23.203 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-20T06:57:23.247 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:57:23.585 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-20T06:57:23.598 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-20T06:57:23.642 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-20T06:57:23.986 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librados2. 2023-11-20T06:57:24.001 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../011-librados2_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:24.045 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librados2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:24.250 INFO:teuthology.orchestra.run.smithi175.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6612-g895e5ada-1jammy [14.0 kB] 2023-11-20T06:57:24.252 INFO:teuthology.orchestra.run.smithi175.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6612-g895e5ada-1jammy [839 kB] 2023-11-20T06:57:24.293 INFO:teuthology.orchestra.run.smithi175.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6612-g895e5ada-1jammy [2,146 kB] 2023-11-20T06:57:24.424 INFO:teuthology.orchestra.run.smithi175.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6612-g895e5ada-1jammy [283 kB] 2023-11-20T06:57:24.443 INFO:teuthology.orchestra.run.smithi175.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6612-g895e5ada-1jammy [138 kB] 2023-11-20T06:57:24.445 INFO:teuthology.orchestra.run.smithi175.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6612-g895e5ada-1jammy [1,906 kB] 2023-11-20T06:57:24.566 INFO:teuthology.orchestra.run.smithi175.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6612-g895e5ada-1jammy [8,625 kB] 2023-11-20T06:57:24.664 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librbd1. 2023-11-20T06:57:24.679 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../012-librbd1_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:24.714 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librbd1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:25.028 INFO:teuthology.orchestra.run.smithi175.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6612-g895e5ada-1jammy [14.2 kB] 2023-11-20T06:57:25.028 INFO:teuthology.orchestra.run.smithi175.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6612-g895e5ada-1jammy [47.7 MB] 2023-11-20T06:57:25.125 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libcephfs2. 2023-11-20T06:57:25.139 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:25.183 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libcephfs2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:25.444 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rados. 2023-11-20T06:57:25.458 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:25.502 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rados (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:25.805 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-20T06:57:25.818 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:57:25.888 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-ceph-argparse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:26.082 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cephfs. 2023-11-20T06:57:26.097 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:26.132 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cephfs (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:26.427 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-20T06:57:26.442 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:57:26.485 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:26.804 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-prettytable. 2023-11-20T06:57:26.819 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-11-20T06:57:26.863 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-20T06:57:27.117 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rbd. 2023-11-20T06:57:27.132 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:27.167 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rbd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:27.269 INFO:teuthology.orchestra.run.smithi175.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6612-g895e5ada-1jammy [120 kB] 2023-11-20T06:57:27.270 INFO:teuthology.orchestra.run.smithi175.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6612-g895e5ada-1jammy [227 kB] 2023-11-20T06:57:27.272 INFO:teuthology.orchestra.run.smithi175.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6612-g895e5ada-1jammy [33.9 kB] 2023-11-20T06:57:27.272 INFO:teuthology.orchestra.run.smithi175.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6612-g895e5ada-1jammy [23.4 kB] 2023-11-20T06:57:27.273 INFO:teuthology.orchestra.run.smithi175.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6612-g895e5ada-1jammy [38.3 kB] 2023-11-20T06:57:27.273 INFO:teuthology.orchestra.run.smithi175.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6612-g895e5ada-1jammy [12.3 MB] 2023-11-20T06:57:27.462 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-20T06:57:27.476 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-20T06:57:27.520 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-20T06:57:27.711 INFO:teuthology.orchestra.run.smithi175.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6612-g895e5ada-1jammy [91.6 kB] 2023-11-20T06:57:27.848 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librgw2. 2023-11-20T06:57:27.862 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../021-librgw2_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:27.906 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librgw2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:28.289 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 184 MB in 15s (12.1 MB/s) 2023-11-20T06:57:28.383 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rgw. 2023-11-20T06:57:28.397 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:28.436 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-20T06:57:28.441 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:28.506 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-20T06:57:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-20T06:57:28.552 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-20T06:57:28.711 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-20T06:57:28.725 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-20T06:57:28.761 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-20T06:57:28.888 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-20T06:57:28.901 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-20T06:57:28.938 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-20T06:57:29.088 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libradosstriper1. 2023-11-20T06:57:29.103 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:29.147 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libradosstriper1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:29.266 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cmd2. 2023-11-20T06:57:29.279 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-20T06:57:29.324 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-20T06:57:29.625 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-common. 2023-11-20T06:57:29.640 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:29.668 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libfmt8:amd64. 2023-11-20T06:57:29.682 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-11-20T06:57:29.683 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:29.760 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-20T06:57:30.054 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-20T06:57:30.068 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-20T06:57:30.112 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-20T06:57:30.458 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-20T06:57:30.472 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-20T06:57:30.516 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-20T06:57:30.772 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-base. 2023-11-20T06:57:30.787 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:30.840 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-base (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:30.869 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-20T06:57:30.883 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-20T06:57:30.927 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-20T06:57:31.322 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-20T06:57:31.337 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-20T06:57:31.380 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:57:31.526 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-20T06:57:31.540 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-20T06:57:31.584 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-20T06:57:31.777 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-20T06:57:31.790 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-20T06:57:31.833 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:57:31.845 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cheroot. 2023-11-20T06:57:31.859 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-20T06:57:31.895 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-20T06:57:32.173 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-20T06:57:32.177 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-20T06:57:32.187 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-20T06:57:32.192 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-20T06:57:32.223 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-20T06:57:32.236 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:57:32.551 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-20T06:57:32.555 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-20T06:57:32.566 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-20T06:57:32.570 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-20T06:57:32.609 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-20T06:57:32.639 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-20T06:57:32.912 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-20T06:57:32.927 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-20T06:57:32.933 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librados2. 2023-11-20T06:57:32.948 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../011-librados2_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:32.970 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-20T06:57:32.991 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librados2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:33.248 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-tempora. 2023-11-20T06:57:33.263 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-11-20T06:57:33.298 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-20T06:57:33.601 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-portend. 2023-11-20T06:57:33.616 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-11-20T06:57:33.636 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librbd1. 2023-11-20T06:57:33.651 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../012-librbd1_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:33.659 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-20T06:57:33.694 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librbd1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:33.945 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-20T06:57:33.960 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-20T06:57:34.003 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-20T06:57:34.071 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs2. 2023-11-20T06:57:34.085 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:34.130 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:34.306 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-20T06:57:34.321 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-20T06:57:34.364 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-20T06:57:34.399 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rados. 2023-11-20T06:57:34.413 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:34.458 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rados (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:34.768 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-20T06:57:34.783 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:57:34.818 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-ceph-argparse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:34.893 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-natsort. 2023-11-20T06:57:34.908 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-11-20T06:57:34.951 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-20T06:57:35.037 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cephfs. 2023-11-20T06:57:35.054 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:35.095 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cephfs (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:35.263 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-logutils. 2023-11-20T06:57:35.277 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-11-20T06:57:35.321 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-20T06:57:35.406 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-20T06:57:35.422 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:57:35.464 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:35.632 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-20T06:57:35.647 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-20T06:57:35.682 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-20T06:57:35.809 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-prettytable. 2023-11-20T06:57:35.824 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-11-20T06:57:35.867 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-20T06:57:35.952 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-mako. 2023-11-20T06:57:35.966 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-20T06:57:36.010 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-20T06:57:36.111 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rbd. 2023-11-20T06:57:36.126 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:36.161 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rbd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:36.313 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-20T06:57:36.328 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-20T06:57:36.371 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-20T06:57:36.448 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-20T06:57:36.463 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-20T06:57:36.506 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-20T06:57:36.682 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-20T06:57:36.697 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-20T06:57:36.749 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-20T06:57:36.850 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librgw2. 2023-11-20T06:57:36.865 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../021-librgw2_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:36.908 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librgw2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:37.052 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webob. 2023-11-20T06:57:37.067 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-20T06:57:37.101 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-20T06:57:37.369 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rgw. 2023-11-20T06:57:37.383 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:37.427 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:37.429 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-waitress. 2023-11-20T06:57:37.444 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-20T06:57:37.501 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-20T06:57:37.780 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-20T06:57:37.795 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-20T06:57:37.798 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-tempita. 2023-11-20T06:57:37.813 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-20T06:57:37.830 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-20T06:57:37.848 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-20T06:57:38.100 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libradosstriper1. 2023-11-20T06:57:38.115 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:38.157 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libradosstriper1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:38.160 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-paste. 2023-11-20T06:57:38.175 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-20T06:57:38.218 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-20T06:57:38.521 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-20T06:57:38.536 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-20T06:57:38.571 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-20T06:57:38.627 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-common. 2023-11-20T06:57:38.642 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:38.686 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:38.890 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-20T06:57:38.905 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-20T06:57:38.948 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-20T06:57:39.210 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webtest. 2023-11-20T06:57:39.225 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-11-20T06:57:39.259 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-20T06:57:39.521 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pecan. 2023-11-20T06:57:39.536 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-20T06:57:39.579 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-20T06:57:39.816 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-base. 2023-11-20T06:57:39.831 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:39.883 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-base (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:40.075 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-certifi. 2023-11-20T06:57:40.091 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-11-20T06:57:40.133 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-20T06:57:40.453 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-idna. 2023-11-20T06:57:40.468 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-11-20T06:57:40.511 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-20T06:57:40.562 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-20T06:57:40.575 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-20T06:57:40.636 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-20T06:57:40.797 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-urllib3. 2023-11-20T06:57:40.812 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-20T06:57:40.847 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-20T06:57:40.939 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cheroot. 2023-11-20T06:57:40.953 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-20T06:57:40.989 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-20T06:57:41.176 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-requests. 2023-11-20T06:57:41.191 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-20T06:57:41.225 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-20T06:57:41.292 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-20T06:57:41.306 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-20T06:57:41.350 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-20T06:57:41.528 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-20T06:57:41.543 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-20T06:57:41.586 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-20T06:57:41.636 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-20T06:57:41.651 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-20T06:57:41.686 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-20T06:57:41.856 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-20T06:57:41.871 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:57:41.906 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:41.981 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-20T06:57:41.995 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-20T06:57:42.039 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-20T06:57:42.311 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-20T06:57:42.325 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:42.342 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-tempora. 2023-11-20T06:57:42.357 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-11-20T06:57:42.369 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:42.400 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-20T06:57:42.672 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-openssl. 2023-11-20T06:57:42.686 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-11-20T06:57:42.719 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-portend. 2023-11-20T06:57:42.730 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-20T06:57:42.734 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-11-20T06:57:42.777 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-20T06:57:43.022 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-20T06:57:43.037 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-20T06:57:43.041 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr. 2023-11-20T06:57:43.056 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:43.097 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-20T06:57:43.099 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:43.383 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-20T06:57:43.398 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-20T06:57:43.441 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-20T06:57:43.469 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mon. 2023-11-20T06:57:43.484 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:43.527 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mon (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:43.961 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-natsort. 2023-11-20T06:57:43.977 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-11-20T06:57:44.011 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-20T06:57:44.323 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-logutils. 2023-11-20T06:57:44.338 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-11-20T06:57:44.347 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-osd. 2023-11-20T06:57:44.362 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:44.381 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-20T06:57:44.405 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-osd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:44.717 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-20T06:57:44.732 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-20T06:57:44.775 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-20T06:57:45.078 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-mako. 2023-11-20T06:57:45.093 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-20T06:57:45.728 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-20T06:57:46.064 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-20T06:57:46.080 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-20T06:57:46.114 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-20T06:57:46.126 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph. 2023-11-20T06:57:46.140 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../061-ceph_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:46.184 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:46.400 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-20T06:57:46.415 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-20T06:57:46.458 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-20T06:57:46.528 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-fuse. 2023-11-20T06:57:46.543 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:46.603 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:46.786 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webob. 2023-11-20T06:57:46.802 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-20T06:57:46.844 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-20T06:57:46.964 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mds. 2023-11-20T06:57:46.980 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:47.022 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mds (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:47.172 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-waitress. 2023-11-20T06:57:47.187 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-20T06:57:47.233 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-20T06:57:47.351 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephadm. 2023-11-20T06:57:47.365 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../064-cephadm_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:47.400 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:47.510 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-tempita. 2023-11-20T06:57:47.525 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-20T06:57:47.560 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-20T06:57:47.720 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-20T06:57:47.735 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-20T06:57:47.778 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-20T06:57:47.879 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-paste. 2023-11-20T06:57:47.895 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-20T06:57:47.937 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-20T06:57:48.064 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-20T06:57:48.079 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-20T06:57:48.114 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-20T06:57:48.257 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-20T06:57:48.272 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-20T06:57:48.307 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-20T06:57:48.627 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-20T06:57:48.642 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-20T06:57:48.835 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-20T06:57:49.094 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-babel. 2023-11-20T06:57:49.108 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-20T06:57:49.138 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webtest. 2023-11-20T06:57:49.152 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-20T06:57:49.153 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-11-20T06:57:49.196 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-20T06:57:49.472 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jinja2. 2023-11-20T06:57:49.485 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-11-20T06:57:49.507 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pecan. 2023-11-20T06:57:49.522 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-20T06:57:49.530 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-20T06:57:49.598 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-20T06:57:49.962 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-certifi. 2023-11-20T06:57:49.977 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-11-20T06:57:50.019 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-20T06:57:50.083 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-20T06:57:50.097 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:57:50.133 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:50.330 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-idna. 2023-11-20T06:57:50.346 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-11-20T06:57:50.380 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-20T06:57:50.403 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-20T06:57:50.417 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-20T06:57:50.453 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-20T06:57:50.683 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-urllib3. 2023-11-20T06:57:50.697 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-20T06:57:50.741 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-20T06:57:50.748 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-20T06:57:50.762 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-11-20T06:57:50.806 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-20T06:57:51.036 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-requests. 2023-11-20T06:57:51.050 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-20T06:57:51.094 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-20T06:57:51.134 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-routes. 2023-11-20T06:57:51.148 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-20T06:57:51.192 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-20T06:57:51.405 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-20T06:57:51.420 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-20T06:57:51.463 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-20T06:57:51.521 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-20T06:57:51.534 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:57:51.579 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:51.775 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-20T06:57:51.790 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:57:51.833 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:51.999 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-20T06:57:52.012 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-20T06:57:52.057 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-20T06:57:52.196 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-20T06:57:52.210 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:52.246 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:52.507 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-openssl. 2023-11-20T06:57:52.521 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-11-20T06:57:52.527 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-joblib. 2023-11-20T06:57:52.541 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-20T06:57:52.585 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-20T06:57:52.598 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-20T06:57:52.880 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-20T06:57:52.894 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-20T06:57:52.930 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-20T06:57:52.935 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr. 2023-11-20T06:57:52.950 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:52.993 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:53.242 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-sklearn. 2023-11-20T06:57:53.255 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-20T06:57:53.300 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-20T06:57:53.371 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mon. 2023-11-20T06:57:53.386 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:53.429 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mon (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:53.933 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-20T06:57:53.947 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:57:53.991 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:54.207 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-osd. 2023-11-20T06:57:54.222 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:54.265 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-osd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:54.936 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cachetools. 2023-11-20T06:57:54.951 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-11-20T06:57:54.986 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-20T06:57:55.289 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-20T06:57:55.304 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-20T06:57:55.347 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-20T06:57:55.461 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph. 2023-11-20T06:57:55.476 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../061-ceph_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:55.543 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:55.692 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-20T06:57:55.707 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-20T06:57:55.750 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-20T06:57:55.829 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-fuse. 2023-11-20T06:57:55.844 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:55.879 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:56.061 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rsa. 2023-11-20T06:57:56.076 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-11-20T06:57:56.119 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-20T06:57:56.250 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mds. 2023-11-20T06:57:56.265 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:56.307 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mds (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:56.508 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-google-auth. 2023-11-20T06:57:56.523 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-11-20T06:57:56.557 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-20T06:57:56.702 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephadm. 2023-11-20T06:57:56.717 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../064-cephadm_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:57:56.760 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:56.819 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-20T06:57:56.834 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-20T06:57:56.869 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-20T06:57:57.047 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-20T06:57:57.062 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-20T06:57:57.105 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-20T06:57:57.180 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-websocket. 2023-11-20T06:57:57.195 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-11-20T06:57:57.238 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-20T06:57:57.416 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-20T06:57:57.431 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-20T06:57:57.474 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-20T06:57:57.592 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-20T06:57:57.607 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-20T06:57:57.650 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-20T06:57:58.305 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-20T06:57:58.320 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:57:58.388 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:58.487 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-babel. 2023-11-20T06:57:58.502 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-20T06:57:58.553 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-20T06:57:58.683 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-20T06:57:58.696 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-20T06:57:58.733 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-20T06:57:58.823 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jinja2. 2023-11-20T06:57:58.837 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-11-20T06:57:58.873 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-20T06:57:59.052 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-20T06:57:59.066 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-20T06:57:59.110 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-20T06:57:59.326 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-20T06:57:59.340 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:57:59.363 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package jq. 2023-11-20T06:57:59.376 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:57:59.377 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-20T06:57:59.446 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-20T06:57:59.663 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-20T06:57:59.677 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-20T06:57:59.707 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package socat. 2023-11-20T06:57:59.712 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-20T06:57:59.721 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-20T06:57:59.765 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-20T06:58:00.015 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-20T06:58:00.030 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-11-20T06:58:00.043 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package xmlstarlet. 2023-11-20T06:58:00.058 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-20T06:58:00.073 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-20T06:58:00.101 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-20T06:58:00.343 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-routes. 2023-11-20T06:58:00.357 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-20T06:58:00.393 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-20T06:58:00.639 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-test. 2023-11-20T06:58:00.653 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:58:00.697 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-test (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:00.763 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-20T06:58:00.778 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:58:00.821 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:01.267 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-20T06:58:01.281 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-20T06:58:01.325 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-20T06:58:01.828 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-joblib. 2023-11-20T06:58:01.842 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-20T06:58:01.886 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-20T06:58:02.232 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-20T06:58:02.245 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-20T06:58:02.281 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-20T06:58:02.511 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-volume. 2023-11-20T06:58:02.526 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:58:02.568 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-volume (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:02.593 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-sklearn. 2023-11-20T06:58:02.607 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-20T06:58:02.651 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-20T06:58:02.973 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-20T06:58:02.988 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:58:03.031 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-mirror (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:03.284 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-colorama. 2023-11-20T06:58:03.300 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-11-20T06:58:03.342 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-20T06:58:03.359 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-20T06:58:03.373 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:58:03.425 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:03.578 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-shell. 2023-11-20T06:58:03.594 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:58:03.628 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-shell (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:03.897 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-top. 2023-11-20T06:58:03.913 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:58:03.955 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-top (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:04.185 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-20T06:58:04.201 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:58:04.243 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libcephfs-dev (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:04.562 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cachetools. 2023-11-20T06:58:04.578 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-11-20T06:58:04.605 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package nvme-cli. 2023-11-20T06:58:04.612 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-20T06:58:04.621 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-20T06:58:04.663 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-20T06:58:04.906 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-20T06:58:04.922 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-20T06:58:04.964 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-20T06:58:05.026 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-20T06:58:05.041 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-20T06:58:05.084 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-20T06:58:05.337 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-20T06:58:05.353 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-20T06:58:05.392 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-20T06:58:05.595 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-20T06:58:05.610 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-20T06:58:05.654 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-20T06:58:05.737 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rsa. 2023-11-20T06:58:05.752 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-11-20T06:58:05.795 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-20T06:58:05.965 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pastescript. 2023-11-20T06:58:05.980 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-11-20T06:58:06.023 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-20T06:58:06.175 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-google-auth. 2023-11-20T06:58:06.191 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-11-20T06:58:06.233 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-20T06:58:06.385 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pluggy. 2023-11-20T06:58:06.400 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-20T06:58:06.435 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-20T06:58:06.578 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-20T06:58:06.593 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-20T06:58:06.636 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-20T06:58:06.696 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-psutil. 2023-11-20T06:58:06.711 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-20T06:58:06.754 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-20T06:58:06.931 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-websocket. 2023-11-20T06:58:06.946 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-11-20T06:58:06.989 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-20T06:58:07.115 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-py. 2023-11-20T06:58:07.131 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-11-20T06:58:07.165 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-20T06:58:07.309 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-20T06:58:07.325 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-20T06:58:07.367 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-20T06:58:07.477 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pygments. 2023-11-20T06:58:07.493 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-20T06:58:07.535 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-20T06:58:07.947 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-20T06:58:07.962 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-20T06:58:07.997 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-20T06:58:08.064 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-20T06:58:08.078 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:58:08.122 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:08.325 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-toml. 2023-11-20T06:58:08.339 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-11-20T06:58:08.383 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-20T06:58:08.450 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-20T06:58:08.464 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-20T06:58:08.539 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-20T06:58:08.677 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pytest. 2023-11-20T06:58:08.691 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-20T06:58:08.735 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-20T06:58:08.827 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-20T06:58:08.842 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-20T06:58:08.877 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-20T06:58:09.064 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-simplejson. 2023-11-20T06:58:09.078 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-20T06:58:09.113 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package jq. 2023-11-20T06:58:09.122 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-20T06:58:09.128 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-20T06:58:09.171 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-20T06:58:09.400 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-20T06:58:09.414 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-20T06:58:09.457 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-20T06:58:09.649 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package socat. 2023-11-20T06:58:09.664 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-20T06:58:09.707 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-20T06:58:10.010 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package xmlstarlet. 2023-11-20T06:58:10.026 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-20T06:58:10.060 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-20T06:58:10.195 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package radosgw. 2023-11-20T06:58:10.209 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../113-radosgw_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:58:10.245 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking radosgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:10.406 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-test. 2023-11-20T06:58:10.420 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:58:10.464 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-test (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:10.798 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package rbd-fuse. 2023-11-20T06:58:10.813 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:58:10.856 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking rbd-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:11.132 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-20T06:58:11.403 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-20T06:58:11.520 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-20T06:58:11.782 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-20T06:58:12.168 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-20T06:58:12.285 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-volume. 2023-11-20T06:58:12.300 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:58:12.343 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-volume (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:12.755 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-20T06:58:12.756 INFO:teuthology.orchestra.run.smithi088.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-20T06:58:12.771 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:58:12.809 INFO:teuthology.orchestra.run.smithi088.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-20T06:58:12.813 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephfs-mirror (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:12.855 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:13.124 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-colorama. 2023-11-20T06:58:13.140 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-11-20T06:58:13.191 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-20T06:58:13.408 INFO:teuthology.orchestra.run.smithi088.stdout:Adding system user cephadm....done 2023-11-20T06:58:13.419 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephfs-shell. 2023-11-20T06:58:13.434 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:58:13.477 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephfs-shell (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:13.569 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-20T06:58:13.788 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephfs-top. 2023-11-20T06:58:13.804 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6612-g895e5ada-1jammy_all.deb ... 2023-11-20T06:58:13.821 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-20T06:58:13.846 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephfs-top (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:14.080 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-20T06:58:14.098 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-20T06:58:14.114 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:58:14.157 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs-dev (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:14.206 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-20T06:58:14.465 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-20T06:58:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package nvme-cli. 2023-11-20T06:58:14.518 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-20T06:58:14.585 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-20T06:58:14.758 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-20T06:58:14.884 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-20T06:58:14.923 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-20T06:58:14.938 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-20T06:58:14.981 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-20T06:58:15.186 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-20T06:58:15.393 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-20T06:58:15.407 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-20T06:58:15.442 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-20T06:58:15.554 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-20T06:58:15.745 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pastescript. 2023-11-20T06:58:15.760 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-11-20T06:58:15.803 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-20T06:58:16.039 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-20T06:58:16.106 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pluggy. 2023-11-20T06:58:16.122 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-20T06:58:16.165 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-20T06:58:16.307 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-20T06:58:16.459 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-psutil. 2023-11-20T06:58:16.475 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-20T06:58:16.542 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-20T06:58:16.608 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-20T06:58:16.870 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-py. 2023-11-20T06:58:16.886 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-11-20T06:58:16.893 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-20T06:58:16.928 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-20T06:58:17.154 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-20T06:58:17.273 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pygments. 2023-11-20T06:58:17.289 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-20T06:58:17.331 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-20T06:58:17.403 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-ceph-argparse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:17.654 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-20T06:58:17.793 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-20T06:58:17.804 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-20T06:58:17.808 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-20T06:58:17.851 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-20T06:58:18.072 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-20T06:58:18.146 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-toml. 2023-11-20T06:58:18.160 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-11-20T06:58:18.196 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-20T06:58:18.332 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-20T06:58:18.457 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-20T06:58:18.473 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pytest. 2023-11-20T06:58:18.489 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-20T06:58:18.556 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-20T06:58:18.851 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-20T06:58:18.893 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-simplejson. 2023-11-20T06:58:18.908 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-20T06:58:18.951 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-20T06:58:18.960 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-20T06:58:19.211 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-20T06:58:19.220 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-20T06:58:19.236 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-20T06:58:19.278 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-20T06:58:19.470 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-20T06:58:19.797 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-20T06:58:21.607 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-20T06:58:21.607 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-20T06:58:21.608 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-20T06:58:21.608 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-20T06:58:21.608 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-20T06:58:21.608 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package radosgw. 2023-11-20T06:58:21.609 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../113-radosgw_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:58:21.609 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking radosgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:21.609 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package rbd-fuse. 2023-11-20T06:58:21.609 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6612-g895e5ada-1jammy_amd64.deb ... 2023-11-20T06:58:21.609 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking rbd-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:21.609 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-20T06:58:21.609 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-20T06:58:21.609 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-20T06:58:21.609 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-20T06:58:21.712 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-20T06:58:21.971 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-20T06:58:21.985 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-20T06:58:22.390 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-20T06:58:22.580 INFO:teuthology.orchestra.run.smithi175.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-20T06:58:22.627 INFO:teuthology.orchestra.run.smithi175.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-20T06:58:22.675 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:22.699 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-20T06:58:23.017 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-20T06:58:23.245 INFO:teuthology.orchestra.run.smithi175.stdout:Adding system user cephadm....done 2023-11-20T06:58:23.360 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-20T06:58:23.372 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-20T06:58:23.627 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-20T06:58:23.649 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-20T06:58:23.745 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:23.900 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-20T06:58:24.017 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-20T06:58:24.046 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-idna (3.3-1) ... 2023-11-20T06:58:24.277 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-20T06:58:24.390 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-20T06:58:24.545 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-20T06:58:24.704 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-20T06:58:25.272 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-20T06:58:25.620 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:58:25.649 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-20T06:58:25.754 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-20T06:58:25.900 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-20T06:58:26.030 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-20T06:58:26.156 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-20T06:58:26.168 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-20T06:58:26.281 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-20T06:58:26.453 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-20T06:58:26.600 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-20T06:58:26.712 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-20T06:58:26.843 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-20T06:58:26.980 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-20T06:58:27.085 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:58:27.203 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-20T06:58:27.231 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-ceph-argparse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:27.329 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-20T06:58:27.507 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-20T06:58:27.660 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-20T06:58:27.680 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-20T06:58:27.928 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-20T06:58:27.940 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-20T06:58:28.187 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-20T06:58:28.216 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-20T06:58:28.304 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-20T06:58:28.475 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-20T06:58:28.656 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-20T06:58:28.718 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-20T06:58:28.781 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-20T06:58:28.977 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-20T06:58:29.058 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-20T06:58:29.103 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-20T06:58:29.325 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-20T06:58:29.396 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-20T06:58:29.547 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-20T06:58:29.669 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-20T06:58:29.848 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-20T06:58:30.157 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-20T06:58:30.363 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-20T06:58:30.417 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-20T06:58:30.631 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-20T06:58:30.756 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-20T06:58:30.810 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-20T06:58:30.865 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-20T06:58:31.069 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-20T06:58:31.175 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-20T06:58:31.429 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-20T06:58:31.585 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-20T06:58:31.830 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-20T06:58:31.852 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-20T06:58:32.106 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-20T06:58:32.262 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-20T06:58:32.366 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:58:32.467 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-20T06:58:32.563 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-20T06:58:32.793 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-20T06:58:32.881 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-20T06:58:33.086 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-20T06:58:33.225 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-20T06:58:33.353 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-20T06:58:33.479 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-20T06:58:33.484 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-20T06:58:33.643 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:33.780 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-20T06:58:33.970 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-idna (3.3-1) ... 2023-11-20T06:58:34.073 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-20T06:58:34.312 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-20T06:58:34.349 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-20T06:58:34.734 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-20T06:58:35.035 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-20T06:58:35.370 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-20T06:58:35.497 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librados2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:35.568 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:58:35.622 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librgw2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:35.703 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-20T06:58:35.819 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:35.951 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libcephfs2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:35.970 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-20T06:58:36.078 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libradosstriper1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:36.096 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-20T06:58:36.203 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-20T06:58:36.222 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-20T06:58:36.497 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librbd1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:36.540 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-20T06:58:36.623 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:36.757 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:36.800 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-20T06:58:36.982 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-20T06:58:36.982 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-20T06:58:37.052 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:58:37.177 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-20T06:58:37.303 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-20T06:58:37.621 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-20T06:58:37.853 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libcephfs-dev (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:37.906 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-20T06:58:37.990 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rados (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:38.120 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-top (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:38.173 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-20T06:58:38.246 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-20T06:58:38.441 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-20T06:58:38.726 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-20T06:58:39.002 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-20T06:58:39.128 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-20T06:58:39.420 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-20T06:58:39.533 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rbd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:39.580 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-20T06:58:39.634 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up rbd-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:39.743 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:39.869 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cephfs (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:39.881 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-20T06:58:39.995 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-shell (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:40.138 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:40.199 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-20T06:58:40.485 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-20T06:58:40.649 INFO:teuthology.orchestra.run.smithi088.stdout:Adding group ceph....done 2023-11-20T06:58:40.947 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-20T06:58:41.017 INFO:teuthology.orchestra.run.smithi088.stdout:Adding system user ceph....done 2023-11-20T06:58:41.211 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-20T06:58:41.220 INFO:teuthology.orchestra.run.smithi088.stdout:Setting system user ceph properties....done 2023-11-20T06:58:41.238 INFO:teuthology.orchestra.run.smithi088.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-20T06:58:41.337 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-20T06:58:41.378 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-20T06:58:41.731 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-20T06:58:41.768 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-20T06:58:42.006 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-20T06:58:42.299 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-20T06:58:42.408 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-20T06:58:42.438 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-mirror (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:42.656 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-20T06:58:42.656 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-20T06:58:42.768 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-20T06:58:43.077 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-20T06:58:43.323 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-test (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:43.362 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-20T06:58:43.424 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up radosgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:43.513 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-20T06:58:43.797 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-20T06:58:43.947 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-20T06:58:43.948 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-20T06:58:44.065 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-20T06:58:44.316 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-20T06:58:44.618 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-base (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:44.693 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-20T06:58:44.974 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-20T06:58:44.985 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-20T06:58:45.355 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-20T06:58:45.505 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librados2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:45.615 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librgw2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:45.732 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mds (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:45.810 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:45.936 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs2 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:46.013 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-20T06:58:46.013 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-20T06:58:46.079 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libradosstriper1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:46.205 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-20T06:58:46.507 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librbd1 (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:46.632 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:46.673 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:46.742 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:46.950 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-20T06:58:46.951 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-20T06:58:47.170 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-20T06:58:47.171 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-20T06:58:47.602 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs-dev (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:47.728 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rados (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:47.825 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-osd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:47.853 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephfs-top (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:47.980 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-20T06:58:48.139 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-20T06:58:48.140 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-20T06:58:48.743 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:48.852 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:48.995 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mon (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:49.204 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-20T06:58:49.205 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-20T06:58:49.251 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rbd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:49.395 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up rbd-fuse (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:49.528 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:49.654 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cephfs (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:49.780 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephfs-shell (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:49.830 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:49.906 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-common (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:49.981 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:50.107 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:50.250 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-volume (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:50.468 INFO:teuthology.orchestra.run.smithi175.stdout:Adding group ceph....done 2023-11-20T06:58:50.577 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-20T06:58:50.852 INFO:teuthology.orchestra.run.smithi175.stdout:Adding system user ceph....done 2023-11-20T06:58:51.047 INFO:teuthology.orchestra.run.smithi175.stdout:Setting system user ceph properties....done 2023-11-20T06:58:51.063 INFO:teuthology.orchestra.run.smithi175.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-20T06:58:51.203 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-20T06:58:51.352 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-20T06:58:51.595 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-20T06:58:51.813 INFO:teuthology.orchestra.run.smithi088.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-20T06:58:51.818 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-20T06:58:51.892 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2023-11-20T06:58:52.057 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2023-11-20T06:58:52.058 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2023-11-20T06:58:52.208 INFO:teuthology.orchestra.run.smithi088.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-20T06:58:52.208 INFO:teuthology.orchestra.run.smithi088.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-20T06:58:52.208 INFO:teuthology.orchestra.run.smithi088.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-20T06:58:52.208 INFO:teuthology.orchestra.run.smithi088.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-20T06:58:52.208 INFO:teuthology.orchestra.run.smithi088.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-20T06:58:52.208 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2023-11-20T06:58:52.208 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-20T06:58:52.208 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-20T06:58:52.208 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-20T06:58:52.209 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-20T06:58:52.209 INFO:teuthology.orchestra.run.smithi088.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-20T06:58:52.210 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-20T06:58:52.210 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2023-11-20T06:58:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-20T06:58:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-20T06:58:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-20T06:58:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-20T06:58:52.210 INFO:teuthology.orchestra.run.smithi088.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-20T06:58:52.211 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2023-11-20T06:58:52.211 INFO:teuthology.orchestra.run.smithi088.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-20T06:58:52.211 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-20T06:58:52.211 INFO:teuthology.orchestra.run.smithi088.stdout: libengine-pkcs11-openssl 2023-11-20T06:58:52.259 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2023-11-20T06:58:52.260 INFO:teuthology.orchestra.run.smithi088.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-20T06:58:52.260 INFO:teuthology.orchestra.run.smithi088.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-20T06:58:52.261 INFO:teuthology.orchestra.run.smithi088.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-20T06:58:52.261 INFO:teuthology.orchestra.run.smithi088.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-20T06:58:52.261 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-20T06:58:52.261 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-20T06:58:52.261 INFO:teuthology.orchestra.run.smithi088.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-20T06:58:52.262 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages will be upgraded: 2023-11-20T06:58:52.262 INFO:teuthology.orchestra.run.smithi088.stdout: libssl3 2023-11-20T06:58:52.291 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephfs-mirror (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:52.317 INFO:teuthology.orchestra.run.smithi088.stdout:1 upgraded, 39 newly installed, 0 to remove and 262 not upgraded. 2023-11-20T06:58:52.318 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 54.6 MB of archives. 2023-11-20T06:58:52.318 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-20T06:58:52.318 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-20T06:58:52.420 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-20T06:58:52.475 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-20T06:58:52.483 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-20T06:58:52.483 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-20T06:58:52.485 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-20T06:58:52.486 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-20T06:58:52.486 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-20T06:58:52.488 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-20T06:58:52.488 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-20T06:58:52.489 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-20T06:58:52.494 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-20T06:58:52.506 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-20T06:58:52.524 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-20T06:58:52.524 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-20T06:58:52.721 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-20T06:58:52.723 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-20T06:58:52.723 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-20T06:58:52.726 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-20T06:58:52.726 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-20T06:58:52.731 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-20T06:58:52.732 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-20T06:58:52.740 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-20T06:58:52.740 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-20T06:58:52.761 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-20T06:58:52.761 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-20T06:58:52.771 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-20T06:58:52.792 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-20T06:58:52.796 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-20T06:58:52.796 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-20T06:58:52.797 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-20T06:58:52.797 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-20T06:58:52.809 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-20T06:58:52.811 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-20T06:58:52.957 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-20T06:58:52.957 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-20T06:58:52.958 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-20T06:58:52.958 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-20T06:58:52.958 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-20T06:58:52.959 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-20T06:58:52.970 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-20T06:58:52.971 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-20T06:58:53.167 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-test (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:53.293 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up radosgw (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:53.345 INFO:teuthology.orchestra.run.smithi088.stdout:Preconfiguring packages ... 2023-11-20T06:58:53.500 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 54.6 MB in 1s (77.8 MB/s) 2023-11-20T06:58:53.643 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package flex. 2023-11-20T06:58:53.713 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139849 files and directories currently installed.) 2023-11-20T06:58:53.717 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-20T06:58:53.758 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-20T06:58:53.877 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-20T06:58:53.877 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-20T06:58:54.327 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-20T06:58:54.486 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-base (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:54.497 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-20T06:58:54.847 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-20T06:58:54.877 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-20T06:58:55.405 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package bison. 2023-11-20T06:58:55.478 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139922 files and directories currently installed.) 2023-11-20T06:58:55.481 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-20T06:58:55.525 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-20T06:58:55.546 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mds (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:55.778 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-20T06:58:55.778 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-20T06:58:55.942 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-20T06:58:55.956 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-20T06:58:56.000 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-20T06:58:56.378 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package dump. 2023-11-20T06:58:56.392 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-20T06:58:56.436 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking dump (0.4b47-3) ... 2023-11-20T06:58:56.717 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package indent. 2023-11-20T06:58:56.730 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:58:56.775 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-20T06:58:56.945 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:57.036 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-20T06:58:57.050 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-20T06:58:57.086 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-20T06:58:57.166 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-20T06:58:57.166 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-20T06:58:57.566 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-20T06:58:57.580 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-20T06:58:57.624 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-20T06:58:57.772 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-osd (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:57.876 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-20T06:58:57.891 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-20T06:58:57.926 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-20T06:58:58.099 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-20T06:58:58.099 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-20T06:58:58.288 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-20T06:58:58.302 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-20T06:58:58.346 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-20T06:58:58.599 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-20T06:58:58.613 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-20T06:58:58.657 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-20T06:58:58.715 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:58.840 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:58.910 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjson-perl. 2023-11-20T06:58:58.923 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-20T06:58:58.969 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-20T06:58:58.992 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mon (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:59.201 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-20T06:58:59.201 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-20T06:58:59.263 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-20T06:58:59.276 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-20T06:58:59.346 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-20T06:58:59.810 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:58:59.944 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:59:00.070 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:59:00.213 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-volume (18.0.0-6612-g895e5ada-1jammy) ... 2023-11-20T06:59:00.574 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-20T06:59:00.724 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-20T06:59:00.739 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-20T06:59:00.782 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:59:01.026 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-20T06:59:01.041 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-20T06:59:01.084 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:59:01.362 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-20T06:59:01.377 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-20T06:59:01.412 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:59:01.725 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-20T06:59:01.773 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-20T06:59:01.788 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-20T06:59:01.831 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-20T06:59:02.168 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-20T06:59:02.183 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-20T06:59:02.195 INFO:teuthology.orchestra.run.smithi175.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-20T06:59:02.200 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-20T06:59:02.226 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-20T06:59:02.275 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2023-11-20T06:59:02.441 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2023-11-20T06:59:02.442 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2023-11-20T06:59:02.529 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-20T06:59:02.543 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:59:02.592 INFO:teuthology.orchestra.run.smithi175.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-20T06:59:02.592 INFO:teuthology.orchestra.run.smithi175.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-20T06:59:02.592 INFO:teuthology.orchestra.run.smithi175.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-20T06:59:02.592 INFO:teuthology.orchestra.run.smithi175.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-20T06:59:02.592 INFO:teuthology.orchestra.run.smithi175.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-20T06:59:02.592 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2023-11-20T06:59:02.592 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-20T06:59:02.592 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-20T06:59:02.593 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-20T06:59:02.593 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-20T06:59:02.593 INFO:teuthology.orchestra.run.smithi175.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-20T06:59:02.594 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-20T06:59:02.594 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2023-11-20T06:59:02.594 INFO:teuthology.orchestra.run.smithi175.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-20T06:59:02.594 INFO:teuthology.orchestra.run.smithi175.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-20T06:59:02.594 INFO:teuthology.orchestra.run.smithi175.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-20T06:59:02.594 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-20T06:59:02.595 INFO:teuthology.orchestra.run.smithi175.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-20T06:59:02.595 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:59:02.595 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2023-11-20T06:59:02.595 INFO:teuthology.orchestra.run.smithi175.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-20T06:59:02.595 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-20T06:59:02.595 INFO:teuthology.orchestra.run.smithi175.stdout: libengine-pkcs11-openssl 2023-11-20T06:59:02.644 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2023-11-20T06:59:02.644 INFO:teuthology.orchestra.run.smithi175.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-20T06:59:02.645 INFO:teuthology.orchestra.run.smithi175.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-20T06:59:02.645 INFO:teuthology.orchestra.run.smithi175.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-20T06:59:02.645 INFO:teuthology.orchestra.run.smithi175.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-20T06:59:02.645 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-20T06:59:02.646 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-20T06:59:02.646 INFO:teuthology.orchestra.run.smithi175.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-20T06:59:02.646 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages will be upgraded: 2023-11-20T06:59:02.647 INFO:teuthology.orchestra.run.smithi175.stdout: libssl3 2023-11-20T06:59:02.701 INFO:teuthology.orchestra.run.smithi175.stdout:1 upgraded, 39 newly installed, 0 to remove and 262 not upgraded. 2023-11-20T06:59:02.702 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 54.6 MB of archives. 2023-11-20T06:59:02.702 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-20T06:59:02.702 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-20T06:59:02.804 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-20T06:59:02.858 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-20T06:59:02.866 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-20T06:59:02.866 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-20T06:59:02.868 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-20T06:59:02.869 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-20T06:59:02.870 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-20T06:59:02.871 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-20T06:59:02.871 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-20T06:59:02.872 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-20T06:59:02.877 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-20T06:59:02.889 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-20T06:59:02.906 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-20T06:59:02.920 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:59:02.964 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:59:03.108 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-20T06:59:03.110 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-20T06:59:03.110 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-20T06:59:03.113 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-20T06:59:03.113 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-20T06:59:03.118 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-20T06:59:03.120 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-20T06:59:03.127 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-20T06:59:03.127 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-20T06:59:03.148 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-20T06:59:03.149 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-20T06:59:03.159 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-20T06:59:03.180 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-20T06:59:03.184 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-20T06:59:03.184 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-20T06:59:03.185 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-20T06:59:03.186 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-20T06:59:03.197 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-20T06:59:03.199 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-20T06:59:03.250 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-20T06:59:03.264 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:59:03.309 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:59:03.347 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-20T06:59:03.347 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-20T06:59:03.347 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-20T06:59:03.347 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-20T06:59:03.348 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-20T06:59:03.348 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-20T06:59:03.360 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-20T06:59:03.361 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-20T06:59:03.553 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-20T06:59:03.567 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-20T06:59:03.636 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-20T06:59:03.735 INFO:teuthology.orchestra.run.smithi175.stdout:Preconfiguring packages ... 2023-11-20T06:59:03.881 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 54.6 MB in 1s (77.2 MB/s) 2023-11-20T06:59:04.023 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package flex. 2023-11-20T06:59:04.096 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139849 files and directories currently installed.) 2023-11-20T06:59:04.100 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-20T06:59:04.147 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-20T06:59:04.156 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-20T06:59:04.170 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-20T06:59:04.214 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-20T06:59:04.559 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package modemmanager. 2023-11-20T06:59:04.573 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-20T06:59:04.617 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:59:04.684 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-20T06:59:04.853 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-20T06:59:05.266 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-20T06:59:05.298 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package network-manager. 2023-11-20T06:59:05.314 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-20T06:59:05.365 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-20T06:59:05.787 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package bison. 2023-11-20T06:59:05.859 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139922 files and directories currently installed.) 2023-11-20T06:59:05.863 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-20T06:59:05.906 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-20T06:59:05.997 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ppp. 2023-11-20T06:59:06.012 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-20T06:59:06.323 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-20T06:59:06.337 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-20T06:59:06.362 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-20T06:59:06.398 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-20T06:59:06.686 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package pptp-linux. 2023-11-20T06:59:06.700 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-20T06:59:06.702 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package dump. 2023-11-20T06:59:06.716 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-20T06:59:06.744 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-20T06:59:06.752 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking dump (0.4b47-3) ... 2023-11-20T06:59:06.996 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-20T06:59:07.011 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-20T06:59:07.021 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package indent. 2023-11-20T06:59:07.036 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:59:07.054 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-20T06:59:07.080 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-20T06:59:07.382 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-20T06:59:07.398 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-20T06:59:07.441 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-20T06:59:07.442 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-20T06:59:07.456 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-20T06:59:07.500 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client-common (238) ... 2023-11-20T06:59:07.770 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-20T06:59:07.785 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-20T06:59:07.804 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-20T06:59:07.818 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:59:07.828 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-20T06:59:07.879 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:59:08.056 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-20T06:59:08.071 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-20T06:59:08.105 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-20T06:59:08.434 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-common. 2023-11-20T06:59:08.448 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-20T06:59:08.476 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-20T06:59:08.491 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-20T06:59:08.509 INFO:teuthology.orchestra.run.smithi088.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-20T06:59:08.534 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-20T06:59:08.540 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-common (238) ... 2023-11-20T06:59:08.770 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-20T06:59:08.785 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-20T06:59:08.828 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-20T06:59:09.025 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-14. 2023-11-20T06:59:09.039 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:59:09.086 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:59:09.089 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libjson-perl. 2023-11-20T06:59:09.105 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-20T06:59:09.147 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-20T06:59:09.450 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-20T06:59:09.467 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-20T06:59:09.509 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-20T06:59:10.128 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql. 2023-11-20T06:59:10.142 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-20T06:59:10.178 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql (14+238) ... 2023-11-20T06:59:10.413 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client. 2023-11-20T06:59:10.428 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-20T06:59:10.471 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client (14+238) ... 2023-11-20T06:59:10.698 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-20T06:59:10.713 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-20T06:59:10.757 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-20T06:59:10.836 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-20T06:59:10.852 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-20T06:59:10.886 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:59:11.093 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package tcl8.6. 2023-11-20T06:59:11.107 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-20T06:59:11.139 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-20T06:59:11.151 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-20T06:59:11.154 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-20T06:59:11.197 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:59:11.437 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package tcl. 2023-11-20T06:59:11.452 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-20T06:59:11.500 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-20T06:59:11.558 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-20T06:59:11.574 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-20T06:59:11.616 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:59:11.798 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package wpasupplicant. 2023-11-20T06:59:11.814 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-20T06:59:11.848 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-20T06:59:11.944 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-20T06:59:11.960 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-20T06:59:12.002 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-20T06:59:12.203 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-20T06:59:12.218 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-20T06:59:12.261 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-20T06:59:12.305 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-20T06:59:12.321 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-20T06:59:12.363 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-20T06:59:12.700 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-20T06:59:12.715 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:59:12.758 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:59:12.790 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-20T06:59:12.806 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-20T06:59:12.849 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-20T06:59:13.094 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-20T06:59:13.110 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:59:13.152 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:59:13.199 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client-common (238) ... 2023-11-20T06:59:13.413 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-20T06:59:13.428 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:59:13.446 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-20T06:59:13.471 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:59:13.572 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-20T06:59:13.698 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:59:13.740 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-20T06:59:13.756 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-20T06:59:13.798 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-20T06:59:13.833 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-20T06:59:13.959 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-20T06:59:14.085 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:59:14.227 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-20T06:59:14.242 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-20T06:59:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-20T06:59:14.630 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package modemmanager. 2023-11-20T06:59:14.645 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-20T06:59:14.688 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:59:15.082 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-20T06:59:15.181 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-20T06:59:15.277 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package network-manager. 2023-11-20T06:59:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-20T06:59:15.344 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-20T06:59:15.584 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-20T06:59:15.584 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-20T06:59:15.993 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ppp. 2023-11-20T06:59:16.008 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-20T06:59:16.284 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-20T06:59:16.388 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-20T06:59:16.418 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-20T06:59:16.527 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-20T06:59:16.653 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-20T06:59:16.722 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package pptp-linux. 2023-11-20T06:59:16.736 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-20T06:59:16.779 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-20T06:59:16.780 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-20T06:59:16.905 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-20T06:59:17.016 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-20T06:59:17.031 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-20T06:59:17.031 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-20T06:59:17.075 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-20T06:59:17.377 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-20T06:59:17.392 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-20T06:59:17.436 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-client-common (238) ... 2023-11-20T06:59:17.781 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-20T06:59:17.796 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:59:17.839 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:59:18.037 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-20T06:59:18.163 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up dump (0.4b47-3) ... 2023-11-20T06:59:18.258 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-20T06:59:18.323 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:59:18.336 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-common. 2023-11-20T06:59:18.351 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-20T06:59:18.412 INFO:teuthology.orchestra.run.smithi175.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-20T06:59:18.443 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-common (238) ... 2023-11-20T06:59:18.466 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-20T06:59:18.592 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-20T06:59:18.734 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-20T06:59:18.844 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-20T06:59:18.917 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-20T06:59:18.945 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-14. 2023-11-20T06:59:18.960 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-20T06:59:18.987 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-20T06:59:19.006 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:59:19.113 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-20T06:59:19.289 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-20T06:59:19.415 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:59:19.542 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-20T06:59:19.735 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client (14+238) ... 2023-11-20T06:59:19.852 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-20T06:59:19.997 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql. 2023-11-20T06:59:20.012 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-20T06:59:20.056 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql (14+238) ... 2023-11-20T06:59:20.300 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-client. 2023-11-20T06:59:20.314 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-20T06:59:20.358 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-client (14+238) ... 2023-11-20T06:59:20.436 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:20.436 INFO:teuthology.orchestra.run.smithi088.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-20T06:59:20.436 INFO:teuthology.orchestra.run.smithi088.stdout:which means they are currently configured by ifupdown: 2023-11-20T06:59:20.436 INFO:teuthology.orchestra.run.smithi088.stdout:- enp3s0f1 2023-11-20T06:59:20.436 INFO:teuthology.orchestra.run.smithi088.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-20T06:59:20.436 INFO:teuthology.orchestra.run.smithi088.stdout:remove their configuration from /etc/network/interfaces. 2023-11-20T06:59:20.436 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:20.568 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-20T06:59:20.569 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-20T06:59:20.583 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-20T06:59:20.635 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-20T06:59:20.921 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package tcl8.6. 2023-11-20T06:59:20.936 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-20T06:59:20.969 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-20T06:59:20.978 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-20T06:59:21.265 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package tcl. 2023-11-20T06:59:21.281 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-20T06:59:21.329 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-20T06:59:21.374 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-20T06:59:21.701 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package wpasupplicant. 2023-11-20T06:59:21.717 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-20T06:59:21.759 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-20T06:59:22.046 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:59:22.094 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-20T06:59:22.106 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-20T06:59:22.155 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-20T06:59:22.193 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-20T06:59:22.316 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-20T06:59:22.425 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-common (238) ... 2023-11-20T06:59:22.527 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-20T06:59:22.541 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-20T06:59:22.608 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-20T06:59:22.883 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-client-common (238) ... 2023-11-20T06:59:23.222 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-20T06:59:23.348 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-20T06:59:23.457 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:59:23.599 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-20T06:59:23.725 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-20T06:59:23.749 INFO:teuthology.orchestra.run.smithi088.stdout:Adding user postgres to group ssl-cert 2023-11-20T06:59:23.851 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:59:24.040 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:24.040 INFO:teuthology.orchestra.run.smithi088.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-20T06:59:24.290 INFO:teuthology.orchestra.run.smithi088.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-20T06:59:24.290 INFO:teuthology.orchestra.run.smithi088.stdout:Removing obsolete dictionary files: 2023-11-20T06:59:24.867 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-20T06:59:24.949 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-20T06:59:24.979 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-20T06:59:25.318 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-20T06:59:25.318 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-20T06:59:25.470 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:59:25.818 INFO:teuthology.orchestra.run.smithi088.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-20T06:59:25.842 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-20T06:59:25.896 INFO:teuthology.orchestra.run.smithi088.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-20T06:59:25.896 INFO:teuthology.orchestra.run.smithi088.stdout:This user must also own the server process. 2023-11-20T06:59:25.897 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:25.897 INFO:teuthology.orchestra.run.smithi088.stdout:The database cluster will be initialized with locale "en_US". 2023-11-20T06:59:25.897 INFO:teuthology.orchestra.run.smithi088.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-20T06:59:25.897 INFO:teuthology.orchestra.run.smithi088.stdout:The default text search configuration will be set to "english". 2023-11-20T06:59:25.897 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:25.897 INFO:teuthology.orchestra.run.smithi088.stdout:Data page checksums are disabled. 2023-11-20T06:59:25.897 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:25.897 INFO:teuthology.orchestra.run.smithi088.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-20T06:59:25.898 INFO:teuthology.orchestra.run.smithi088.stdout:creating subdirectories ... ok 2023-11-20T06:59:25.898 INFO:teuthology.orchestra.run.smithi088.stdout:selecting dynamic shared memory implementation ... posix 2023-11-20T06:59:25.922 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default max_connections ... 100 2023-11-20T06:59:25.957 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default shared_buffers ... 128MB 2023-11-20T06:59:25.970 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default time zone ... Etc/UTC 2023-11-20T06:59:25.971 INFO:teuthology.orchestra.run.smithi088.stdout:creating configuration files ... ok 2023-11-20T06:59:26.009 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-20T06:59:26.142 INFO:teuthology.orchestra.run.smithi088.stdout:running bootstrap script ... ok 2023-11-20T06:59:26.169 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-20T06:59:26.295 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-20T06:59:26.421 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-20T06:59:26.572 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-20T06:59:26.698 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-20T06:59:26.773 INFO:teuthology.orchestra.run.smithi088.stdout:performing post-bootstrap initialization ... ok 2023-11-20T06:59:26.815 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-20T06:59:27.309 INFO:teuthology.orchestra.run.smithi088.stdout:syncing data to disk ... ok 2023-11-20T06:59:27.454 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-20T06:59:27.605 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up dump (0.4b47-3) ... 2023-11-20T06:59:27.700 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-20T06:59:27.765 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:59:27.827 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-20T06:59:27.882 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-20T06:59:28.036 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-20T06:59:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-20T06:59:28.643 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-20T06:59:28.741 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-20T06:59:28.803 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-20T06:59:28.929 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-20T06:59:29.105 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-20T06:59:29.231 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:59:29.357 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-20T06:59:29.533 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-client (14+238) ... 2023-11-20T06:59:29.643 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-20T06:59:30.243 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:30.243 INFO:teuthology.orchestra.run.smithi175.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-20T06:59:30.243 INFO:teuthology.orchestra.run.smithi175.stdout:which means they are currently configured by ifupdown: 2023-11-20T06:59:30.243 INFO:teuthology.orchestra.run.smithi175.stdout:- enp3s0f1 2023-11-20T06:59:30.243 INFO:teuthology.orchestra.run.smithi175.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-20T06:59:30.244 INFO:teuthology.orchestra.run.smithi175.stdout:remove their configuration from /etc/network/interfaces. 2023-11-20T06:59:30.244 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:30.376 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-20T06:59:30.793 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:59:30.795 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-20T06:59:30.919 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-20T06:59:31.045 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql (14+238) ... 2023-11-20T06:59:31.172 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:59:31.218 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-20T06:59:31.297 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:59:31.592 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-20T06:59:31.592 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-20T06:59:31.895 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-20T06:59:32.030 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-20T06:59:32.156 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-20T06:59:32.282 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-common (238) ... 2023-11-20T06:59:32.308 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-20T06:59:32.618 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-20T06:59:32.786 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-20T06:59:33.162 INFO:teuthology.orchestra.run.smithi175.stdout:Adding user postgres to group ssl-cert 2023-11-20T06:59:33.712 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:33.712 INFO:teuthology.orchestra.run.smithi175.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-20T06:59:34.010 INFO:teuthology.orchestra.run.smithi175.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-20T06:59:34.010 INFO:teuthology.orchestra.run.smithi175.stdout:Removing obsolete dictionary files: 2023-11-20T06:59:34.223 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-20T06:59:34.323 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-20T06:59:34.738 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-20T06:59:35.029 INFO:teuthology.orchestra.run.smithi088.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-20T06:59:35.034 DEBUG:teuthology.parallel:result is None 2023-11-20T06:59:35.199 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-20T06:59:35.554 INFO:teuthology.orchestra.run.smithi175.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-20T06:59:35.576 INFO:teuthology.orchestra.run.smithi175.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-20T06:59:35.632 INFO:teuthology.orchestra.run.smithi175.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-20T06:59:35.632 INFO:teuthology.orchestra.run.smithi175.stdout:This user must also own the server process. 2023-11-20T06:59:35.633 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:35.633 INFO:teuthology.orchestra.run.smithi175.stdout:The database cluster will be initialized with locale "en_US". 2023-11-20T06:59:35.633 INFO:teuthology.orchestra.run.smithi175.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-20T06:59:35.633 INFO:teuthology.orchestra.run.smithi175.stdout:The default text search configuration will be set to "english". 2023-11-20T06:59:35.633 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:35.633 INFO:teuthology.orchestra.run.smithi175.stdout:Data page checksums are disabled. 2023-11-20T06:59:35.633 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:35.633 INFO:teuthology.orchestra.run.smithi175.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-20T06:59:35.634 INFO:teuthology.orchestra.run.smithi175.stdout:creating subdirectories ... ok 2023-11-20T06:59:35.634 INFO:teuthology.orchestra.run.smithi175.stdout:selecting dynamic shared memory implementation ... posix 2023-11-20T06:59:35.658 INFO:teuthology.orchestra.run.smithi175.stdout:selecting default max_connections ... 100 2023-11-20T06:59:35.693 INFO:teuthology.orchestra.run.smithi175.stdout:selecting default shared_buffers ... 128MB 2023-11-20T06:59:35.707 INFO:teuthology.orchestra.run.smithi175.stdout:selecting default time zone ... Etc/UTC 2023-11-20T06:59:35.708 INFO:teuthology.orchestra.run.smithi175.stdout:creating configuration files ... ok 2023-11-20T06:59:35.878 INFO:teuthology.orchestra.run.smithi175.stdout:running bootstrap script ... ok 2023-11-20T06:59:36.504 INFO:teuthology.orchestra.run.smithi175.stdout:performing post-bootstrap initialization ... ok 2023-11-20T06:59:37.085 INFO:teuthology.orchestra.run.smithi175.stdout:syncing data to disk ... ok 2023-11-20T06:59:37.592 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-20T06:59:40.681 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:59:40.799 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-20T06:59:40.908 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql (14+238) ... 2023-11-20T06:59:41.042 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-20T06:59:41.168 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-20T06:59:41.431 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-20T06:59:41.431 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-20T06:59:42.170 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-20T06:59:42.472 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-20T06:59:42.640 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-20T06:59:44.034 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-20T06:59:44.143 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-20T06:59:44.864 INFO:teuthology.orchestra.run.smithi175.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-20T06:59:44.868 DEBUG:teuthology.parallel:result is None 2023-11-20T06:59:44.868 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-20T06:59:45.020 DEBUG:teuthology.orchestra.run.smithi088:> dpkg-query -W -f '${Version}' ceph 2023-11-20T06:59:45.044 INFO:teuthology.orchestra.run.smithi088.stdout:18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:59:45.045 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:59:45.045 INFO:teuthology.task.install:The correct ceph version 18.0.0-6612-g895e5ada-1jammy is installed. 2023-11-20T06:59:45.045 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-20T06:59:45.198 DEBUG:teuthology.orchestra.run.smithi175:> dpkg-query -W -f '${Version}' ceph 2023-11-20T06:59:45.221 INFO:teuthology.orchestra.run.smithi175.stdout:18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:59:45.221 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6612-g895e5ada-1jammy 2023-11-20T06:59:45.221 INFO:teuthology.task.install:The correct ceph version 18.0.0-6612-g895e5ada-1jammy is installed. 2023-11-20T06:59:45.221 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-20T06:59:45.222 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:59:45.222 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-20T06:59:45.244 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T06:59:45.244 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-20T06:59:45.285 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-20T06:59:45.285 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:59:45.285 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2023-11-20T06:59:45.306 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-20T06:59:45.370 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T06:59:45.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2023-11-20T06:59:45.390 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-20T06:59:45.456 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-20T06:59:45.456 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:59:45.457 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-20T06:59:45.478 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-20T06:59:45.546 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T06:59:45.546 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-20T06:59:45.566 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-20T06:59:45.627 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-20T06:59:45.627 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:59:45.627 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2023-11-20T06:59:45.649 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-20T06:59:45.710 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T06:59:45.710 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2023-11-20T06:59:45.730 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-20T06:59:45.791 INFO:teuthology.run_tasks:Running task ceph... 2023-11-20T06:59:46.031 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-20T06:59:46.032 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2023-11-20T06:59:46.036 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2023-11-20T06:59:46.055 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-20T06:59:46.055 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-20T06:59:46.105 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-20T06:59:46.124 INFO:tasks.ceph:Creating extra log directories... 2023-11-20T06:59:46.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-20T06:59:46.173 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-20T06:59:46.198 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-20T06:59:46.199 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-20T06:59:46.199 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-20T06:59:46.199 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:59:46.199 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-20T06:59:46.246 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-20T06:59:46.344 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T06:59:46.344 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-20T06:59:46.353 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-20T06:59:46.451 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-20T06:59:46.452 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-20T06:59:46.452 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037', 'branch': 'wip-57087-3', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7463037', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '7678e1afe51c4ac0c30e2c032e042c836160928a'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-57087-3'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-57087-3', 'sha1': 'dc2d87c1fc8f518422f0be9931df0b31dc6a3bad'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9639, 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-57087-3', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': 'dc2d87c1fc8f518422f0be9931df0b31dc6a3bad', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNzpL51gNqz4xUF966H1QvQlmp/+VMXN2RIlr8gUZDJyno4913EymWp34c045bEN3w/DhhH1V92xmMb/ODu7+3o=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHBmbQcfoU3kC5OuxqTXMlJhKGIZNquLGok3zXFwFEXkZ0hbRaPVhbglq261RhnLLHH/qK6ZOo1dnjrl+PqeFBc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '7678e1afe51c4ac0c30e2c032e042c836160928a'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-20_06:01:31', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-20T06:59:46.452 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-20T06:59:46.456 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-20T06:59:46.465 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2023-11-20T06:59:46.509 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2023-11-20T06:59:46.532 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:59:46.532 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2023-11-20T06:59:46.582 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-20T06:59:46.582 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2023-11-20T06:59:46.638 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-20T06:59:46.639 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:59:46.639 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 886 Links: 1 2023-11-20T06:59:46.639 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:59:46.639 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-11-20 06:53:29.956806003 +0000 2023-11-20T06:59:46.639 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-11-20 06:53:29.560809542 +0000 2023-11-20T06:59:46.639 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-11-20 06:53:29.560809542 +0000 2023-11-20T06:59:46.639 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-11-20 06:53:29.560809542 +0000 2023-11-20T06:59:46.639 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-20T06:59:46.701 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-11-20T06:59:46.701 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-11-20T06:59:46.701 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000381625 s, 1.3 MB/s 2023-11-20T06:59:46.703 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-20T06:59:46.756 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2023-11-20T06:59:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-20T06:59:46.810 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:59:46.811 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 904 Links: 1 2023-11-20T06:59:46.811 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:59:46.811 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-11-20 06:53:30.608800175 +0000 2023-11-20T06:59:46.811 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-11-20 06:53:30.232803536 +0000 2023-11-20T06:59:46.811 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-11-20 06:53:30.232803536 +0000 2023-11-20T06:59:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-11-20 06:53:30.232803536 +0000 2023-11-20T06:59:46.811 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-20T06:59:46.873 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-11-20T06:59:46.873 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-11-20T06:59:46.873 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.00041429 s, 1.2 MB/s 2023-11-20T06:59:46.877 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-20T06:59:46.928 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2023-11-20T06:59:46.978 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-20T06:59:46.979 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:59:46.979 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 922 Links: 1 2023-11-20T06:59:46.979 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:59:46.979 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-11-20 06:53:31.284794133 +0000 2023-11-20T06:59:46.979 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-11-20 06:53:30.900797564 +0000 2023-11-20T06:59:46.979 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-11-20 06:53:30.900797564 +0000 2023-11-20T06:59:46.979 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-11-20 06:53:30.900797564 +0000 2023-11-20T06:59:46.979 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-20T06:59:47.045 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-11-20T06:59:47.046 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-11-20T06:59:47.046 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000387862 s, 1.3 MB/s 2023-11-20T06:59:47.047 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-20T06:59:47.101 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2023-11-20T06:59:47.150 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-20T06:59:47.150 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:59:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 939 Links: 1 2023-11-20T06:59:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:59:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-11-20 06:53:31.936788305 +0000 2023-11-20T06:59:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-11-20 06:53:31.552791738 +0000 2023-11-20T06:59:47.151 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-11-20 06:53:31.552791738 +0000 2023-11-20T06:59:47.151 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-11-20 06:53:31.552791738 +0000 2023-11-20T06:59:47.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-20T06:59:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-11-20T06:59:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-11-20T06:59:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000398244 s, 1.3 MB/s 2023-11-20T06:59:47.220 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-20T06:59:47.276 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-20T06:59:47.277 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T06:59:47.277 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2023-11-20T06:59:47.287 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-20T06:59:47.287 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2023-11-20T06:59:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-20T06:59:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:59:47.342 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 891 Links: 1 2023-11-20T06:59:47.342 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:59:47.342 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-11-20 06:53:11.847618759 +0000 2023-11-20T06:59:47.342 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-11-20 06:53:11.475622081 +0000 2023-11-20T06:59:47.342 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-11-20 06:53:11.475622081 +0000 2023-11-20T06:59:47.342 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2023-11-20 06:53:11.475622081 +0000 2023-11-20T06:59:47.343 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-20T06:59:47.408 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-11-20T06:59:47.408 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-11-20T06:59:47.408 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000384063 s, 1.3 MB/s 2023-11-20T06:59:47.410 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-20T06:59:47.464 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2023-11-20T06:59:47.518 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-20T06:59:47.518 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:59:47.518 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 909 Links: 1 2023-11-20T06:59:47.518 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:59:47.518 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-11-20 06:53:12.123616293 +0000 2023-11-20T06:59:47.518 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-11-20 06:53:12.115616365 +0000 2023-11-20T06:59:47.518 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-11-20 06:53:12.115616365 +0000 2023-11-20T06:59:47.518 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2023-11-20 06:53:12.115616365 +0000 2023-11-20T06:59:47.519 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-20T06:59:47.580 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-11-20T06:59:47.580 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-11-20T06:59:47.580 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000385651 s, 1.3 MB/s 2023-11-20T06:59:47.582 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-20T06:59:47.635 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2023-11-20T06:59:47.685 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-20T06:59:47.685 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:59:47.685 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 924 Links: 1 2023-11-20T06:59:47.686 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:59:47.686 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-11-20 06:53:13.139607217 +0000 2023-11-20T06:59:47.686 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-11-20 06:53:12.759610612 +0000 2023-11-20T06:59:47.686 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-11-20 06:53:12.759610612 +0000 2023-11-20T06:59:47.686 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2023-11-20 06:53:12.759610612 +0000 2023-11-20T06:59:47.686 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-20T06:59:47.747 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-11-20T06:59:47.748 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-11-20T06:59:47.748 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000381219 s, 1.3 MB/s 2023-11-20T06:59:47.750 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-20T06:59:47.807 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2023-11-20T06:59:47.858 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-20T06:59:47.858 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-20T06:59:47.858 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 940 Links: 1 2023-11-20T06:59:47.858 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-20T06:59:47.858 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-11-20 06:53:13.395604930 +0000 2023-11-20T06:59:47.859 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-11-20 06:53:13.391604966 +0000 2023-11-20T06:59:47.859 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-11-20 06:53:13.391604966 +0000 2023-11-20T06:59:47.859 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2023-11-20 06:53:13.391604966 +0000 2023-11-20T06:59:47.859 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-20T06:59:47.920 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-11-20T06:59:47.920 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-11-20T06:59:47.920 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000399811 s, 1.3 MB/s 2023-11-20T06:59:47.922 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-20T06:59:47.979 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-20T06:59:47.979 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-20T06:59:47.979 INFO:tasks.ceph:Generating config... 2023-11-20T06:59:47.998 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-20T06:59:47.998 INFO:tasks.ceph:[client] debug client = 20 2023-11-20T06:59:47.998 INFO:tasks.ceph:[client] debug ms = 1 2023-11-20T06:59:47.998 INFO:tasks.ceph:[client] pid file = 2023-11-20T06:59:47.998 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-20T06:59:47.998 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-20T06:59:47.998 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-20T06:59:47.998 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-20T06:59:47.998 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-20T06:59:47.998 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-20T06:59:47.998 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-20T06:59:47.999 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-20T06:59:47.999 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-20T06:59:47.999 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-20T06:59:47.999 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-20T06:59:47.999 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-20T06:59:47.999 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-20T06:59:47.999 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-20T06:59:47.999 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-20T06:59:47.999 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-20T06:59:47.999 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-20T06:59:47.999 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-20T06:59:47.999 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-20T06:59:47.999 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-20T06:59:48.000 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-11-20T06:59:48.000 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-11-20T06:59:48.000 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-20T06:59:48.000 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-20T06:59:48.000 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-11-20T06:59:48.000 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-20T06:59:48.000 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-20T06:59:48.000 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-20T06:59:48.000 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-20T06:59:48.000 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-20T06:59:48.000 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-20T06:59:48.000 INFO:tasks.ceph:Setting up mon.a... 2023-11-20T06:59:48.001 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-20T06:59:48.048 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2023-11-20T06:59:48.067 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-20T06:59:48.116 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-20T06:59:48.137 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.b', '172.21.15.175'), ('mon.c', '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]')] 2023-11-20T06:59:48.137 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.88,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-20T06:59:48.138 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:59:48.138 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-20T06:59:48.190 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.88 --add b 172.21.15.175 --addv c '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:59:48.284 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:59:48.284 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid 81254148-3aea-4f86-927e-f8c4e1bfa591 2023-11-20T06:59:48.284 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = pacific 2023-11-20T06:59:48.284 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2023-11-20T06:59:48.284 INFO:teuthology.orchestra.run.smithi088.stdout:fsid 81254148-3aea-4f86-927e-f8c4e1bfa591 2023-11-20T06:59:48.284 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2023-11-20T06:59:48.285141+0000 2023-11-20T06:59:48.285 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-11-20T06:59:48.285141+0000 2023-11-20T06:59:48.285 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 16 (pacific) 2023-11-20T06:59:48.285 INFO:teuthology.orchestra.run.smithi088.stdout:election_strategy: 1 2023-11-20T06:59:48.285 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2023-11-20T06:59:48.285 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.b 2023-11-20T06:59:48.285 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] mon.c 2023-11-20T06:59:48.285 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-20T06:59:48.287 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-20T06:59:48.295 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 81254148-3aea-4f86-927e-f8c4e1bfa591... 2023-11-20T06:59:48.296 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-20T06:59:48.344 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-20T06:59:48.385 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2023-11-20T06:59:48.385 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2023-11-20T06:59:48.385 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-20T06:59:48.385 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2023-11-20T06:59:48.386 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.386 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2023-11-20T06:59:48.386 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.386 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2023-11-20T06:59:48.386 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.386 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2023-11-20T06:59:48.386 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2023-11-20T06:59:48.386 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.386 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2023-11-20T06:59:48.387 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2023-11-20T06:59:48.387 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.387 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-20T06:59:48.387 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2023-11-20T06:59:48.387 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.387 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2023-11-20T06:59:48.387 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-20T06:59:48.387 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.387 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2023-11-20T06:59:48.387 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.388 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2023-11-20T06:59:48.388 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2023-11-20T06:59:48.388 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2023-11-20T06:59:48.388 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2023-11-20T06:59:48.388 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2023-11-20T06:59:48.388 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2023-11-20T06:59:48.388 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2023-11-20T06:59:48.388 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-20T06:59:48.388 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-20T06:59:48.388 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2023-11-20T06:59:48.388 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.389 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-20T06:59:48.389 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.389 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2023-11-20T06:59:48.389 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.389 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2023-11-20T06:59:48.389 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.389 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2023-11-20T06:59:48.389 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2023-11-20T06:59:48.389 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2023-11-20T06:59:48.389 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2023-11-20T06:59:48.390 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 81254148-3aea-4f86-927e-f8c4e1bfa591 2023-11-20T06:59:48.390 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.390 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2023-11-20T06:59:48.390 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2023-11-20T06:59:48.390 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.390 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2023-11-20T06:59:48.390 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2023-11-20T06:59:48.390 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2023-11-20T06:59:48.390 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.390 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2023-11-20T06:59:48.391 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2023-11-20T06:59:48.391 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.391 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2023-11-20T06:59:48.391 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2023-11-20T06:59:48.391 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2023-11-20T06:59:48.391 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.391 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2023-11-20T06:59:48.391 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2023-11-20T06:59:48.391 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.391 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2023-11-20T06:59:48.392 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.392 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2023-11-20T06:59:48.392 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.392 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2023-11-20T06:59:48.392 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.392 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2023-11-20T06:59:48.392 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2023-11-20T06:59:48.392 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.393 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2023-11-20T06:59:48.393 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2023-11-20T06:59:48.393 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2023-11-20T06:59:48.393 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2023-11-20T06:59:48.393 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 20 2023-11-20T06:59:48.393 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 20 2023-11-20T06:59:48.393 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-11-20T06:59:48.393 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2023-11-20T06:59:48.393 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 10 2023-11-20T06:59:48.394 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2023-11-20T06:59:48.394 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2023-11-20T06:59:48.394 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2023-11-20T06:59:48.394 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2023-11-20T06:59:48.394 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2023-11-20T06:59:48.394 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-11-20T06:59:48.394 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.394 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2023-11-20T06:59:48.394 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-11-20T06:59:48.394 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2023-11-20T06:59:48.395 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-11-20T06:59:48.395 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-11-20T06:59:48.395 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-11-20T06:59:48.395 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-11-20T06:59:48.395 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2023-11-20T06:59:48.395 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.395 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2023-11-20T06:59:48.395 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-11-20T06:59:48.395 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-11-20T06:59:48.395 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2023-11-20T06:59:48.395 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-11-20T06:59:48.396 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2023-11-20T06:59:48.396 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2023-11-20T06:59:48.396 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-11-20T06:59:48.396 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2023-11-20T06:59:48.396 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2023-11-20T06:59:48.396 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-11-20T06:59:48.396 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.396 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-20T06:59:48.396 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2023-11-20T06:59:48.396 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2023-11-20T06:59:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2023-11-20T06:59:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-20T06:59:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-20T06:59:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2023-11-20T06:59:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2023-11-20T06:59:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2023-11-20T06:59:48.397 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2023-11-20T06:59:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T06:59:48.398 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2023-11-20T06:59:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2023-11-20T06:59:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2023-11-20T06:59:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2023-11-20T06:59:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-20T06:59:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-20T06:59:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2023-11-20T06:59:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2023-11-20T06:59:48.398 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-11-20T06:59:48.399 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = "" 2023-11-20T06:59:48.399 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-11-20T06:59:48.399 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-11-20T06:59:48.399 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2023-11-20T06:59:48.399 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2023-11-20T06:59:48.399 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2023-11-20T06:59:48.399 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-11-20T06:59:48.399 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-11-20T06:59:48.399 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-11-20T06:59:48.399 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2023-11-20T06:59:48.399 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2023-11-20T06:59:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2023-11-20T06:59:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds balancer = 20 2023-11-20T06:59:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-11-20T06:59:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2023-11-20T06:59:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2023-11-20T06:59:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2023-11-20T06:59:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2023-11-20T06:59:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-11-20T06:59:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-11-20T06:59:48.400 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-11-20T06:59:48.401 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2023-11-20T06:59:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2023-11-20T06:59:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-20T06:59:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2023-11-20T06:59:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2023-11-20T06:59:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2023-11-20T06:59:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2023-11-20T06:59:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2023-11-20T06:59:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2023-11-20T06:59:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2023-11-20T06:59:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-20T06:59:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2023-11-20T06:59:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2023-11-20T06:59:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-20T06:59:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2023-11-20T06:59:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2023-11-20T06:59:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2023-11-20T06:59:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2023-11-20T06:59:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2023-11-20T06:59:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2023-11-20T06:59:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2023-11-20T06:59:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2023-11-20T06:59:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-20T06:59:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-20T06:59:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2023-11-20T06:59:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-20T06:59:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2023-11-20T06:59:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2023-11-20T06:59:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2023-11-20T06:59:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2023-11-20T06:59:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2023-11-20T06:59:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.88,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2023-11-20T06:59:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 81254148-3aea-4f86-927e-f8c4e1bfa591 2023-11-20T06:59:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.406 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2023-11-20T06:59:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2023-11-20T06:59:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2023-11-20T06:59:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2023-11-20T06:59:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2023-11-20T06:59:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2023-11-20T06:59:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2023-11-20T06:59:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2023-11-20T06:59:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2023-11-20T06:59:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2023-11-20T06:59:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2023-11-20T06:59:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2023-11-20T06:59:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2023-11-20T06:59:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2023-11-20T06:59:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2023-11-20T06:59:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2023-11-20T06:59:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2023-11-20T06:59:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2023-11-20T06:59:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2023-11-20T06:59:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2023-11-20T06:59:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2023-11-20T06:59:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 20 2023-11-20T06:59:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 20 2023-11-20T06:59:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-11-20T06:59:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2023-11-20T06:59:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 10 2023-11-20T06:59:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2023-11-20T06:59:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2023-11-20T06:59:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2023-11-20T06:59:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2023-11-20T06:59:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2023-11-20T06:59:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2023-11-20T06:59:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.410 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2023-11-20T06:59:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-11-20T06:59:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2023-11-20T06:59:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2023-11-20T06:59:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2023-11-20T06:59:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2023-11-20T06:59:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2023-11-20T06:59:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2023-11-20T06:59:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.411 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2023-11-20T06:59:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-11-20T06:59:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2023-11-20T06:59:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2023-11-20T06:59:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2023-11-20T06:59:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2023-11-20T06:59:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2023-11-20T06:59:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2023-11-20T06:59:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2023-11-20T06:59:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2023-11-20T06:59:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2023-11-20T06:59:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-20T06:59:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2023-11-20T06:59:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2023-11-20T06:59:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2023-11-20T06:59:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-20T06:59:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-20T06:59:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2023-11-20T06:59:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2023-11-20T06:59:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2023-11-20T06:59:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2023-11-20T06:59:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-20T06:59:48.413 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2023-11-20T06:59:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2023-11-20T06:59:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2023-11-20T06:59:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2023-11-20T06:59:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-20T06:59:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-20T06:59:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2023-11-20T06:59:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2023-11-20T06:59:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-11-20T06:59:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = "" 2023-11-20T06:59:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2023-11-20T06:59:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2023-11-20T06:59:48.415 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2023-11-20T06:59:48.415 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2023-11-20T06:59:48.415 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2023-11-20T06:59:48.415 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2023-11-20T06:59:48.415 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2023-11-20T06:59:48.415 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2023-11-20T06:59:48.415 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2023-11-20T06:59:48.415 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2023-11-20T06:59:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2023-11-20T06:59:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2023-11-20T06:59:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-11-20T06:59:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2023-11-20T06:59:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2023-11-20T06:59:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2023-11-20T06:59:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2023-11-20T06:59:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2023-11-20T06:59:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2023-11-20T06:59:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2023-11-20T06:59:48.418 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-20T06:59:48.418 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-20T06:59:48.518 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-20T06:59:48.518 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:59:48.518 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-20T06:59:48.527 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:59:48.528 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-20T06:59:48.577 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T06:59:48.578 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:59:48.578 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-20T06:59:48.578 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-20T06:59:48.657 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T06:59:48.657 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:59:48.706 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T06:59:48.706 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T06:59:48.706 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-20T06:59:48.706 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-20T06:59:48.744 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T06:59:48.744 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:59:48.793 INFO:tasks.ceph:Setting up mon nodes... 2023-11-20T06:59:48.793 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-20T06:59:48.794 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-20T06:59:48.848 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-20T06:59:48.853 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-20T06:59:48.914 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-20T06:59:48.931 INFO:tasks.ceph:Setting up mds nodes... 2023-11-20T06:59:48.932 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-20T06:59:48.990 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-20T06:59:48.994 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-20T06:59:49.015 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-20T06:59:49.116 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-20T06:59:49.121 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-20T06:59:49.142 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-20T06:59:49.201 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-20T06:59:49.206 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-20T06:59:49.227 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-20T06:59:49.324 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-20T06:59:49.328 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-20T06:59:49.348 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-20T06:59:49.349 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-20T06:59:49.391 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-20T06:59:49.409 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-20T06:59:49.495 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-20T06:59:49.512 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-20T06:59:49.556 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-20T06:59:49.572 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-20T06:59:49.659 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-20T06:59:49.676 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-20T06:59:49.677 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-20T06:59:49.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-20T06:59:49.697 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-20T06:59:49.697 INFO:tasks.ceph:role: osd.0 2023-11-20T06:59:49.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T06:59:49.698 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-20T06:59:49.769 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T06:59:49.769 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T06:59:49.769 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T06:59:49.769 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T06:59:49.769 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T06:59:49.770 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-11-20T06:59:49.770 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T06:59:49.770 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T06:59:49.770 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T06:59:49.770 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T06:59:50.217 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-11-20T06:59:50.220 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-11-20T06:59:50.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-20T06:59:50.322 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-20T06:59:50.339 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T06:59:50.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:59:50.340 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-20T06:59:50.401 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-20T06:59:50.401 INFO:tasks.ceph:role: osd.1 2023-11-20T06:59:50.401 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T06:59:50.401 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-20T06:59:50.468 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T06:59:50.468 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T06:59:50.469 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T06:59:50.469 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T06:59:50.469 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T06:59:50.469 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-11-20T06:59:50.469 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T06:59:50.469 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T06:59:50.469 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T06:59:50.469 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T06:59:50.934 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-11-20T06:59:50.937 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-11-20T06:59:50.937 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-20T06:59:51.073 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-20T06:59:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T06:59:51.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:59:51.091 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-20T06:59:51.157 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-20T06:59:51.157 INFO:tasks.ceph:role: osd.2 2023-11-20T06:59:51.157 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T06:59:51.157 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-20T06:59:51.224 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T06:59:51.225 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T06:59:51.225 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T06:59:51.225 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T06:59:51.225 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T06:59:51.225 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-11-20T06:59:51.225 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T06:59:51.225 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T06:59:51.225 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T06:59:51.225 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T06:59:51.683 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-11-20T06:59:51.686 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-11-20T06:59:51.686 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-20T06:59:51.828 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-20T06:59:51.845 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T06:59:51.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:59:51.846 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-20T06:59:51.914 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-20T06:59:51.915 INFO:tasks.ceph:role: osd.3 2023-11-20T06:59:51.915 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T06:59:51.915 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-20T06:59:51.986 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T06:59:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T06:59:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T06:59:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T06:59:51.986 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T06:59:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-11-20T06:59:51.986 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T06:59:51.986 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T06:59:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T06:59:51.986 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T06:59:52.416 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-11-20T06:59:52.419 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-11-20T06:59:52.420 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-20T06:59:52.528 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-20T06:59:52.545 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T06:59:52.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T06:59:52.547 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:59:52.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:52.666+0000 7f45d3095640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-20T06:59:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:52.666+0000 7f45d3095640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-20T06:59:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:52.666+0000 7f45d3095640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-20T06:59:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:52.670+0000 7f45d3095640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-20T06:59:52.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:52.670+0000 7f45d3095640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-20T06:59:52.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:52.678+0000 7f45d3095640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-20T06:59:55.669 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-20T06:59:55.691 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:59:55.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:55.790+0000 7f873742b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-20T06:59:55.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:55.790+0000 7f873742b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-20T06:59:55.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:55.790+0000 7f873742b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-20T06:59:55.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:55.790+0000 7f873742b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-20T06:59:55.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:55.790+0000 7f873742b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-20T06:59:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:55.790+0000 7f873742b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-20T06:59:58.772 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-20T06:59:58.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T06:59:58.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:58.890+0000 7f9eea869640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-20T06:59:58.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:58.890+0000 7f9eea869640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-20T06:59:58.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:58.890+0000 7f9eea869640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-20T06:59:58.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:58.890+0000 7f9eea869640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-20T06:59:58.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:58.890+0000 7f9eea869640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-20T06:59:58.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T06:59:58.894+0000 7f9eea869640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-20T07:00:01.876 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-20T07:00:01.897 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T07:00:01.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:01.994+0000 7f3883efb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-20T07:00:01.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:01.994+0000 7f3883efb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-20T07:00:01.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:01.994+0000 7f3883efb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-20T07:00:01.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:01.994+0000 7f3883efb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-20T07:00:01.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:01.994+0000 7f3883efb640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-20T07:00:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:01.994+0000 7f3883efb640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-20T07:00:04.980 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-20T07:00:05.002 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-20T07:00:05.025 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-20T07:00:05.025 INFO:tasks.ceph:role: osd.4 2023-11-20T07:00:05.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:00:05.025 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-20T07:00:05.098 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T07:00:05.098 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T07:00:05.098 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T07:00:05.098 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T07:00:05.098 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T07:00:05.098 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-11-20T07:00:05.098 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T07:00:05.098 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T07:00:05.098 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T07:00:05.098 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T07:00:05.555 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-11-20T07:00:05.558 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-11-20T07:00:05.558 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-20T07:00:05.666 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-20T07:00:05.684 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T07:00:05.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T07:00:05.685 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-20T07:00:05.754 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-20T07:00:05.754 INFO:tasks.ceph:role: osd.5 2023-11-20T07:00:05.754 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:00:05.754 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-20T07:00:05.825 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T07:00:05.825 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T07:00:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T07:00:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T07:00:05.826 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T07:00:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-11-20T07:00:05.826 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T07:00:05.826 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T07:00:05.826 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T07:00:05.826 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T07:00:06.318 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-11-20T07:00:06.321 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-11-20T07:00:06.321 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-20T07:00:06.487 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-20T07:00:06.505 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T07:00:06.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T07:00:06.506 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-20T07:00:06.574 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-20T07:00:06.574 INFO:tasks.ceph:role: osd.6 2023-11-20T07:00:06.574 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:00:06.574 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-20T07:00:06.646 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T07:00:06.646 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T07:00:06.646 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T07:00:06.646 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T07:00:06.646 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T07:00:06.646 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-11-20T07:00:06.647 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T07:00:06.647 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T07:00:06.647 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T07:00:06.647 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T07:00:07.126 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-11-20T07:00:07.128 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-11-20T07:00:07.128 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-20T07:00:07.227 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-20T07:00:07.244 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T07:00:07.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T07:00:07.246 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-20T07:00:07.313 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-20T07:00:07.313 INFO:tasks.ceph:role: osd.7 2023-11-20T07:00:07.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:00:07.313 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-20T07:00:07.385 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-20T07:00:07.385 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-20T07:00:07.385 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-20T07:00:07.385 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-20T07:00:07.385 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-20T07:00:07.385 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-11-20T07:00:07.386 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-20T07:00:07.386 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-20T07:00:07.386 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-20T07:00:07.386 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-20T07:00:07.845 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-11-20T07:00:07.848 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-11-20T07:00:07.848 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-20T07:00:07.956 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-20T07:00:07.972 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2023-11-20T07:00:07.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T07:00:07.973 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T07:00:08.112 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:08.111+0000 7fc075ce6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-20T07:00:08.119 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:08.119+0000 7fc075ce6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-20T07:00:08.119 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:08.119+0000 7fc075ce6640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-20T07:00:08.119 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:08.119+0000 7fc075ce6640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-20T07:00:08.119 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:08.119+0000 7fc075ce6640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-20T07:00:08.122 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:08.123+0000 7fc075ce6640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-20T07:00:11.116 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-20T07:00:11.137 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T07:00:11.235 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:11.235+0000 7fb857fd3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-20T07:00:11.236 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:11.235+0000 7fb857fd3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-20T07:00:11.236 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:11.235+0000 7fb857fd3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-20T07:00:11.237 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:11.235+0000 7fb857fd3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-20T07:00:11.237 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:11.235+0000 7fb857fd3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-20T07:00:11.238 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:11.239+0000 7fb857fd3640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-20T07:00:14.216 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-20T07:00:14.237 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T07:00:14.345 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:14.347+0000 7fee6eed6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-20T07:00:14.346 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:14.347+0000 7fee6eed6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-20T07:00:14.346 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:14.347+0000 7fee6eed6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-20T07:00:14.346 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:14.347+0000 7fee6eed6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-20T07:00:14.346 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:14.347+0000 7fee6eed6640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-20T07:00:14.347 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:14.347+0000 7fee6eed6640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-20T07:00:16.454 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:00:16.458 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:00:17.347 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-20T07:00:17.368 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-20T07:00:17.466 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:17.467+0000 7f5133543640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-20T07:00:17.468 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:17.467+0000 7f5133543640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-20T07:00:17.468 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:17.467+0000 7f5133543640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-20T07:00:17.468 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:17.467+0000 7f5133543640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-20T07:00:17.468 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:17.467+0000 7f5133543640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-20T07:00:17.469 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:17.471+0000 7f5133543640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-20T07:00:20.468 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-20T07:00:20.490 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-20T07:00:20.490 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:20.491 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-20T07:00:20.515 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:20.515 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-20T07:00:20.578 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:20.578 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-20T07:00:20.642 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:20.642 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-20T07:00:20.706 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:20.706 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-20T07:00:20.770 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:20.770 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-20T07:00:20.833 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:20.833 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-20T07:00:20.901 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:20.901 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-20T07:00:20.924 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:20.924 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-20T07:00:20.985 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:20.986 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-20T07:00:21.050 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:21.050 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-20T07:00:21.113 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:21.113 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-20T07:00:21.177 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:21.177 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-20T07:00:21.241 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:21.242 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-20T07:00:21.305 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:21.305 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-20T07:00:21.315 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:21.315 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-20T07:00:21.366 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:21.366 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-20T07:00:21.375 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:21.375 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-20T07:00:21.425 INFO:tasks.ceph:Adding keys to all mons... 2023-11-20T07:00:21.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-20T07:00:21.429 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-20T07:00:21.472 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2023-11-20T07:00:21.472 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDkA1tlZzunMhAA6Df88OUJQTIAvDGgyi0LFg== 2023-11-20T07:00:21.473 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-11-20T07:00:21.473 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDkA1tl/y0WOxAAdq5wTKyfuOxiZ6Q8ckw93w== 2023-11-20T07:00:21.473 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-11-20T07:00:21.473 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDlA1tltEAEBxAAHgggAANkIKo2R8P4jjPrLw== 2023-11-20T07:00:21.473 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2023-11-20T07:00:21.473 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDoA1tlezLgJxAASzvc82a86q2qZrMdetIz3A== 2023-11-20T07:00:21.473 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2023-11-20T07:00:21.473 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDrA1tly9Y+LxAAthOefOOSsuhlefFMvvDWeg== 2023-11-20T07:00:21.473 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2023-11-20T07:00:21.474 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDuA1tl2Zc8NRAAx057Q19yRux8JAHdeuzKew== 2023-11-20T07:00:21.474 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2023-11-20T07:00:21.474 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDxA1tlxXhbOxAAVexn3zBZ1Oqf7J+WOEZUYA== 2023-11-20T07:00:21.474 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2023-11-20T07:00:21.474 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDkA1tlbeSlNhAA3Radpg9vlQ2jD1ES/Blvgg== 2023-11-20T07:00:21.474 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-11-20T07:00:21.474 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDlA1tlf+srDBAAf//Tdho9hIGFQtFDpTo0SQ== 2023-11-20T07:00:21.474 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2023-11-20T07:00:21.474 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDlA1tlsOl+ExAADfD3GbTACjZ6Ha8LJ8o9CQ== 2023-11-20T07:00:21.474 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2023-11-20T07:00:21.474 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQD4A1tlLWrfBhAA1QmzT7o5CzQeEvyr/ywVTg== 2023-11-20T07:00:21.474 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2023-11-20T07:00:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQD7A1tlGZo3DhAAHB9bpcv5h2QVXOUbUUVi1Q== 2023-11-20T07:00:21.475 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2023-11-20T07:00:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQD+A1tlDXy/FBAA0Fj7D0H48hgjb1yoQW6tKA== 2023-11-20T07:00:21.475 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2023-11-20T07:00:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQABBFtlZJH2GxAA4orHS1ptWdKZVkrzdRT3sg== 2023-11-20T07:00:21.475 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-11-20T07:00:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDlA1tlJRZoFxAAjx3lxpd5CSyg4vcDb18mMQ== 2023-11-20T07:00:21.475 INFO:teuthology.orchestra.run.smithi088.stdout:[client.2] 2023-11-20T07:00:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDlA1tlqdGfHRAAA14f+qcizfbitieltn5MPQ== 2023-11-20T07:00:21.475 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2023-11-20T07:00:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDlA1tlmFBNIRAAG3PLBIcfXgYsdDDiPyVHhg== 2023-11-20T07:00:21.476 INFO:teuthology.orchestra.run.smithi088.stdout:[client.3] 2023-11-20T07:00:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDlA1tlSkd5JxAAA8WgMlLOvlnG/dIdBPkngA== 2023-11-20T07:00:21.487 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2023-11-20T07:00:21.487 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDkA1tlZzunMhAA6Df88OUJQTIAvDGgyi0LFg== 2023-11-20T07:00:21.487 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2023-11-20T07:00:21.487 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDkA1tl/y0WOxAAdq5wTKyfuOxiZ6Q8ckw93w== 2023-11-20T07:00:21.487 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2023-11-20T07:00:21.488 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDlA1tltEAEBxAAHgggAANkIKo2R8P4jjPrLw== 2023-11-20T07:00:21.488 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2023-11-20T07:00:21.488 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDoA1tlezLgJxAASzvc82a86q2qZrMdetIz3A== 2023-11-20T07:00:21.488 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2023-11-20T07:00:21.488 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDrA1tly9Y+LxAAthOefOOSsuhlefFMvvDWeg== 2023-11-20T07:00:21.488 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2023-11-20T07:00:21.488 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDuA1tl2Zc8NRAAx057Q19yRux8JAHdeuzKew== 2023-11-20T07:00:21.488 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2023-11-20T07:00:21.488 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDxA1tlxXhbOxAAVexn3zBZ1Oqf7J+WOEZUYA== 2023-11-20T07:00:21.488 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2023-11-20T07:00:21.488 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDkA1tlbeSlNhAA3Radpg9vlQ2jD1ES/Blvgg== 2023-11-20T07:00:21.488 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDlA1tlf+srDBAAf//Tdho9hIGFQtFDpTo0SQ== 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDlA1tlsOl+ExAADfD3GbTACjZ6Ha8LJ8o9CQ== 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQD4A1tlLWrfBhAA1QmzT7o5CzQeEvyr/ywVTg== 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQD7A1tlGZo3DhAAHB9bpcv5h2QVXOUbUUVi1Q== 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQD+A1tlDXy/FBAA0Fj7D0H48hgjb1yoQW6tKA== 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQABBFtlZJH2GxAA4orHS1ptWdKZVkrzdRT3sg== 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2023-11-20T07:00:21.489 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDlA1tlJRZoFxAAjx3lxpd5CSyg4vcDb18mMQ== 2023-11-20T07:00:21.490 INFO:teuthology.orchestra.run.smithi175.stdout:[client.2] 2023-11-20T07:00:21.490 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDlA1tlqdGfHRAAA14f+qcizfbitieltn5MPQ== 2023-11-20T07:00:21.490 INFO:teuthology.orchestra.run.smithi175.stdout:[client.1] 2023-11-20T07:00:21.490 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDlA1tlmFBNIRAAG3PLBIcfXgYsdDDiPyVHhg== 2023-11-20T07:00:21.490 INFO:teuthology.orchestra.run.smithi175.stdout:[client.3] 2023-11-20T07:00:21.490 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDlA1tlSkd5JxAAA8WgMlLOvlnG/dIdBPkngA== 2023-11-20T07:00:21.491 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-20T07:00:21.520 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-20T07:00:21.595 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T07:00:21.599 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T07:00:21.660 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T07:00:21.663 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T07:00:21.722 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:21.725 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:21.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:21.783 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:21.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:21.840 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:21.895 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:21.898 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:21.952 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-20T07:00:21.956 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-20T07:00:22.010 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T07:00:22.014 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T07:00:22.072 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T07:00:22.076 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-20T07:00:22.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:22.137 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:22.191 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:22.194 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:22.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:22.253 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:22.307 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:22.310 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-20T07:00:22.364 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T07:00:22.368 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T07:00:22.426 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T07:00:22.429 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T07:00:22.486 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T07:00:22.490 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T07:00:22.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T07:00:22.552 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-20T07:00:22.609 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-20T07:00:22.609 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-20T07:00:22.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-20T07:00:22.746 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-20T07:00:22.767 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-20T07:00:22.787 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-20T07:00:22.900 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-20T07:00:22.920 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-20T07:00:22.979 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-20T07:00:23.094 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-20T07:00:23.115 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-20T07:00:23.118 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-20T07:00:23.168 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-20T07:00:23.168 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-20T07:00:23.168 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-20T07:00:23.172 INFO:tasks.ceph.mon.a:Started 2023-11-20T07:00:23.172 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-20T07:00:23.172 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-20T07:00:23.215 INFO:tasks.ceph.mon.b:Started 2023-11-20T07:00:23.215 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-20T07:00:23.215 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-20T07:00:23.220 INFO:tasks.ceph.mon.c:Started 2023-11-20T07:00:23.220 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-20T07:00:23.220 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-20T07:00:23.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-20T07:00:23.224 INFO:tasks.ceph.mgr.y:Started 2023-11-20T07:00:23.224 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-20T07:00:23.224 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-20T07:00:23.227 INFO:tasks.ceph.mgr.x:Started 2023-11-20T07:00:23.227 INFO:tasks.ceph:Setting crush tunables to default 2023-11-20T07:00:23.228 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2023-11-20T07:00:23.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b9b0f640 1 Processor -- start 2023-11-20T07:00:23.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b9b0f640 1 -- start start 2023-11-20T07:00:23.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b9b0f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:23.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b9b0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:23.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b9b0f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:23.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b9b0f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b40cb090 con 0x7fc3b40702f0 2023-11-20T07:00:23.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b9b0f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b415ae30 con 0x7fc3b4069e90 2023-11-20T07:00:23.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b9b0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b40ca510 con 0x7fc3b406a270 2023-11-20T07:00:23.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:23.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52838/0 (socket says 172.21.15.88:52838) 2023-11-20T07:00:23.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b3fff640 1 -- 172.21.15.88:0/795312802 learned_addr learned my addr 172.21.15.88:0/795312802 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:23.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b3fff640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 msgr2=0x7fc3b4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-20T07:00:23.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b3fff640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 msgr2=0x7fc3b4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T07:00:23.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T07:00:23.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-20T07:00:23.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:23.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:23.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 msgr2=0x7fc3b40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-20T07:00:23.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 msgr2=0x7fc3b40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T07:00:23.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T07:00:23.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b37fe640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 msgr2=0x7fc3b406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-20T07:00:23.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b37fe640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 msgr2=0x7fc3b406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T07:00:23.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T07:00:23.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-20T07:00:23.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.366+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-20T07:00:23.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:23.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b3fff640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 msgr2=0x7fc3b4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-20T07:00:23.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b3fff640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 msgr2=0x7fc3b4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T07:00:23.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T07:00:23.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-20T07:00:23.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:23.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:23.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b37fe640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 msgr2=0x7fc3b406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-20T07:00:23.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b37fe640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 msgr2=0x7fc3b406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T07:00:23.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T07:00:23.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-20T07:00:23.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 msgr2=0x7fc3b40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-20T07:00:23.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 msgr2=0x7fc3b40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T07:00:23.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T07:00:23.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.570+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-20T07:00:23.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:23.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:23.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:23.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b3fff640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 msgr2=0x7fc3b4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-20T07:00:23.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b3fff640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 msgr2=0x7fc3b4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T07:00:23.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T07:00:23.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-20T07:00:23.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b37fe640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 msgr2=0x7fc3b406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-20T07:00:23.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b37fe640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 msgr2=0x7fc3b406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T07:00:23.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T07:00:23.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-20T07:00:23.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 msgr2=0x7fc3b40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-20T07:00:23.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 msgr2=0x7fc3b40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T07:00:23.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T07:00:23.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:23.974+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-20T07:00:24.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b3fff640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 msgr2=0x7fc3b4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b3fff640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 msgr2=0x7fc3b4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b37fe640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 msgr2=0x7fc3b406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b37fe640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 msgr2=0x7fc3b406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 msgr2=0x7fc3b40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 msgr2=0x7fc3b40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-20T07:00:24.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-20T07:00:24.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:24.778+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-20T07:00:26.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:26.366+0000 7fc3b17fa640 1 -- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 msgr2=0x7fc3b40c9ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-20T07:00:26.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:26.366+0000 7fc3b17fa640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3b406a270 0x7fc3b40c9ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:26.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:26.366+0000 7fc3b17fa640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 msgr2=0x7fc3b406d010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-20T07:00:26.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:26.366+0000 7fc3b17fa640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.175:3300/0 conn(0x7fc3b4069e90 0x7fc3b406d010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:26.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:26.366+0000 7fc3b17fa640 1 -- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 msgr2=0x7fc3b4070780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-20T07:00:26.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:26.366+0000 7fc3b17fa640 1 --2- 172.21.15.88:0/795312802 >> v2:172.21.15.88:3300/0 conn(0x7fc3b40702f0 0x7fc3b4070780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:26.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:26.366+0000 7fc3b17fa640 1 -- 172.21.15.88:0/795312802 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b40ca7f0 con 0x7fc39c007310 2023-11-20T07:00:26.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:26.366+0000 7fc3b17fa640 1 -- 172.21.15.88:0/795312802 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c00c080 con 0x7fc39c0036c0 2023-11-20T07:00:28.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.534+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152588968 0 0) 0x7fc3b40ca7f0 con 0x7fc39c007310 2023-11-20T07:00:28.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.534+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a0003530 con 0x7fc39c007310 2023-11-20T07:00:28.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588313764 0 0) 0x7fc39c00c080 con 0x7fc39c0036c0 2023-11-20T07:00:28.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3b40ca7f0 con 0x7fc39c0036c0 2023-11-20T07:00:28.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1577411982 0 0) 0x7fc3a0003530 con 0x7fc39c007310 2023-11-20T07:00:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 >> v1:172.21.15.175:6789/0 conn(0x7fc39c0036c0 legacy=0x7fc39c005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c00d2e0 con 0x7fc39c007310 2023-11-20T07:00:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fc3a800e510 con 0x7fc39c007310 2023-11-20T07:00:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 >> v1:172.21.15.88:6789/0 conn(0x7fc39c007310 legacy=0x7fc39c0097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b3fff640 1 -- 172.21.15.88:0/795312802 reap_dead start 2023-11-20T07:00:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a0003b90 0x7fc3a0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3a00047d0 0x7fc3a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a0009980 0x7fc3a000bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a000c2e0 con 0x7fc3a00047d0 2023-11-20T07:00:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a000c450 con 0x7fc3a0003b90 2023-11-20T07:00:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a0010a20 con 0x7fc3a0009980 2023-11-20T07:00:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a0003b90 0x7fc3a0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3a00047d0 0x7fc3a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a0009980 0x7fc3a000bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b37fe640 1 -- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a0009980 msgr2=0x7fc3a000bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a0009980 0x7fc3a000bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b37fe640 1 -- 172.21.15.88:0/795312802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3a00047d0 msgr2=0x7fc3a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3a00047d0 0x7fc3a0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.538+0000 7fc3b37fe640 1 -- 172.21.15.88:0/795312802 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a0003530 con 0x7fc3a0003b90 2023-11-20T07:00:28.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a0003b90 0x7fc3a0003f70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4000ee0 tx=0x7fc3a401d220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b03dd31694e649f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:28.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4004020 con 0x7fc3a0003b90 2023-11-20T07:00:28.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a40a8030 con 0x7fc3a0003b90 2023-11-20T07:00:28.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b27fc640 1 -- 172.21.15.88:0/795312802 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40043e0 con 0x7fc3a0003b90 2023-11-20T07:00:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a0003b90 msgr2=0x7fc3a0003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b9b0f640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a0003b90 0x7fc3a0003f70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4000ee0 tx=0x7fc3a401d220 comp rx=0 tx=0).stop 2023-11-20T07:00:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/795312802 shutdown_connections 2023-11-20T07:00:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b9b0f640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a0009980 0x7fc3a000bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b9b0f640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3a00047d0 0x7fc3a0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b9b0f640 1 --2- 172.21.15.88:0/795312802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a0003b90 0x7fc3a0003f70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/795312802 >> 172.21.15.88:0/795312802 conn(0x7fc3b40b0da0 msgr2=0x7fc3b40ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/795312802 shutdown_connections 2023-11-20T07:00:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.542+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/795312802 wait complete. 2023-11-20T07:00:28.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.546+0000 7fc3b9b0f640 1 Processor -- start 2023-11-20T07:00:28.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.546+0000 7fc3b9b0f640 1 -- start start 2023-11-20T07:00:28.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.546+0000 7fc3b9b0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a0003b90 0x7fc3b40c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:28.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.546+0000 7fc3b9b0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3a00047d0 0x7fc3b414bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:28.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.546+0000 7fc3b9b0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a0009980 0x7fc3b40c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:28.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.546+0000 7fc3b9b0f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b40c8780 con 0x7fc3a00047d0 2023-11-20T07:00:28.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.546+0000 7fc3b9b0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b40c84a0 con 0x7fc3a0009980 2023-11-20T07:00:28.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.546+0000 7fc3b9b0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b40c6b00 con 0x7fc3a0003b90 2023-11-20T07:00:28.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.546+0000 7fc3b2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3a00047d0 0x7fc3b414bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:28.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.546+0000 7fc3b2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3a00047d0 0x7fc3b414bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53044/0 (socket says 172.21.15.88:53044) 2023-11-20T07:00:28.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/3199394210 learned_addr learned my addr 172.21.15.88:0/3199394210 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:28.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/3199394210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a0009980 0x7fc3b40c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:28.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b37fe640 1 --2- 172.21.15.88:0/3199394210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a0003b90 0x7fc3b40c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:28.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/3199394210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a0003b90 msgr2=0x7fc3b40c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:28.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/3199394210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a0003b90 0x7fc3b40c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:28.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/3199394210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a0009980 msgr2=0x7fc3b40c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:28.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/3199394210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a0009980 0x7fc3b40c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:28.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b2ffd640 1 -- 172.21.15.88:0/3199394210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b40c6de0 con 0x7fc3a00047d0 2023-11-20T07:00:28.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b3fff640 1 --2- 172.21.15.88:0/3199394210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a0009980 0x7fc3b40c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:00:28.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b2ffd640 1 --2- 172.21.15.88:0/3199394210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3a00047d0 0x7fc3b414bd70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8000c10 tx=0x7fc3a8015730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:28.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc39bfff640 1 -- 172.21.15.88:0/3199394210 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8015ea0 con 0x7fc3a00047d0 2023-11-20T07:00:28.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/3199394210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b40c70c0 con 0x7fc3a00047d0 2023-11-20T07:00:28.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/3199394210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b4157d30 con 0x7fc3a00047d0 2023-11-20T07:00:28.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc39bfff640 1 -- 172.21.15.88:0/3199394210 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a800c040 con 0x7fc3a00047d0 2023-11-20T07:00:28.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc39bfff640 1 -- 172.21.15.88:0/3199394210 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8020660 con 0x7fc3a00047d0 2023-11-20T07:00:28.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc39bfff640 1 -- 172.21.15.88:0/3199394210 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc3a8020880 con 0x7fc3a00047d0 2023-11-20T07:00:28.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc39bfff640 1 -- 172.21.15.88:0/3199394210 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc3a8017be0 con 0x7fc3a00047d0 2023-11-20T07:00:28.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.550+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/3199394210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc394005260 con 0x7fc3a00047d0 2023-11-20T07:00:28.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.746+0000 7fc39bfff640 1 -- 172.21.15.88:0/3199394210 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc3a8025060 con 0x7fc3a00047d0 2023-11-20T07:00:28.775 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:28.775+0000 7f184f6db180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-20T07:00:28.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.810+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/3199394210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc3940057e0 con 0x7fc3a00047d0 2023-11-20T07:00:28.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.814+0000 7fc39bfff640 1 -- 172.21.15.88:0/3199394210 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc3a800f040 con 0x7fc3a00047d0 2023-11-20T07:00:28.816 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2023-11-20T07:00:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.814+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/3199394210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3a00047d0 msgr2=0x7fc3b414bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.814+0000 7fc3b9b0f640 1 --2- 172.21.15.88:0/3199394210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3a00047d0 0x7fc3b414bd70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8000c10 tx=0x7fc3a8015730 comp rx=0 tx=0).stop 2023-11-20T07:00:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.814+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/3199394210 shutdown_connections 2023-11-20T07:00:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.814+0000 7fc3b9b0f640 1 --2- 172.21.15.88:0/3199394210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a0009980 0x7fc3b40c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.814+0000 7fc3b9b0f640 1 --2- 172.21.15.88:0/3199394210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3a00047d0 0x7fc3b414bd70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.814+0000 7fc3b9b0f640 1 --2- 172.21.15.88:0/3199394210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3a0003b90 0x7fc3b40c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.814+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/3199394210 >> 172.21.15.88:0/3199394210 conn(0x7fc3b40b0da0 msgr2=0x7fc3b40c3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:28.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.814+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/3199394210 shutdown_connections 2023-11-20T07:00:28.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:28.814+0000 7fc3b9b0f640 1 -- 172.21.15.88:0/3199394210 wait complete. 2023-11-20T07:00:28.838 INFO:tasks.ceph:check_enable_crimson: False 2023-11-20T07:00:28.838 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-20T07:00:28.838 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:28.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-20T07:00:28.860 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:28.860 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-20T07:00:28.921 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:28.921 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-20T07:00:28.968 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:28.966+0000 7f86cc418180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-20T07:00:28.988 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:00:28.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-20T07:00:29.053 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:29.053 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-20T07:00:29.074 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:29.074 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-20T07:00:29.136 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:29.136 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-20T07:00:29.196 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:00:29.197 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-20T07:00:29.261 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 16d24238-148f-4be4-8aec-63faf7dbd418 0 2023-11-20T07:00:29.309 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:29.311+0000 7f184f6db180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-20T07:00:29.440 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.439+0000 7ffb9152a640 1 Processor -- start 2023-11-20T07:00:29.440 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.439+0000 7ffb9152a640 1 -- start start 2023-11-20T07:00:29.441 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.443+0000 7ffb9152a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffb8c0b84e0 0x7ffb8c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.441 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.443+0000 7ffb9152a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0d1670 con 0x7ffb8c15cba0 2023-11-20T07:00:29.441 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.443+0000 7ffb9152a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0d1950 con 0x7ffb8c0d0210 2023-11-20T07:00:29.441 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.443+0000 7ffb9152a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8c0d1460 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.441 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.443+0000 7ffb8a7fc640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ffb8c0d0210 0x7ffb8c0b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53164/0 (socket says 172.21.15.175:53164) 2023-11-20T07:00:29.442 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.443+0000 7ffb8a7fc640 1 -- 172.21.15.175:0/1553259089 learned_addr learned my addr 172.21.15.175:0/1553259089 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-11-20T07:00:29.442 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.443+0000 7ffb8b7fe640 1 --2- 172.21.15.175:0/1553259089 >> v2:172.21.15.88:3300/0 conn(0x7ffb8c0b84e0 0x7ffb8c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.442 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.443+0000 7ffb89ffb640 1 -- 172.21.15.175:0/1553259089 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331561061 0 0) 0x7ffb8c0d1950 con 0x7ffb8c0d0210 2023-11-20T07:00:29.442 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.443+0000 7ffb8b7fe640 1 -- 172.21.15.175:0/1553259089 >> v1:172.21.15.175:6789/0 conn(0x7ffb8c0d0210 legacy=0x7ffb8c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.442 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.443+0000 7ffb8b7fe640 1 -- 172.21.15.175:0/1553259089 >> v1:172.21.15.88:6789/0 conn(0x7ffb8c15cba0 legacy=0x7ffb8c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.442 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.443+0000 7ffb8b7fe640 1 -- 172.21.15.175:0/1553259089 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0d1c30 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.445 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb8b7fe640 1 --2- 172.21.15.175:0/1553259089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb8c0b84e0 0x7ffb8c0d0f20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009d90 tx=0x7ffb8401c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289bbac0ed956bbe server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:29.445 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb89ffb640 1 -- 172.21.15.175:0/1553259089 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840a5790 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.445 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb89ffb640 1 -- 172.21.15.175:0/1553259089 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb840a58f0 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.445 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb89ffb640 1 -- 172.21.15.175:0/1553259089 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840a5c80 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.446 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb9152a640 1 -- 172.21.15.175:0/1553259089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb8c0b84e0 msgr2=0x7ffb8c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.446 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb9152a640 1 --2- 172.21.15.175:0/1553259089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb8c0b84e0 0x7ffb8c0d0f20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb84009d90 tx=0x7ffb8401c750 comp rx=0 tx=0).stop 2023-11-20T07:00:29.446 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb9152a640 1 -- 172.21.15.175:0/1553259089 shutdown_connections 2023-11-20T07:00:29.446 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb9152a640 1 --2- 172.21.15.175:0/1553259089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb8c0b84e0 0x7ffb8c0d0f20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.446 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb9152a640 1 -- 172.21.15.175:0/1553259089 >> 172.21.15.175:0/1553259089 conn(0x7ffb8c0719c0 msgr2=0x7ffb8c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:29.446 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb9152a640 1 -- 172.21.15.175:0/1553259089 shutdown_connections 2023-11-20T07:00:29.446 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb9152a640 1 -- 172.21.15.175:0/1553259089 wait complete. 2023-11-20T07:00:29.448 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb9152a640 1 Processor -- start 2023-11-20T07:00:29.448 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.447+0000 7ffb9152a640 1 -- start start 2023-11-20T07:00:29.449 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb9152a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c0b84e0 0x7ffb8c1f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.450 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb9152a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb8c0d0210 0x7ffb8c1f9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.450 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb9152a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb8c15cba0 0x7ffb8c0c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.450 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb9152a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c157810 con 0x7ffb8c0d0210 2023-11-20T07:00:29.450 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb9152a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0c59d0 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.450 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb9152a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0cd030 con 0x7ffb8c15cba0 2023-11-20T07:00:29.450 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb8affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c0b84e0 0x7ffb8c1f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.450 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb8affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c0b84e0 0x7ffb8c1f8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38176/0 (socket says 172.21.15.175:38176) 2023-11-20T07:00:29.450 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb8affd640 1 -- 172.21.15.175:0/3951704003 learned_addr learned my addr 172.21.15.175:0/3951704003 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:29.450 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb8b7fe640 1 --2- 172.21.15.175:0/3951704003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb8c15cba0 0x7ffb8c0c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.450 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb8a7fc640 1 --2- 172.21.15.175:0/3951704003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb8c0d0210 0x7ffb8c1f9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.450 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb8affd640 1 -- 172.21.15.175:0/3951704003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb8c15cba0 msgr2=0x7ffb8c0c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.450 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb8affd640 1 --2- 172.21.15.175:0/3951704003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb8c15cba0 0x7ffb8c0c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.451 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb8affd640 1 -- 172.21.15.175:0/3951704003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb8c0d0210 msgr2=0x7ffb8c1f9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.451 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb8affd640 1 --2- 172.21.15.175:0/3951704003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb8c0d0210 0x7ffb8c1f9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.451 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb8affd640 1 -- 172.21.15.175:0/3951704003 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb84009a70 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.451 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb8affd640 1 --2- 172.21.15.175:0/3951704003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c0b84e0 0x7ffb8c1f8ce0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00c750 tx=0x7ffb7c00cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:29.452 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb737fe640 1 -- 172.21.15.175:0/3951704003 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c005270 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.452 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb737fe640 1 -- 172.21.15.175:0/3951704003 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c0053d0 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.452 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb9152a640 1 -- 172.21.15.175:0/3951704003 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c0c5c20 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.452 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb737fe640 1 -- 172.21.15.175:0/3951704003 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c00a860 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.452 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb9152a640 1 -- 172.21.15.175:0/3951704003 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c1574a0 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.452 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb737fe640 1 -- 172.21.15.175:0/3951704003 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffb7c00acc0 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.452 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb737fe640 1 -- 172.21.15.175:0/3951704003 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ffb7c01c780 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.452 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.451+0000 7ffb9152a640 1 -- 172.21.15.175:0/3951704003 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8c157630 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.462 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.463+0000 7ffb737fe640 1 -- 172.21.15.175:0/3951704003 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ffb7c017070 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.508 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:29.506+0000 7f86cc418180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-20T07:00:29.523 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:29.523+0000 7f184f6db180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-20T07:00:29.528 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.527+0000 7ffb9152a640 1 -- 172.21.15.175:0/3951704003 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "16d24238-148f-4be4-8aec-63faf7dbd418", "id": 0} v 0) v1 -- 0x7ffb8c04e170 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.535+0000 7ffb737fe640 1 -- 172.21.15.175:0/3951704003 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16d24238-148f-4be4-8aec-63faf7dbd418", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffb7c003600 con 0x7ffb8c0b84e0 2023-11-20T07:00:29.534 INFO:teuthology.orchestra.run.smithi175.stdout:0 2023-11-20T07:00:29.535 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.535+0000 7ffb9152a640 1 -- 172.21.15.175:0/3951704003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c0b84e0 msgr2=0x7ffb8c1f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.535 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.535+0000 7ffb9152a640 1 --2- 172.21.15.175:0/3951704003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c0b84e0 0x7ffb8c1f8ce0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00c750 tx=0x7ffb7c00cc10 comp rx=0 tx=0).stop 2023-11-20T07:00:29.535 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.535+0000 7ffb9152a640 1 -- 172.21.15.175:0/3951704003 shutdown_connections 2023-11-20T07:00:29.537 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.535+0000 7ffb9152a640 1 --2- 172.21.15.175:0/3951704003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb8c15cba0 0x7ffb8c0c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.537 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.535+0000 7ffb9152a640 1 --2- 172.21.15.175:0/3951704003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb8c0d0210 0x7ffb8c1f9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.537 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.535+0000 7ffb9152a640 1 --2- 172.21.15.175:0/3951704003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb8c0b84e0 0x7ffb8c1f8ce0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.537 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.535+0000 7ffb9152a640 1 -- 172.21.15.175:0/3951704003 >> 172.21.15.175:0/3951704003 conn(0x7ffb8c0719c0 msgr2=0x7ffb8c072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:29.537 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.535+0000 7ffb9152a640 1 -- 172.21.15.175:0/3951704003 shutdown_connections 2023-11-20T07:00:29.537 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.535+0000 7ffb9152a640 1 -- 172.21.15.175:0/3951704003 wait complete. 2023-11-20T07:00:29.555 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 86beb9f6-e652-4fb2-9c37-d9729ae471d3 1 2023-11-20T07:00:29.710 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:29.710+0000 7f86cc418180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-20T07:00:29.733 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.731+0000 7f2f12b65640 1 Processor -- start 2023-11-20T07:00:29.733 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.735+0000 7f2f12b65640 1 -- start start 2023-11-20T07:00:29.734 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.735+0000 7f2f12b65640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2f0c15cba0 0x7f2f0c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.735 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.735+0000 7f2f12b65640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c0d1670 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.735 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.735+0000 7f2f12b65640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c0d1950 con 0x7f2f0c0d0210 2023-11-20T07:00:29.735 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.735+0000 7f2f12b65640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c0d1460 con 0x7f2f0c15cba0 2023-11-20T07:00:29.735 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.735+0000 7f2f10901640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2f0c15cba0 0x7f2f0c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.735 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.735+0000 7f2f10901640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2f0c15cba0 0x7f2f0c0d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38184/0 (socket says 172.21.15.175:38184) 2023-11-20T07:00:29.736 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.735+0000 7f2f10901640 1 -- 172.21.15.175:0/2482089162 learned_addr learned my addr 172.21.15.175:0/2482089162 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:29.736 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.735+0000 7f2f10901640 1 -- 172.21.15.175:0/2482089162 >> v1:172.21.15.175:6789/0 conn(0x7f2f0c0d0210 legacy=0x7f2f0c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.736 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.735+0000 7f2f10901640 1 -- 172.21.15.175:0/2482089162 >> v1:172.21.15.88:6789/0 conn(0x7f2f0c0b84e0 legacy=0x7f2f0c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.736 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.735+0000 7f2f10901640 1 -- 172.21.15.175:0/2482089162 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0d1c30 con 0x7f2f0c15cba0 2023-11-20T07:00:29.737 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f10901640 1 --2- 172.21.15.175:0/2482089162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f0c15cba0 0x7f2f0c0d0f20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009870 tx=0x7f2f0001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a94c838b977123ac server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:29.738 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f0b7fe640 1 -- 172.21.15.175:0/2482089162 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f000aa610 con 0x7f2f0c15cba0 2023-11-20T07:00:29.738 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f0b7fe640 1 -- 172.21.15.175:0/2482089162 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f000a6040 con 0x7f2f0c15cba0 2023-11-20T07:00:29.738 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f0b7fe640 1 -- 172.21.15.175:0/2482089162 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f000aa990 con 0x7f2f0c15cba0 2023-11-20T07:00:29.739 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f12b65640 1 -- 172.21.15.175:0/2482089162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f0c15cba0 msgr2=0x7f2f0c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.739 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f12b65640 1 --2- 172.21.15.175:0/2482089162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f0c15cba0 0x7f2f0c0d0f20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009870 tx=0x7f2f0001c4b0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.739 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f12b65640 1 -- 172.21.15.175:0/2482089162 shutdown_connections 2023-11-20T07:00:29.739 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f12b65640 1 --2- 172.21.15.175:0/2482089162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f0c15cba0 0x7f2f0c0d0f20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.739 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f12b65640 1 -- 172.21.15.175:0/2482089162 >> 172.21.15.175:0/2482089162 conn(0x7f2f0c0719c0 msgr2=0x7f2f0c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:29.739 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f12b65640 1 -- 172.21.15.175:0/2482089162 shutdown_connections 2023-11-20T07:00:29.740 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f12b65640 1 -- 172.21.15.175:0/2482089162 wait complete. 2023-11-20T07:00:29.740 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f12b65640 1 Processor -- start 2023-11-20T07:00:29.740 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.739+0000 7f2f12b65640 1 -- start start 2023-11-20T07:00:29.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f12b65640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f0c0b84e0 0x7f2f0c14bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f12b65640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f0c0d0210 0x7f2f0c153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f12b65640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f0c15cba0 0x7f2f0c153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f12b65640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0c9330 con 0x7f2f0c0d0210 2023-11-20T07:00:29.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f12b65640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0c8720 con 0x7f2f0c15cba0 2023-11-20T07:00:29.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f12b65640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0c8a00 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f11102640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f0c15cba0 0x7f2f0c153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f10901640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f0c0b84e0 0x7f2f0c14bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f11102640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f0c15cba0 0x7f2f0c153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38192/0 (socket says 172.21.15.175:38192) 2023-11-20T07:00:29.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f0bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f0c0d0210 0x7f2f0c153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.743 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f10901640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f0c0b84e0 0x7f2f0c14bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:55276/0 (socket says 172.21.15.175:55276) 2023-11-20T07:00:29.743 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f11102640 1 -- 172.21.15.175:0/4085686764 learned_addr learned my addr 172.21.15.175:0/4085686764 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:29.744 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f10901640 1 -- 172.21.15.175:0/4085686764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f0c15cba0 msgr2=0x7f2f0c153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.744 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f10901640 1 --2- 172.21.15.175:0/4085686764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f0c15cba0 0x7f2f0c153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.744 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f10901640 1 -- 172.21.15.175:0/4085686764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f0c0d0210 msgr2=0x7f2f0c153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.744 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f10901640 1 --2- 172.21.15.175:0/4085686764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f0c0d0210 0x7f2f0c153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.744 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f10901640 1 -- 172.21.15.175:0/4085686764 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f000094d0 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.744 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f0bfff640 1 --2- 172.21.15.175:0/4085686764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f0c0d0210 0x7f2f0c153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:00:29.744 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f11102640 1 --2- 172.21.15.175:0/4085686764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f0c15cba0 0x7f2f0c153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:00:29.745 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f10901640 1 --2- 172.21.15.175:0/4085686764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f0c0b84e0 0x7f2f0c14bf70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f000ab000 tx=0x7f2f0001acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:29.745 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f097fa640 1 -- 172.21.15.175:0/4085686764 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f000bd5f0 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.745 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f097fa640 1 -- 172.21.15.175:0/4085686764 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f000bd750 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.745 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f097fa640 1 -- 172.21.15.175:0/4085686764 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f000bdb00 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.745 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f12b65640 1 -- 172.21.15.175:0/4085686764 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c0c8ce0 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.745 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f12b65640 1 -- 172.21.15.175:0/4085686764 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c14c4b0 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.745 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f097fa640 1 -- 172.21.15.175:0/4085686764 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2f000c63f0 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.745 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f097fa640 1 -- 172.21.15.175:0/4085686764 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f2f000b33f0 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.745 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.743+0000 7f2f12b65640 1 -- 172.21.15.175:0/4085686764 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c04e170 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.746 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.747+0000 7f2f097fa640 1 -- 172.21.15.175:0/4085686764 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2f000c6740 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.812 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.811+0000 7f2f12b65640 1 -- 172.21.15.175:0/4085686764 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "86beb9f6-e652-4fb2-9c37-d9729ae471d3", "id": 1} v 0) v1 -- 0x7f2f0c0c8b40 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.818 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.819+0000 7f2f097fa640 1 -- 172.21.15.175:0/4085686764 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86beb9f6-e652-4fb2-9c37-d9729ae471d3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f0c0c8b40 con 0x7f2f0c0b84e0 2023-11-20T07:00:29.819 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-11-20T07:00:29.819 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.819+0000 7f2f12b65640 1 -- 172.21.15.175:0/4085686764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f0c0b84e0 msgr2=0x7f2f0c14bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.819+0000 7f2f12b65640 1 --2- 172.21.15.175:0/4085686764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f0c0b84e0 0x7f2f0c14bf70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f000ab000 tx=0x7f2f0001acf0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.819+0000 7f2f12b65640 1 -- 172.21.15.175:0/4085686764 shutdown_connections 2023-11-20T07:00:29.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.819+0000 7f2f12b65640 1 --2- 172.21.15.175:0/4085686764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f0c15cba0 0x7f2f0c153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.819+0000 7f2f12b65640 1 --2- 172.21.15.175:0/4085686764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2f0c0d0210 0x7f2f0c153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.819+0000 7f2f12b65640 1 --2- 172.21.15.175:0/4085686764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2f0c0b84e0 0x7f2f0c14bf70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.819+0000 7f2f12b65640 1 -- 172.21.15.175:0/4085686764 >> 172.21.15.175:0/4085686764 conn(0x7f2f0c0719c0 msgr2=0x7f2f0c071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:29.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.819+0000 7f2f12b65640 1 -- 172.21.15.175:0/4085686764 shutdown_connections 2023-11-20T07:00:29.820 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.819+0000 7f2f12b65640 1 -- 172.21.15.175:0/4085686764 wait complete. 2023-11-20T07:00:29.838 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new d4aa4be2-5d29-4ffe-9f46-9686156793b6 2 2023-11-20T07:00:29.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5ec54640 1 Processor -- start 2023-11-20T07:00:29.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5ec54640 1 -- start start 2023-11-20T07:00:29.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5ec54640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8e5815cc30 0x7f8e580b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5ec54640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e580cd840 0x7f8e580cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5ec54640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e580d0f90 0x7f8e580d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5ec54640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5815d010 con 0x7f8e580cd840 2023-11-20T07:00:29.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5ec54640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e580b74d0 con 0x7f8e5815cc30 2023-11-20T07:00:29.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5ec54640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580b77b0 con 0x7f8e580d0f90 2023-11-20T07:00:29.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5d1f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e580d0f90 0x7f8e580d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5c9f0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8e5815cc30 0x7f8e580b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5d1f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e580d0f90 0x7f8e580d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:55292/0 (socket says 172.21.15.175:55292) 2023-11-20T07:00:29.976 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5d1f1640 1 -- 172.21.15.175:0/621283214 learned_addr learned my addr 172.21.15.175:0/621283214 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:29.976 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e57fff640 1 --2- 172.21.15.175:0/621283214 >> v2:172.21.15.88:3300/0 conn(0x7f8e580cd840 0x7f8e580cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.976 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5c9f0640 1 -- 172.21.15.175:0/621283214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e580d0f90 msgr2=0x7f8e580d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:29.976 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5c9f0640 1 --2- 172.21.15.175:0/621283214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e580d0f90 0x7f8e580d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.976 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5c9f0640 1 -- 172.21.15.175:0/621283214 >> v2:172.21.15.88:3300/0 conn(0x7f8e580cd840 msgr2=0x7f8e580cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:29.976 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5c9f0640 1 --2- 172.21.15.175:0/621283214 >> v2:172.21.15.88:3300/0 conn(0x7f8e580cd840 0x7f8e580cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.976 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5c9f0640 1 -- 172.21.15.175:0/621283214 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e580b7a90 con 0x7f8e5815cc30 2023-11-20T07:00:29.977 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.975+0000 7f8e5d1f1640 1 --2- 172.21.15.175:0/621283214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e580d0f90 0x7f8e580d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:00:29.978 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e5c9f0640 1 --2- 172.21.15.175:0/621283214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e5815cc30 0x7f8e580b8780 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8e580b4720 tx=0x7f8e4c01ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=143bbdd86b6e97a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:29.979 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e577fe640 1 -- 172.21.15.175:0/621283214 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0a8910 con 0x7f8e5815cc30 2023-11-20T07:00:29.979 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e577fe640 1 -- 172.21.15.175:0/621283214 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c0a8a70 con 0x7f8e5815cc30 2023-11-20T07:00:29.979 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e577fe640 1 -- 172.21.15.175:0/621283214 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0a8e00 con 0x7f8e5815cc30 2023-11-20T07:00:29.980 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e5ec54640 1 -- 172.21.15.175:0/621283214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e5815cc30 msgr2=0x7f8e580b8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.980 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e5ec54640 1 --2- 172.21.15.175:0/621283214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e5815cc30 0x7f8e580b8780 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8e580b4720 tx=0x7f8e4c01ec50 comp rx=0 tx=0).stop 2023-11-20T07:00:29.980 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e5ec54640 1 -- 172.21.15.175:0/621283214 shutdown_connections 2023-11-20T07:00:29.980 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e5ec54640 1 --2- 172.21.15.175:0/621283214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e580d0f90 0x7f8e580d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.980 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e5ec54640 1 --2- 172.21.15.175:0/621283214 >> v2:172.21.15.88:3300/0 conn(0x7f8e580cd840 0x7f8e580cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.980 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e5ec54640 1 --2- 172.21.15.175:0/621283214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e5815cc30 0x7f8e580b8780 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.980 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e5ec54640 1 -- 172.21.15.175:0/621283214 >> 172.21.15.175:0/621283214 conn(0x7f8e5806b750 msgr2=0x7f8e5806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:29.980 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e5ec54640 1 -- 172.21.15.175:0/621283214 shutdown_connections 2023-11-20T07:00:29.980 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.979+0000 7f8e5ec54640 1 -- 172.21.15.175:0/621283214 wait complete. 2023-11-20T07:00:29.981 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5ec54640 1 Processor -- start 2023-11-20T07:00:29.981 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5ec54640 1 -- start start 2023-11-20T07:00:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5ec54640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e580cd840 0x7f8e5815fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5ec54640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e580d0f90 0x7f8e581f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5ec54640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e5815cc30 0x7f8e5815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5ec54640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e581f3350 con 0x7f8e580d0f90 2023-11-20T07:00:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5ec54640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580c8590 con 0x7f8e580cd840 2023-11-20T07:00:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5ec54640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580c79a0 con 0x7f8e5815cc30 2023-11-20T07:00:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5c9f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e580cd840 0x7f8e5815fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5d1f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e5815cc30 0x7f8e5815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5c9f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e580cd840 0x7f8e5815fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38218/0 (socket says 172.21.15.175:38218) 2023-11-20T07:00:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5c9f0640 1 -- 172.21.15.175:0/2766791906 learned_addr learned my addr 172.21.15.175:0/2766791906 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:29.983 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e57fff640 1 --2- 172.21.15.175:0/2766791906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e580d0f90 0x7f8e581f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:29.985 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5c9f0640 1 -- 172.21.15.175:0/2766791906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e5815cc30 msgr2=0x7f8e5815b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.985 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5c9f0640 1 --2- 172.21.15.175:0/2766791906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e5815cc30 0x7f8e5815b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.985 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5c9f0640 1 -- 172.21.15.175:0/2766791906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e580d0f90 msgr2=0x7f8e581f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:29.985 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5c9f0640 1 --2- 172.21.15.175:0/2766791906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e580d0f90 0x7f8e581f2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:29.985 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5c9f0640 1 -- 172.21.15.175:0/2766791906 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e50009b30 con 0x7f8e580cd840 2023-11-20T07:00:29.985 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e57fff640 1 --2- 172.21.15.175:0/2766791906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e580d0f90 0x7f8e581f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:00:29.985 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5c9f0640 1 --2- 172.21.15.175:0/2766791906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e580cd840 0x7f8e5815fc70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009710 tx=0x7f8e4c01b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:29.985 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e557fa640 1 -- 172.21.15.175:0/2766791906 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0b0850 con 0x7f8e580cd840 2023-11-20T07:00:29.985 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e557fa640 1 -- 172.21.15.175:0/2766791906 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c0b09d0 con 0x7f8e580cd840 2023-11-20T07:00:29.985 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e557fa640 1 -- 172.21.15.175:0/2766791906 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0b0d80 con 0x7f8e580cd840 2023-11-20T07:00:29.986 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5ec54640 1 -- 172.21.15.175:0/2766791906 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c009420 con 0x7f8e580cd840 2023-11-20T07:00:29.986 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e5ec54640 1 -- 172.21.15.175:0/2766791906 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e580c7f40 con 0x7f8e580cd840 2023-11-20T07:00:29.986 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e557fa640 1 -- 172.21.15.175:0/2766791906 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8e4c0b7040 con 0x7f8e580cd840 2023-11-20T07:00:29.986 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.983+0000 7f8e557fa640 1 -- 172.21.15.175:0/2766791906 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f8e4c0b9850 con 0x7f8e580cd840 2023-11-20T07:00:29.986 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.987+0000 7f8e5ec54640 1 -- 172.21.15.175:0/2766791906 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e58067230 con 0x7f8e580cd840 2023-11-20T07:00:29.987 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:29.987+0000 7f8e557fa640 1 -- 172.21.15.175:0/2766791906 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8e4c0b5070 con 0x7f8e580cd840 2023-11-20T07:00:30.053 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.051+0000 7f8e5ec54640 1 -- 172.21.15.175:0/2766791906 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d4aa4be2-5d29-4ffe-9f46-9686156793b6", "id": 2} v 0) v1 -- 0x7f8e580718a0 con 0x7f8e580cd840 2023-11-20T07:00:30.059 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.059+0000 7f8e557fa640 1 -- 172.21.15.175:0/2766791906 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d4aa4be2-5d29-4ffe-9f46-9686156793b6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e4c0b9430 con 0x7f8e580cd840 2023-11-20T07:00:30.059 INFO:teuthology.orchestra.run.smithi175.stdout:2 2023-11-20T07:00:30.060 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.059+0000 7f8e5ec54640 1 -- 172.21.15.175:0/2766791906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e580cd840 msgr2=0x7f8e5815fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.060 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.059+0000 7f8e5ec54640 1 --2- 172.21.15.175:0/2766791906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e580cd840 0x7f8e5815fc70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c009710 tx=0x7f8e4c01b9f0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.059+0000 7f8e5ec54640 1 -- 172.21.15.175:0/2766791906 shutdown_connections 2023-11-20T07:00:30.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.059+0000 7f8e5ec54640 1 --2- 172.21.15.175:0/2766791906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e5815cc30 0x7f8e5815b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.059+0000 7f8e5ec54640 1 --2- 172.21.15.175:0/2766791906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e580d0f90 0x7f8e581f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.059+0000 7f8e5ec54640 1 --2- 172.21.15.175:0/2766791906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e580cd840 0x7f8e5815fc70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.059+0000 7f8e5ec54640 1 -- 172.21.15.175:0/2766791906 >> 172.21.15.175:0/2766791906 conn(0x7f8e5806b750 msgr2=0x7f8e580b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:30.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.059+0000 7f8e5ec54640 1 -- 172.21.15.175:0/2766791906 shutdown_connections 2023-11-20T07:00:30.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.059+0000 7f8e5ec54640 1 -- 172.21.15.175:0/2766791906 wait complete. 2023-11-20T07:00:30.079 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 691307ae-a2c8-45f6-9638-01bccc6acb00 3 2023-11-20T07:00:30.181 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:30.183+0000 7f184f6db180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-20T07:00:30.217 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21ba617640 1 Processor -- start 2023-11-20T07:00:30.217 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21ba617640 1 -- start start 2023-11-20T07:00:30.218 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21ba617640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21b415cba0 0x7f21b40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.218 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21ba617640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f21b40d0210 0x7f21b40b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.219 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21ba617640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b40d1670 con 0x7f21b40b84e0 2023-11-20T07:00:30.219 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21ba617640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b40d1460 con 0x7f21b415cba0 2023-11-20T07:00:30.219 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21ba617640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b40d1950 con 0x7f21b40d0210 2023-11-20T07:00:30.219 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21b8bb4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f21b40d0210 0x7f21b40b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.219 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21b8bb4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f21b40d0210 0x7f21b40b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38224/0 (socket says 172.21.15.175:38224) 2023-11-20T07:00:30.219 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21b8bb4640 1 -- 172.21.15.175:0/1842994485 learned_addr learned my addr 172.21.15.175:0/1842994485 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:30.219 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21b3fff640 1 --2- 172.21.15.175:0/1842994485 >> v2:172.21.15.88:3300/0 conn(0x7f21b415cba0 0x7f21b40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.219 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21b3fff640 1 -- 172.21.15.175:0/1842994485 >> v2:172.21.15.175:3300/0 conn(0x7f21b40d0210 msgr2=0x7f21b40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:30.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21b3fff640 1 --2- 172.21.15.175:0/1842994485 >> v2:172.21.15.175:3300/0 conn(0x7f21b40d0210 0x7f21b40b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21b3fff640 1 -- 172.21.15.175:0/1842994485 >> v1:172.21.15.175:6789/0 conn(0x7f21b40b84e0 legacy=0x7f21b40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.219+0000 7f21b3fff640 1 -- 172.21.15.175:0/1842994485 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40d1c30 con 0x7f21b415cba0 2023-11-20T07:00:30.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.223+0000 7f21b3fff640 1 --2- 172.21.15.175:0/1842994485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21b415cba0 0x7f21b40d0f20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f21b40ce450 tx=0x7f21a401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38ccaddb285a7a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:30.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.223+0000 7f21b2ffd640 1 -- 172.21.15.175:0/1842994485 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a40ac630 con 0x7f21b415cba0 2023-11-20T07:00:30.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.223+0000 7f21b2ffd640 1 -- 172.21.15.175:0/1842994485 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a40ac790 con 0x7f21b415cba0 2023-11-20T07:00:30.223 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.223+0000 7f21b2ffd640 1 -- 172.21.15.175:0/1842994485 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a40acb20 con 0x7f21b415cba0 2023-11-20T07:00:30.223 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.223+0000 7f21ba617640 1 -- 172.21.15.175:0/1842994485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21b415cba0 msgr2=0x7f21b40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.223 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.223+0000 7f21ba617640 1 --2- 172.21.15.175:0/1842994485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21b415cba0 0x7f21b40d0f20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f21b40ce450 tx=0x7f21a401c3d0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.223 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.223+0000 7f21ba617640 1 -- 172.21.15.175:0/1842994485 shutdown_connections 2023-11-20T07:00:30.224 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.223+0000 7f21ba617640 1 --2- 172.21.15.175:0/1842994485 >> v2:172.21.15.175:3300/0 conn(0x7f21b40d0210 0x7f21b40b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.224 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.223+0000 7f21ba617640 1 --2- 172.21.15.175:0/1842994485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21b415cba0 0x7f21b40d0f20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.224 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.223+0000 7f21ba617640 1 -- 172.21.15.175:0/1842994485 >> 172.21.15.175:0/1842994485 conn(0x7f21b40719c0 msgr2=0x7f21b4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:30.224 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.223+0000 7f21ba617640 1 -- 172.21.15.175:0/1842994485 shutdown_connections 2023-11-20T07:00:30.224 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.223+0000 7f21ba617640 1 -- 172.21.15.175:0/1842994485 wait complete. 2023-11-20T07:00:30.225 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21ba617640 1 Processor -- start 2023-11-20T07:00:30.225 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21ba617640 1 -- start start 2023-11-20T07:00:30.227 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21ba617640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b40b84e0 0x7f21b414db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.227 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21ba617640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21b40d0210 0x7f21b41576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.227 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21ba617640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21b415cba0 0x7f21b4151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.227 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21ba617640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b41f5c20 con 0x7f21b40d0210 2023-11-20T07:00:30.228 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21ba617640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b4151640 con 0x7f21b40b84e0 2023-11-20T07:00:30.228 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21ba617640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b4150a30 con 0x7f21b415cba0 2023-11-20T07:00:30.228 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b40b84e0 0x7f21b414db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.228 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b40b84e0 0x7f21b414db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38232/0 (socket says 172.21.15.175:38232) 2023-11-20T07:00:30.228 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b3fff640 1 -- 172.21.15.175:0/136622540 learned_addr learned my addr 172.21.15.175:0/136622540 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:30.228 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b8bb4640 1 --2- 172.21.15.175:0/136622540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21b415cba0 0x7f21b4151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.228 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b37fe640 1 --2- 172.21.15.175:0/136622540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21b40d0210 0x7f21b41576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.228 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b3fff640 1 -- 172.21.15.175:0/136622540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21b415cba0 msgr2=0x7f21b4151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.228 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b3fff640 1 --2- 172.21.15.175:0/136622540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21b415cba0 0x7f21b4151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.229 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b3fff640 1 -- 172.21.15.175:0/136622540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21b40d0210 msgr2=0x7f21b41576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.229 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b3fff640 1 --2- 172.21.15.175:0/136622540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21b40d0210 0x7f21b41576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.229 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b3fff640 1 -- 172.21.15.175:0/136622540 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4009420 con 0x7f21b40b84e0 2023-11-20T07:00:30.229 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b3fff640 1 --2- 172.21.15.175:0/136622540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b40b84e0 0x7f21b414db40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f21a401a000 tx=0x7f21a401ac10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:30.230 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b0ff9640 1 -- 172.21.15.175:0/136622540 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a40b8650 con 0x7f21b40b84e0 2023-11-20T07:00:30.230 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b0ff9640 1 -- 172.21.15.175:0/136622540 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a40b87d0 con 0x7f21b40b84e0 2023-11-20T07:00:30.230 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21ba617640 1 -- 172.21.15.175:0/136622540 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b4150d10 con 0x7f21b40b84e0 2023-11-20T07:00:30.230 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b0ff9640 1 -- 172.21.15.175:0/136622540 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a40b8b80 con 0x7f21b40b84e0 2023-11-20T07:00:30.231 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21ba617640 1 -- 172.21.15.175:0/136622540 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b41512d0 con 0x7f21b40b84e0 2023-11-20T07:00:30.231 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b0ff9640 1 -- 172.21.15.175:0/136622540 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f21a40c1400 con 0x7f21b40b84e0 2023-11-20T07:00:30.231 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.227+0000 7f21b0ff9640 1 -- 172.21.15.175:0/136622540 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f21a40b6890 con 0x7f21b40b84e0 2023-11-20T07:00:30.231 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.231+0000 7f21ba617640 1 -- 172.21.15.175:0/136622540 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b404e170 con 0x7f21b40b84e0 2023-11-20T07:00:30.231 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.231+0000 7f21b0ff9640 1 -- 172.21.15.175:0/136622540 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f21a40bc020 con 0x7f21b40b84e0 2023-11-20T07:00:30.257 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:30.259+0000 7f184f6db180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-20T07:00:30.297 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.299+0000 7f21ba617640 1 -- 172.21.15.175:0/136622540 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "691307ae-a2c8-45f6-9638-01bccc6acb00", "id": 3} v 0) v1 -- 0x7f21b414e080 con 0x7f21b40b84e0 2023-11-20T07:00:30.303 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.303+0000 7f21b0ff9640 1 -- 172.21.15.175:0/136622540 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "691307ae-a2c8-45f6-9638-01bccc6acb00", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f21a40b1070 con 0x7f21b40b84e0 2023-11-20T07:00:30.303 INFO:teuthology.orchestra.run.smithi175.stdout:3 2023-11-20T07:00:30.304 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.303+0000 7f21ba617640 1 -- 172.21.15.175:0/136622540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b40b84e0 msgr2=0x7f21b414db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.304 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.303+0000 7f21ba617640 1 --2- 172.21.15.175:0/136622540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b40b84e0 0x7f21b414db40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f21a401a000 tx=0x7f21a401ac10 comp rx=0 tx=0).stop 2023-11-20T07:00:30.304 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.303+0000 7f21ba617640 1 -- 172.21.15.175:0/136622540 shutdown_connections 2023-11-20T07:00:30.305 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.303+0000 7f21ba617640 1 --2- 172.21.15.175:0/136622540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21b415cba0 0x7f21b4151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.305 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.303+0000 7f21ba617640 1 --2- 172.21.15.175:0/136622540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21b40d0210 0x7f21b41576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.305 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.303+0000 7f21ba617640 1 --2- 172.21.15.175:0/136622540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21b40b84e0 0x7f21b414db40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.305 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.303+0000 7f21ba617640 1 -- 172.21.15.175:0/136622540 >> 172.21.15.175:0/136622540 conn(0x7f21b40719c0 msgr2=0x7f21b415a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:30.305 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.303+0000 7f21ba617640 1 -- 172.21.15.175:0/136622540 shutdown_connections 2023-11-20T07:00:30.305 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.303+0000 7f21ba617640 1 -- 172.21.15.175:0/136622540 wait complete. 2023-11-20T07:00:30.320 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:30.319+0000 7f184f6db180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-20T07:00:30.322 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 91acdcb0-85b3-40c5-aaa1-4737296fb794 4 2023-11-20T07:00:30.344 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:30.342+0000 7f86cc418180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-20T07:00:30.407 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:30.406+0000 7f86cc418180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-20T07:00:30.410 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:30.411+0000 7f184f6db180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-20T07:00:30.459 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43e511d640 1 Processor -- start 2023-11-20T07:00:30.459 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43e511d640 1 -- start start 2023-11-20T07:00:30.460 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43e511d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00d0210 0x7f43e00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.460 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43e511d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e00d1670 con 0x7f43e015cba0 2023-11-20T07:00:30.460 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43e511d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e00d1950 con 0x7f43e00b84e0 2023-11-20T07:00:30.460 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43e511d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00d1460 con 0x7f43e00d0210 2023-11-20T07:00:30.460 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43de59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00d0210 0x7f43e00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.460 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43df59e640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f43e00b84e0 0x7f43e00b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53180/0 (socket says 172.21.15.175:53180) 2023-11-20T07:00:30.461 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43df59e640 1 -- 172.21.15.175:0/93939912 learned_addr learned my addr 172.21.15.175:0/93939912 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-11-20T07:00:30.461 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43de59c640 1 -- 172.21.15.175:0/93939912 >> v1:172.21.15.175:6789/0 conn(0x7f43e00b84e0 legacy=0x7f43e00b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.461 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43ddd9b640 1 -- 172.21.15.175:0/93939912 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893267467 0 0) 0x7f43e00d1670 con 0x7f43e015cba0 2023-11-20T07:00:30.461 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43de59c640 1 -- 172.21.15.175:0/93939912 >> v1:172.21.15.88:6789/0 conn(0x7f43e015cba0 legacy=0x7f43e00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.462 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.459+0000 7f43de59c640 1 -- 172.21.15.175:0/93939912 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00d1c30 con 0x7f43e00d0210 2023-11-20T07:00:30.465 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43de59c640 1 --2- 172.21.15.175:0/93939912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00d0210 0x7f43e00d0f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009770 tx=0x7f43d401c2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd535e6a636c99ad server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:30.466 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43ddd9b640 1 -- 172.21.15.175:0/93939912 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40ab600 con 0x7f43e00d0210 2023-11-20T07:00:30.466 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43ddd9b640 1 -- 172.21.15.175:0/93939912 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d40a7050 con 0x7f43e00d0210 2023-11-20T07:00:30.466 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43ddd9b640 1 -- 172.21.15.175:0/93939912 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40ab980 con 0x7f43e00d0210 2023-11-20T07:00:30.467 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43e511d640 1 -- 172.21.15.175:0/93939912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00d0210 msgr2=0x7f43e00d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.467 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43e511d640 1 --2- 172.21.15.175:0/93939912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00d0210 0x7f43e00d0f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009770 tx=0x7f43d401c2f0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.467 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43e511d640 1 -- 172.21.15.175:0/93939912 shutdown_connections 2023-11-20T07:00:30.467 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43e511d640 1 --2- 172.21.15.175:0/93939912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00d0210 0x7f43e00d0f20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.468 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43e511d640 1 -- 172.21.15.175:0/93939912 >> 172.21.15.175:0/93939912 conn(0x7f43e00719c0 msgr2=0x7f43e0071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:30.468 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43e511d640 1 -- 172.21.15.175:0/93939912 shutdown_connections 2023-11-20T07:00:30.468 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43e511d640 1 -- 172.21.15.175:0/93939912 wait complete. 2023-11-20T07:00:30.469 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:30.466+0000 7f86cc418180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-20T07:00:30.470 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43e511d640 1 Processor -- start 2023-11-20T07:00:30.470 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.467+0000 7f43e511d640 1 -- start start 2023-11-20T07:00:30.471 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43e511d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00b84e0 0x7f43e00c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.471 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43e511d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e00d0210 0x7f43e01495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.471 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43e511d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e015cba0 0x7f43e0148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.471 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43e511d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e014bee0 con 0x7f43e00d0210 2023-11-20T07:00:30.471 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43e511d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00c4510 con 0x7f43e015cba0 2023-11-20T07:00:30.472 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43e511d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e0152250 con 0x7f43e00b84e0 2023-11-20T07:00:30.472 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43ded9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00b84e0 0x7f43e00c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.472 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43ded9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00b84e0 0x7f43e00c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:55326/0 (socket says 172.21.15.175:55326) 2023-11-20T07:00:30.472 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43ded9d640 1 -- 172.21.15.175:0/3163261020 learned_addr learned my addr 172.21.15.175:0/3163261020 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:30.472 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43df59e640 1 --2- 172.21.15.175:0/3163261020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e015cba0 0x7f43e0148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.473 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43de59c640 1 --2- 172.21.15.175:0/3163261020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e00d0210 0x7f43e01495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.473 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43ded9d640 1 -- 172.21.15.175:0/3163261020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e015cba0 msgr2=0x7f43e0148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.473 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43ded9d640 1 --2- 172.21.15.175:0/3163261020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e015cba0 0x7f43e0148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.473 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43ded9d640 1 -- 172.21.15.175:0/3163261020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e00d0210 msgr2=0x7f43e01495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.474 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43ded9d640 1 --2- 172.21.15.175:0/3163261020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e00d0210 0x7f43e01495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.474 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43ded9d640 1 -- 172.21.15.175:0/3163261020 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d4009420 con 0x7f43e00b84e0 2023-11-20T07:00:30.475 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43ded9d640 1 --2- 172.21.15.175:0/3163261020 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00b84e0 0x7f43e00c5820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43d000c4a0 tx=0x7f43d000c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:30.475 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43c77fe640 1 -- 172.21.15.175:0/3163261020 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0005480 con 0x7f43e00b84e0 2023-11-20T07:00:30.475 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43c77fe640 1 -- 172.21.15.175:0/3163261020 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d0003600 con 0x7f43e00b84e0 2023-11-20T07:00:30.476 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43c77fe640 1 -- 172.21.15.175:0/3163261020 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d00039b0 con 0x7f43e00b84e0 2023-11-20T07:00:30.476 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43e511d640 1 -- 172.21.15.175:0/3163261020 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e0152530 con 0x7f43e00b84e0 2023-11-20T07:00:30.476 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43e511d640 1 -- 172.21.15.175:0/3163261020 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e0152af0 con 0x7f43e00b84e0 2023-11-20T07:00:30.476 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43c77fe640 1 -- 172.21.15.175:0/3163261020 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f43d001c440 con 0x7f43e00b84e0 2023-11-20T07:00:30.476 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43c77fe640 1 -- 172.21.15.175:0/3163261020 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f43d0012910 con 0x7f43e00b84e0 2023-11-20T07:00:30.476 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.471+0000 7f43e511d640 1 -- 172.21.15.175:0/3163261020 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e004e170 con 0x7f43e00b84e0 2023-11-20T07:00:30.476 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.475+0000 7f43c77fe640 1 -- 172.21.15.175:0/3163261020 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f43d0017070 con 0x7f43e00b84e0 2023-11-20T07:00:30.476 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:30.475+0000 7f184f6db180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-20T07:00:30.541 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.543+0000 7f43e511d640 1 -- 172.21.15.175:0/3163261020 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "91acdcb0-85b3-40c5-aaa1-4737296fb794", "id": 4} v 0) v1 -- 0x7f43e00c5d60 con 0x7f43e00b84e0 2023-11-20T07:00:30.551 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.551+0000 7f43c77fe640 1 -- 172.21.15.175:0/3163261020 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "91acdcb0-85b3-40c5-aaa1-4737296fb794", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f43d0012cc0 con 0x7f43e00b84e0 2023-11-20T07:00:30.551 INFO:teuthology.orchestra.run.smithi175.stdout:4 2023-11-20T07:00:30.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.551+0000 7f43e511d640 1 -- 172.21.15.175:0/3163261020 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00b84e0 msgr2=0x7f43e00c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.551+0000 7f43e511d640 1 --2- 172.21.15.175:0/3163261020 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00b84e0 0x7f43e00c5820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f43d000c4a0 tx=0x7f43d000c960 comp rx=0 tx=0).stop 2023-11-20T07:00:30.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.551+0000 7f43e511d640 1 -- 172.21.15.175:0/3163261020 shutdown_connections 2023-11-20T07:00:30.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.551+0000 7f43e511d640 1 --2- 172.21.15.175:0/3163261020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43e015cba0 0x7f43e0148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.551+0000 7f43e511d640 1 --2- 172.21.15.175:0/3163261020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43e00d0210 0x7f43e01495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.552 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.551+0000 7f43e511d640 1 --2- 172.21.15.175:0/3163261020 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43e00b84e0 0x7f43e00c5820 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.553 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.551+0000 7f43e511d640 1 -- 172.21.15.175:0/3163261020 >> 172.21.15.175:0/3163261020 conn(0x7f43e00719c0 msgr2=0x7f43e01538f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:30.553 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.551+0000 7f43e511d640 1 -- 172.21.15.175:0/3163261020 shutdown_connections 2023-11-20T07:00:30.553 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.551+0000 7f43e511d640 1 -- 172.21.15.175:0/3163261020 wait complete. 2023-11-20T07:00:30.559 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:30.558+0000 7f86cc418180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-20T07:00:30.569 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:30.571+0000 7f184f6db180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-20T07:00:30.570 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 58ab5ad7-804b-44b6-9209-64921fc69496 5 2023-11-20T07:00:30.618 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:30.618+0000 7f86cc418180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-20T07:00:30.630 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:30.631+0000 7f184f6db180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-20T07:00:30.705 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:30.702+0000 7f86cc418180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-20T07:00:30.706 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.707+0000 7f370e501640 1 Processor -- start 2023-11-20T07:00:30.706 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.707+0000 7f370e501640 1 -- start start 2023-11-20T07:00:30.709 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.707+0000 7f370e501640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f370815cc30 0x7f37080b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.709 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.707+0000 7f370e501640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37080d1fa0 0x7f37080b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.709 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.707+0000 7f370e501640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370815d010 con 0x7f37080cd840 2023-11-20T07:00:30.709 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.707+0000 7f370e501640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37080b74d0 con 0x7f370815cc30 2023-11-20T07:00:30.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.707+0000 7f370e501640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37080b77b0 con 0x7f37080d1fa0 2023-11-20T07:00:30.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f3707fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f370815cc30 0x7f37080b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f370ca9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37080d1fa0 0x7f37080b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f370ca9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37080d1fa0 0x7f37080b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:55328/0 (socket says 172.21.15.175:55328) 2023-11-20T07:00:30.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f3707fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f370815cc30 0x7f37080b8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38256/0 (socket says 172.21.15.175:38256) 2023-11-20T07:00:30.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f370ca9e640 1 -- 172.21.15.175:0/844555313 learned_addr learned my addr 172.21.15.175:0/844555313 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:30.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f370ca9e640 1 -- 172.21.15.175:0/844555313 >> v2:172.21.15.175:3300/0 conn(0x7f370815cc30 msgr2=0x7f37080b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:30.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f370ca9e640 1 --2- 172.21.15.175:0/844555313 >> v2:172.21.15.175:3300/0 conn(0x7f370815cc30 0x7f37080b8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f370ca9e640 1 -- 172.21.15.175:0/844555313 >> v1:172.21.15.88:6789/0 conn(0x7f37080cd840 legacy=0x7f37080cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f370ca9e640 1 -- 172.21.15.175:0/844555313 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37080b7a90 con 0x7f37080d1fa0 2023-11-20T07:00:30.710 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f3706ffd640 1 -- 172.21.15.175:0/844555313 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250955659 0 0) 0x7f370815d010 con 0x7f37080cd840 2023-11-20T07:00:30.712 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f370ca9e640 1 --2- 172.21.15.175:0/844555313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37080d1fa0 0x7f37080b5be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3700009e50 tx=0x7f370001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=462098cd739ea26f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:30.712 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f3706ffd640 1 -- 172.21.15.175:0/844555313 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37000a58d0 con 0x7f37080d1fa0 2023-11-20T07:00:30.713 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f3706ffd640 1 -- 172.21.15.175:0/844555313 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37000a5a30 con 0x7f37080d1fa0 2023-11-20T07:00:30.713 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.711+0000 7f3706ffd640 1 -- 172.21.15.175:0/844555313 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37000a5dc0 con 0x7f37080d1fa0 2023-11-20T07:00:30.713 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 -- 172.21.15.175:0/844555313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37080d1fa0 msgr2=0x7f37080b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.714 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 --2- 172.21.15.175:0/844555313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37080d1fa0 0x7f37080b5be0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3700009e50 tx=0x7f370001c9e0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.714 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 -- 172.21.15.175:0/844555313 shutdown_connections 2023-11-20T07:00:30.714 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 --2- 172.21.15.175:0/844555313 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37080d1fa0 0x7f37080b5be0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.714 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 --2- 172.21.15.175:0/844555313 >> v2:172.21.15.175:3300/0 conn(0x7f370815cc30 0x7f37080b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.714 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 -- 172.21.15.175:0/844555313 >> 172.21.15.175:0/844555313 conn(0x7f370806b750 msgr2=0x7f370806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:30.714 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 -- 172.21.15.175:0/844555313 shutdown_connections 2023-11-20T07:00:30.714 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 -- 172.21.15.175:0/844555313 wait complete. 2023-11-20T07:00:30.715 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 Processor -- start 2023-11-20T07:00:30.715 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 -- start start 2023-11-20T07:00:30.718 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37080cd840 0x7f370815fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.718 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37080d1fa0 0x7f3708147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.718 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f370815cc30 0x7f37080c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.718 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37081603b0 con 0x7f37080cd840 2023-11-20T07:00:30.718 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37080c6740 con 0x7f37080d1fa0 2023-11-20T07:00:30.718 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.715+0000 7f370e501640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3708148d90 con 0x7f370815cc30 2023-11-20T07:00:30.718 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f370ca9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f370815cc30 0x7f37080c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.718 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f370ca9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f370815cc30 0x7f37080c9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:55340/0 (socket says 172.21.15.175:55340) 2023-11-20T07:00:30.718 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f370ca9e640 1 -- 172.21.15.175:0/1364268053 learned_addr learned my addr 172.21.15.175:0/1364268053 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:30.719 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f3707fff640 1 --2- 172.21.15.175:0/1364268053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37080cd840 0x7f370815fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.719 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f37077fe640 1 --2- 172.21.15.175:0/1364268053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37080d1fa0 0x7f3708147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.719 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f370ca9e640 1 -- 172.21.15.175:0/1364268053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37080d1fa0 msgr2=0x7f3708147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.719 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f370ca9e640 1 --2- 172.21.15.175:0/1364268053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37080d1fa0 0x7f3708147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.719 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f370ca9e640 1 -- 172.21.15.175:0/1364268053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37080cd840 msgr2=0x7f370815fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.719 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f370ca9e640 1 --2- 172.21.15.175:0/1364268053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37080cd840 0x7f370815fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.719 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f370ca9e640 1 -- 172.21.15.175:0/1364268053 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3700009b30 con 0x7f370815cc30 2023-11-20T07:00:30.719 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f37077fe640 1 --2- 172.21.15.175:0/1364268053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37080d1fa0 0x7f3708147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:00:30.719 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f370ca9e640 1 --2- 172.21.15.175:0/1364268053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f370815cc30 0x7f37080c9c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f370001a610 tx=0x7f3700019780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:30.719 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f3704ff9640 1 -- 172.21.15.175:0/1364268053 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37000b8880 con 0x7f370815cc30 2023-11-20T07:00:30.719 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f3704ff9640 1 -- 172.21.15.175:0/1364268053 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37000b89e0 con 0x7f370815cc30 2023-11-20T07:00:30.719 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f370e501640 1 -- 172.21.15.175:0/1364268053 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37080c69b0 con 0x7f370815cc30 2023-11-20T07:00:30.720 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f3704ff9640 1 -- 172.21.15.175:0/1364268053 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37000b8d90 con 0x7f370815cc30 2023-11-20T07:00:30.720 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f370e501640 1 -- 172.21.15.175:0/1364268053 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3708149070 con 0x7f370815cc30 2023-11-20T07:00:30.720 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f3704ff9640 1 -- 172.21.15.175:0/1364268053 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f37000c1400 con 0x7f370815cc30 2023-11-20T07:00:30.720 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f3704ff9640 1 -- 172.21.15.175:0/1364268053 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f37000b69c0 con 0x7f370815cc30 2023-11-20T07:00:30.720 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.719+0000 7f370e501640 1 -- 172.21.15.175:0/1364268053 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37080c6ed0 con 0x7f370815cc30 2023-11-20T07:00:30.721 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.723+0000 7f3704ff9640 1 -- 172.21.15.175:0/1364268053 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f37080c6ed0 con 0x7f370815cc30 2023-11-20T07:00:30.765 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:30.766+0000 7f86cc418180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-20T07:00:30.788 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.787+0000 7f370e501640 1 -- 172.21.15.175:0/1364268053 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "58ab5ad7-804b-44b6-9209-64921fc69496", "id": 5} v 0) v1 -- 0x7f3708067230 con 0x7f370815cc30 2023-11-20T07:00:30.793 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.795+0000 7f3704ff9640 1 -- 172.21.15.175:0/1364268053 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58ab5ad7-804b-44b6-9209-64921fc69496", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f37000bc020 con 0x7f370815cc30 2023-11-20T07:00:30.794 INFO:teuthology.orchestra.run.smithi175.stdout:5 2023-11-20T07:00:30.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.795+0000 7f370e501640 1 -- 172.21.15.175:0/1364268053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f370815cc30 msgr2=0x7f37080c9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.795+0000 7f370e501640 1 --2- 172.21.15.175:0/1364268053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f370815cc30 0x7f37080c9c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f370001a610 tx=0x7f3700019780 comp rx=0 tx=0).stop 2023-11-20T07:00:30.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.795+0000 7f370e501640 1 -- 172.21.15.175:0/1364268053 shutdown_connections 2023-11-20T07:00:30.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.795+0000 7f370e501640 1 --2- 172.21.15.175:0/1364268053 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f370815cc30 0x7f37080c9c40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.795+0000 7f370e501640 1 --2- 172.21.15.175:0/1364268053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37080d1fa0 0x7f3708147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.795+0000 7f370e501640 1 --2- 172.21.15.175:0/1364268053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37080cd840 0x7f370815fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.795+0000 7f370e501640 1 -- 172.21.15.175:0/1364268053 >> 172.21.15.175:0/1364268053 conn(0x7f370806b750 msgr2=0x7f370815b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:30.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.795+0000 7f370e501640 1 -- 172.21.15.175:0/1364268053 shutdown_connections 2023-11-20T07:00:30.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.795+0000 7f370e501640 1 -- 172.21.15.175:0/1364268053 wait complete. 2023-11-20T07:00:30.797 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:30.799+0000 7f184f6db180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-20T07:00:30.813 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 0a85757d-53b7-45c3-85a3-f52a00a1c6ce 6 2023-11-20T07:00:30.868 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:30.867+0000 7f184f6db180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-20T07:00:30.922 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:30.922+0000 7f86cc418180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-20T07:00:30.949 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9dcb0f640 1 Processor -- start 2023-11-20T07:00:30.950 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9dcb0f640 1 -- start start 2023-11-20T07:00:30.952 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9dcb0f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9d815cc30 0x7fb9d80b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.952 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9dcb0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d80cd840 0x7fb9d80cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.952 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9dcb0f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d815d010 con 0x7fb9d80d0f90 2023-11-20T07:00:30.952 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9dcb0f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d80b74d0 con 0x7fb9d815cc30 2023-11-20T07:00:30.952 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9dcb0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80b77b0 con 0x7fb9d80cd840 2023-11-20T07:00:30.952 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9d5d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d80cd840 0x7fb9d80cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.953 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9d6d9d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb9d80d0f90 0x7fb9d80d13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53194/0 (socket says 172.21.15.175:53194) 2023-11-20T07:00:30.953 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9d6d9d640 1 -- 172.21.15.175:0/3257453325 learned_addr learned my addr 172.21.15.175:0/3257453325 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-11-20T07:00:30.953 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9d659c640 1 --2- 172.21.15.175:0/3257453325 >> v2:172.21.15.88:3300/0 conn(0x7fb9d815cc30 0x7fb9d80b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.953 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9d559a640 1 -- 172.21.15.175:0/3257453325 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566612037 0 0) 0x7fb9d815d010 con 0x7fb9d80d0f90 2023-11-20T07:00:30.953 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9d5d9b640 1 -- 172.21.15.175:0/3257453325 >> v2:172.21.15.88:3300/0 conn(0x7fb9d815cc30 msgr2=0x7fb9d80b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:30.954 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9d5d9b640 1 --2- 172.21.15.175:0/3257453325 >> v2:172.21.15.88:3300/0 conn(0x7fb9d815cc30 0x7fb9d80b8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.954 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9d5d9b640 1 -- 172.21.15.175:0/3257453325 >> v1:172.21.15.175:6789/0 conn(0x7fb9d80d0f90 legacy=0x7fb9d80d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.954 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.951+0000 7fb9d5d9b640 1 -- 172.21.15.175:0/3257453325 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80b7a90 con 0x7fb9d80cd840 2023-11-20T07:00:30.955 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.955+0000 7fb9d5d9b640 1 --2- 172.21.15.175:0/3257453325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d80cd840 0x7fb9d80cdc80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097c0 tx=0x7fb9cc01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d5aba3c698937f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:30.956 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.955+0000 7fb9d559a640 1 -- 172.21.15.175:0/3257453325 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0a8970 con 0x7fb9d80cd840 2023-11-20T07:00:30.956 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.955+0000 7fb9d559a640 1 -- 172.21.15.175:0/3257453325 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc0a8ad0 con 0x7fb9d80cd840 2023-11-20T07:00:30.956 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.955+0000 7fb9d559a640 1 -- 172.21.15.175:0/3257453325 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0a8e60 con 0x7fb9d80cd840 2023-11-20T07:00:30.956 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.955+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/3257453325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d80cd840 msgr2=0x7fb9d80cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.956 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.955+0000 7fb9dcb0f640 1 --2- 172.21.15.175:0/3257453325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d80cd840 0x7fb9d80cdc80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097c0 tx=0x7fb9cc01ec70 comp rx=0 tx=0).stop 2023-11-20T07:00:30.957 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.955+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/3257453325 shutdown_connections 2023-11-20T07:00:30.957 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.955+0000 7fb9dcb0f640 1 --2- 172.21.15.175:0/3257453325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d80cd840 0x7fb9d80cdc80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.957 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.955+0000 7fb9dcb0f640 1 --2- 172.21.15.175:0/3257453325 >> v2:172.21.15.88:3300/0 conn(0x7fb9d815cc30 0x7fb9d80b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.957 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.955+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/3257453325 >> 172.21.15.175:0/3257453325 conn(0x7fb9d806b750 msgr2=0x7fb9d806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:30.958 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/3257453325 shutdown_connections 2023-11-20T07:00:30.958 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/3257453325 wait complete. 2023-11-20T07:00:30.958 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9dcb0f640 1 Processor -- start 2023-11-20T07:00:30.959 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9dcb0f640 1 -- start start 2023-11-20T07:00:30.960 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9dcb0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9d80cd840 0x7fb9d814e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.960 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9dcb0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d80d0f90 0x7fb9d81f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.960 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9dcb0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9d815cc30 0x7fb9d80cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:30.961 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9dcb0f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d81f5f10 con 0x7fb9d815cc30 2023-11-20T07:00:30.961 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9dcb0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80c8e00 con 0x7fb9d80cd840 2023-11-20T07:00:30.961 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9dcb0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80c90e0 con 0x7fb9d80d0f90 2023-11-20T07:00:30.961 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9d659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9d80cd840 0x7fb9d814e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.961 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9d5d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d80d0f90 0x7fb9d81f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.961 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9d659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9d80cd840 0x7fb9d814e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38262/0 (socket says 172.21.15.175:38262) 2023-11-20T07:00:30.961 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9d659c640 1 -- 172.21.15.175:0/321018744 learned_addr learned my addr 172.21.15.175:0/321018744 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:30.961 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9d6d9d640 1 --2- 172.21.15.175:0/321018744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9d815cc30 0x7fb9d80cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:30.961 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9d5d9b640 1 -- 172.21.15.175:0/321018744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9d80cd840 msgr2=0x7fb9d814e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.961 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9d5d9b640 1 --2- 172.21.15.175:0/321018744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9d80cd840 0x7fb9d814e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.962 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9d5d9b640 1 -- 172.21.15.175:0/321018744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9d815cc30 msgr2=0x7fb9d80cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:30.962 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9d5d9b640 1 --2- 172.21.15.175:0/321018744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9d815cc30 0x7fb9d80cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:30.962 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9d5d9b640 1 -- 172.21.15.175:0/321018744 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc009420 con 0x7fb9d80d0f90 2023-11-20T07:00:30.963 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.959+0000 7fb9d5d9b640 1 --2- 172.21.15.175:0/321018744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d80d0f90 0x7fb9d81f63a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0af000 tx=0x7fb9cc01ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:30.963 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.963+0000 7fb9c6ffd640 1 -- 172.21.15.175:0/321018744 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0be070 con 0x7fb9d80d0f90 2023-11-20T07:00:30.963 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.963+0000 7fb9c6ffd640 1 -- 172.21.15.175:0/321018744 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc0b9430 con 0x7fb9d80d0f90 2023-11-20T07:00:30.963 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.963+0000 7fb9c6ffd640 1 -- 172.21.15.175:0/321018744 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0b97e0 con 0x7fb9d80d0f90 2023-11-20T07:00:30.963 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.963+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/321018744 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d80c93c0 con 0x7fb9d80d0f90 2023-11-20T07:00:30.964 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.963+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/321018744 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d814e5f0 con 0x7fb9d80d0f90 2023-11-20T07:00:30.964 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.963+0000 7fb9c6ffd640 1 -- 172.21.15.175:0/321018744 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb9cc0b7040 con 0x7fb9d80d0f90 2023-11-20T07:00:30.964 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.963+0000 7fb9c6ffd640 1 -- 172.21.15.175:0/321018744 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb9cc0b9c40 con 0x7fb9d80d0f90 2023-11-20T07:00:30.964 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.963+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/321018744 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d81f6080 con 0x7fb9d80d0f90 2023-11-20T07:00:30.964 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:30.963+0000 7fb9c6ffd640 1 -- 172.21.15.175:0/321018744 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb9cc0b5070 con 0x7fb9d80d0f90 2023-11-20T07:00:30.991 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:30.990+0000 7f86cc418180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-20T07:00:31.030 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.031+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/321018744 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0a85757d-53b7-45c3-85a3-f52a00a1c6ce", "id": 6} v 0) v1 -- 0x7fb9d80c9220 con 0x7fb9d80d0f90 2023-11-20T07:00:31.036 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.035+0000 7fb9c6ffd640 1 -- 172.21.15.175:0/321018744 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0a85757d-53b7-45c3-85a3-f52a00a1c6ce", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb9d80c9220 con 0x7fb9d80d0f90 2023-11-20T07:00:31.036 INFO:teuthology.orchestra.run.smithi175.stdout:6 2023-11-20T07:00:31.037 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.039+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/321018744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d80d0f90 msgr2=0x7fb9d81f63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:31.037 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.039+0000 7fb9dcb0f640 1 --2- 172.21.15.175:0/321018744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d80d0f90 0x7fb9d81f63a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0af000 tx=0x7fb9cc01ba10 comp rx=0 tx=0).stop 2023-11-20T07:00:31.037 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.039+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/321018744 shutdown_connections 2023-11-20T07:00:31.038 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.039+0000 7fb9dcb0f640 1 --2- 172.21.15.175:0/321018744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d80d0f90 0x7fb9d81f63a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.038 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.039+0000 7fb9dcb0f640 1 --2- 172.21.15.175:0/321018744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9d815cc30 0x7fb9d80cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.038 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.039+0000 7fb9dcb0f640 1 --2- 172.21.15.175:0/321018744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9d80cd840 0x7fb9d814e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.038 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.039+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/321018744 >> 172.21.15.175:0/321018744 conn(0x7fb9d806b750 msgr2=0x7fb9d80b64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:31.038 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.039+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/321018744 shutdown_connections 2023-11-20T07:00:31.038 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.039+0000 7fb9dcb0f640 1 -- 172.21.15.175:0/321018744 wait complete. 2023-11-20T07:00:31.056 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new fff942b3-009a-4852-a4d6-acecc60cf2bd 7 2023-11-20T07:00:31.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.223+0000 7fc94dd8c640 1 Processor -- start 2023-11-20T07:00:31.223 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.223+0000 7fc94dd8c640 1 -- start start 2023-11-20T07:00:31.224 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.223+0000 7fc94dd8c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc94815ca80 0x7fc9480cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:31.224 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.223+0000 7fc94dd8c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9480cd740 0x7fc9480d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:31.225 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.223+0000 7fc94dd8c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94815ce60 con 0x7fc9480d2b80 2023-11-20T07:00:31.225 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.223+0000 7fc94dd8c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94806b310 con 0x7fc9480cd740 2023-11-20T07:00:31.225 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.223+0000 7fc94dd8c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94806b5f0 con 0x7fc94815ca80 2023-11-20T07:00:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.227+0000 7fc947fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9480cd740 0x7fc9480d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.227+0000 7fc947fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9480cd740 0x7fc9480d2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.175:42176/0 (socket says 172.21.15.175:42176) 2023-11-20T07:00:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.227+0000 7fc947fff640 1 -- 172.21.15.175:0/3988226015 learned_addr learned my addr 172.21.15.175:0/3988226015 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.227+0000 7fc94cd8a640 1 --2- 172.21.15.175:0/3988226015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc94815ca80 0x7fc9480cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.227+0000 7fc947fff640 1 -- 172.21.15.175:0/3988226015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc94815ca80 msgr2=0x7fc9480cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.227+0000 7fc947fff640 1 --2- 172.21.15.175:0/3988226015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc94815ca80 0x7fc9480cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.227+0000 7fc947fff640 1 -- 172.21.15.175:0/3988226015 >> v1:172.21.15.175:6789/0 conn(0x7fc9480d2b80 legacy=0x7fc9480d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.227+0000 7fc947fff640 1 -- 172.21.15.175:0/3988226015 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480cf160 con 0x7fc9480cd740 2023-11-20T07:00:31.234 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.235+0000 7fc947fff640 1 --2- 172.21.15.175:0/3988226015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9480cd740 0x7fc9480d2640 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009870 tx=0x7fc93c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5624b489af002cda server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:31.234 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.235+0000 7fc9477fe640 1 -- 172.21.15.175:0/3988226015 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0aa430 con 0x7fc9480cd740 2023-11-20T07:00:31.235 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.235+0000 7fc9477fe640 1 -- 172.21.15.175:0/3988226015 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c0aa590 con 0x7fc9480cd740 2023-11-20T07:00:31.235 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.235+0000 7fc9477fe640 1 -- 172.21.15.175:0/3988226015 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0aa960 con 0x7fc9480cd740 2023-11-20T07:00:31.236 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.235+0000 7fc94dd8c640 1 -- 172.21.15.175:0/3988226015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9480cd740 msgr2=0x7fc9480d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:31.236 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.235+0000 7fc94dd8c640 1 --2- 172.21.15.175:0/3988226015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9480cd740 0x7fc9480d2640 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009870 tx=0x7fc93c01c4d0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.236 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.235+0000 7fc94dd8c640 1 -- 172.21.15.175:0/3988226015 shutdown_connections 2023-11-20T07:00:31.236 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.235+0000 7fc94dd8c640 1 --2- 172.21.15.175:0/3988226015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9480cd740 0x7fc9480d2640 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.237 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.235+0000 7fc94dd8c640 1 --2- 172.21.15.175:0/3988226015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc94815ca80 0x7fc9480cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.237 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.235+0000 7fc94dd8c640 1 -- 172.21.15.175:0/3988226015 >> 172.21.15.175:0/3988226015 conn(0x7fc94808c230 msgr2=0x7fc94809bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:31.237 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.235+0000 7fc94dd8c640 1 -- 172.21.15.175:0/3988226015 shutdown_connections 2023-11-20T07:00:31.237 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.235+0000 7fc94dd8c640 1 -- 172.21.15.175:0/3988226015 wait complete. 2023-11-20T07:00:31.239 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.239+0000 7fc94dd8c640 1 Processor -- start 2023-11-20T07:00:31.241 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94dd8c640 1 -- start start 2023-11-20T07:00:31.242 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94dd8c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480cd740 0x7fc948156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:31.242 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94dd8c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9480d2b80 0x7fc9480cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:31.243 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94dd8c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc94815ca80 0x7fc9481579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:31.243 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94dd8c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948156750 con 0x7fc9480d2b80 2023-11-20T07:00:31.243 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94dd8c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948156400 con 0x7fc94815ca80 2023-11-20T07:00:31.243 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94dd8c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc948158420 con 0x7fc9480cd740 2023-11-20T07:00:31.243 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94cd8a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480cd740 0x7fc948156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:31.243 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94cd8a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480cd740 0x7fc948156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:55372/0 (socket says 172.21.15.175:55372) 2023-11-20T07:00:31.243 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94cd8a640 1 -- 172.21.15.175:0/1538905234 learned_addr learned my addr 172.21.15.175:0/1538905234 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-20T07:00:31.244 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc947fff640 1 --2- 172.21.15.175:0/1538905234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9480d2b80 0x7fc9480cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:31.244 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94d58b640 1 --2- 172.21.15.175:0/1538905234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc94815ca80 0x7fc9481579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:31.245 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94cd8a640 1 -- 172.21.15.175:0/1538905234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc94815ca80 msgr2=0x7fc9481579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:31.245 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94cd8a640 1 --2- 172.21.15.175:0/1538905234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc94815ca80 0x7fc9481579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.245 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94cd8a640 1 -- 172.21.15.175:0/1538905234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9480d2b80 msgr2=0x7fc9480cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:31.245 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94cd8a640 1 --2- 172.21.15.175:0/1538905234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9480d2b80 0x7fc9480cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.245 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94cd8a640 1 -- 172.21.15.175:0/1538905234 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c0094d0 con 0x7fc9480cd740 2023-11-20T07:00:31.245 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc947fff640 1 --2- 172.21.15.175:0/1538905234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9480d2b80 0x7fc9480cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:00:31.245 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94d58b640 1 --2- 172.21.15.175:0/1538905234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc94815ca80 0x7fc9481579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:00:31.245 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94cd8a640 1 --2- 172.21.15.175:0/1538905234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480cd740 0x7fc948156b70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc93800ebe0 tx=0x7fc93800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:31.246 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc9457fa640 1 -- 172.21.15.175:0/1538905234 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9380095d0 con 0x7fc9480cd740 2023-11-20T07:00:31.246 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc9457fa640 1 -- 172.21.15.175:0/1538905234 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93800ed90 con 0x7fc9480cd740 2023-11-20T07:00:31.246 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc9457fa640 1 -- 172.21.15.175:0/1538905234 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93800ce30 con 0x7fc9480cd740 2023-11-20T07:00:31.246 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94dd8c640 1 -- 172.21.15.175:0/1538905234 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc948158700 con 0x7fc9480cd740 2023-11-20T07:00:31.246 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc94dd8c640 1 -- 172.21.15.175:0/1538905234 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9481570b0 con 0x7fc9480cd740 2023-11-20T07:00:31.246 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.243+0000 7fc9457fa640 1 -- 172.21.15.175:0/1538905234 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc938013770 con 0x7fc9480cd740 2023-11-20T07:00:31.246 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.247+0000 7fc9457fa640 1 -- 172.21.15.175:0/1538905234 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fc938013a20 con 0x7fc9480cd740 2023-11-20T07:00:31.246 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.247+0000 7fc94dd8c640 1 -- 172.21.15.175:0/1538905234 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94804e9c0 con 0x7fc9480cd740 2023-11-20T07:00:31.247 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.247+0000 7fc9457fa640 1 -- 172.21.15.175:0/1538905234 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc938021060 con 0x7fc9480cd740 2023-11-20T07:00:31.312 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.311+0000 7fc94dd8c640 1 -- 172.21.15.175:0/1538905234 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fff942b3-009a-4852-a4d6-acecc60cf2bd", "id": 7} v 0) v1 -- 0x7fc9480cfa20 con 0x7fc9480cd740 2023-11-20T07:00:31.318 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.319+0000 7fc9457fa640 1 -- 172.21.15.175:0/1538905234 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fff942b3-009a-4852-a4d6-acecc60cf2bd", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc938017070 con 0x7fc9480cd740 2023-11-20T07:00:31.319 INFO:teuthology.orchestra.run.smithi175.stdout:7 2023-11-20T07:00:31.320 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.319+0000 7fc94dd8c640 1 -- 172.21.15.175:0/1538905234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480cd740 msgr2=0x7fc948156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:31.320 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.319+0000 7fc94dd8c640 1 --2- 172.21.15.175:0/1538905234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480cd740 0x7fc948156b70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc93800ebe0 tx=0x7fc93800c520 comp rx=0 tx=0).stop 2023-11-20T07:00:31.320 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.319+0000 7fc94dd8c640 1 -- 172.21.15.175:0/1538905234 shutdown_connections 2023-11-20T07:00:31.320 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.319+0000 7fc94dd8c640 1 --2- 172.21.15.175:0/1538905234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc94815ca80 0x7fc9481579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.320 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.319+0000 7fc94dd8c640 1 --2- 172.21.15.175:0/1538905234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9480d2b80 0x7fc9480cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.320 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.319+0000 7fc94dd8c640 1 --2- 172.21.15.175:0/1538905234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9480cd740 0x7fc948156b70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.320 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.319+0000 7fc94dd8c640 1 -- 172.21.15.175:0/1538905234 >> 172.21.15.175:0/1538905234 conn(0x7fc94808c230 msgr2=0x7fc948158dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:31.320 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.319+0000 7fc94dd8c640 1 -- 172.21.15.175:0/1538905234 shutdown_connections 2023-11-20T07:00:31.320 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:00:31.319+0000 7fc94dd8c640 1 -- 172.21.15.175:0/1538905234 wait complete. 2023-11-20T07:00:31.338 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-20T07:00:31.338 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-20T07:00:31.344 INFO:tasks.ceph.osd.0:Started 2023-11-20T07:00:31.344 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-20T07:00:31.344 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-20T07:00:31.353 INFO:tasks.ceph.osd.1:Started 2023-11-20T07:00:31.354 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-20T07:00:31.354 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-20T07:00:31.374 INFO:tasks.ceph.osd.2:Started 2023-11-20T07:00:31.374 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-20T07:00:31.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-20T07:00:31.385 INFO:tasks.ceph.osd.3:Started 2023-11-20T07:00:31.385 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-20T07:00:31.385 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-20T07:00:31.389 INFO:tasks.ceph.osd.4:Started 2023-11-20T07:00:31.389 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-20T07:00:31.389 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-20T07:00:31.393 INFO:tasks.ceph.osd.5:Started 2023-11-20T07:00:31.393 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-20T07:00:31.393 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-20T07:00:31.397 INFO:tasks.ceph.osd.6:Started 2023-11-20T07:00:31.397 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-20T07:00:31.397 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-20T07:00:31.400 INFO:tasks.ceph.osd.7:Started 2023-11-20T07:00:31.401 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:00:31.488 INFO:tasks.ceph.mgr.x.smithi175.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-20T07:00:31.489 INFO:tasks.ceph.mgr.x.smithi175.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-20T07:00:31.489 INFO:tasks.ceph.mgr.x.smithi175.stderr: from numpy import show_config as show_numpy_config 2023-11-20T07:00:31.553 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:31.551+0000 7f184f6db180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-20T07:00:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.558+0000 7f9d9e13e640 1 Processor -- start 2023-11-20T07:00:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.558+0000 7f9d9e13e640 1 -- start start 2023-11-20T07:00:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.562+0000 7f9d9e13e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d9815cf00 0x7f9d980cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.562+0000 7f9d9e13e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d980ce340 con 0x7f9d980d1410 2023-11-20T07:00:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.562+0000 7f9d9e13e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d980d1930 con 0x7f9d980cdee0 2023-11-20T07:00:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.562+0000 7f9d9e13e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9815d2e0 con 0x7f9d9815cf00 2023-11-20T07:00:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.562+0000 7f9d977fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d9815cf00 0x7f9d980cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.562+0000 7f9d97fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9d980d1410 0x7f9d980b6650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50348/0 (socket says 172.21.15.88:50348) 2023-11-20T07:00:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.562+0000 7f9d97fff640 1 -- 172.21.15.88:0/2903953749 learned_addr learned my addr 172.21.15.88:0/2903953749 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:00:31.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.562+0000 7f9d977fe640 1 -- 172.21.15.88:0/2903953749 >> v1:172.21.15.175:6789/0 conn(0x7f9d980cdee0 legacy=0x7f9d980d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:31.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.562+0000 7f9d977fe640 1 -- 172.21.15.88:0/2903953749 >> v1:172.21.15.88:6789/0 conn(0x7f9d980d1410 legacy=0x7f9d980b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:31.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.562+0000 7f9d977fe640 1 -- 172.21.15.88:0/2903953749 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d980d1c10 con 0x7f9d9815cf00 2023-11-20T07:00:31.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d977fe640 1 --2- 172.21.15.88:0/2903953749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d9815cf00 0x7f9d980cd9a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d880097c0 tx=0x7f9d8801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9bb50a88a90f48 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:31.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d967fc640 1 -- 172.21.15.88:0/2903953749 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d880ab5f0 con 0x7f9d9815cf00 2023-11-20T07:00:31.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d967fc640 1 -- 172.21.15.88:0/2903953749 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d880ab750 con 0x7f9d9815cf00 2023-11-20T07:00:31.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d967fc640 1 -- 172.21.15.88:0/2903953749 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d880abae0 con 0x7f9d9815cf00 2023-11-20T07:00:31.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 -- 172.21.15.88:0/2903953749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d9815cf00 msgr2=0x7f9d980cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:31.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 --2- 172.21.15.88:0/2903953749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d9815cf00 0x7f9d980cd9a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d880097c0 tx=0x7f9d8801c3f0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 -- 172.21.15.88:0/2903953749 shutdown_connections 2023-11-20T07:00:31.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 --2- 172.21.15.88:0/2903953749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d9815cf00 0x7f9d980cd9a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 -- 172.21.15.88:0/2903953749 >> 172.21.15.88:0/2903953749 conn(0x7f9d980b4470 msgr2=0x7f9d980b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 -- 172.21.15.88:0/2903953749 shutdown_connections 2023-11-20T07:00:31.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 -- 172.21.15.88:0/2903953749 wait complete. 2023-11-20T07:00:31.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 Processor -- start 2023-11-20T07:00:31.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 -- start start 2023-11-20T07:00:31.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d980cdee0 0x7f9d980cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:31.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d980d1410 0x7f9d980c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:31.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d9815cf00 0x7f9d981484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:31.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d980c8d10 con 0x7f9d980d1410 2023-11-20T07:00:31.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d981591c0 con 0x7f9d980cdee0 2023-11-20T07:00:31.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.566+0000 7f9d9e13e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9815b700 con 0x7f9d9815cf00 2023-11-20T07:00:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d96ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d980d1410 0x7f9d980c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d96ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d980d1410 0x7f9d980c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53082/0 (socket says 172.21.15.88:53082) 2023-11-20T07:00:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d96ffd640 1 -- 172.21.15.88:0/1329266005 learned_addr learned my addr 172.21.15.88:0/1329266005 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d97fff640 1 --2- 172.21.15.88:0/1329266005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d9815cf00 0x7f9d981484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d977fe640 1 --2- 172.21.15.88:0/1329266005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d980cdee0 0x7f9d980cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d96ffd640 1 -- 172.21.15.88:0/1329266005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d9815cf00 msgr2=0x7f9d981484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d96ffd640 1 --2- 172.21.15.88:0/1329266005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d9815cf00 0x7f9d981484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d96ffd640 1 -- 172.21.15.88:0/1329266005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d980cdee0 msgr2=0x7f9d980cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d96ffd640 1 --2- 172.21.15.88:0/1329266005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d980cdee0 0x7f9d980cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d96ffd640 1 -- 172.21.15.88:0/1329266005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88009420 con 0x7f9d980d1410 2023-11-20T07:00:31.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d97fff640 1 --2- 172.21.15.88:0/1329266005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d9815cf00 0x7f9d981484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:00:31.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d977fe640 1 --2- 172.21.15.88:0/1329266005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d980cdee0 0x7f9d980cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:00:31.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d96ffd640 1 --2- 172.21.15.88:0/1329266005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d980d1410 0x7f9d980c87d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00c530 tx=0x7f9d8c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:31.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d7ffff640 1 -- 172.21.15.88:0/1329266005 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c005220 con 0x7f9d980d1410 2023-11-20T07:00:31.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d7ffff640 1 -- 172.21.15.88:0/1329266005 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c005380 con 0x7f9d980d1410 2023-11-20T07:00:31.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d7ffff640 1 -- 172.21.15.88:0/1329266005 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c007270 con 0x7f9d980d1410 2023-11-20T07:00:31.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d9e13e640 1 -- 172.21.15.88:0/1329266005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9815b980 con 0x7f9d980d1410 2023-11-20T07:00:31.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d7ffff640 1 -- 172.21.15.88:0/1329266005 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9d8c0067e0 con 0x7f9d980d1410 2023-11-20T07:00:31.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d9e13e640 1 -- 172.21.15.88:0/1329266005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d980caee0 con 0x7f9d980d1410 2023-11-20T07:00:31.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d7ffff640 1 -- 172.21.15.88:0/1329266005 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9d8c012630 con 0x7f9d980d1410 2023-11-20T07:00:31.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.570+0000 7f9d9e13e640 1 -- 172.21.15.88:0/1329266005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d980cb100 con 0x7f9d980d1410 2023-11-20T07:00:31.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.574+0000 7f9d7ffff640 1 -- 172.21.15.88:0/1329266005 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9d8c016020 con 0x7f9d980d1410 2023-11-20T07:00:31.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.630+0000 7f9d9e13e640 1 -- 172.21.15.88:0/1329266005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d98074010 con 0x7f9d980d1410 2023-11-20T07:00:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.630+0000 7f9d7ffff640 1 -- 172.21.15.88:0/1329266005 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9d8c02a090 con 0x7f9d980d1410 2023-11-20T07:00:31.631 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:00:31.632 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:31.315058+0000","last_up_change":"0.000000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:00:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.630+0000 7f9d9e13e640 1 -- 172.21.15.88:0/1329266005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d980d1410 msgr2=0x7f9d980c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.630+0000 7f9d9e13e640 1 --2- 172.21.15.88:0/1329266005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d980d1410 0x7f9d980c87d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00c530 tx=0x7f9d8c00c9f0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.630+0000 7f9d9e13e640 1 -- 172.21.15.88:0/1329266005 shutdown_connections 2023-11-20T07:00:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.630+0000 7f9d9e13e640 1 --2- 172.21.15.88:0/1329266005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d9815cf00 0x7f9d981484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.630+0000 7f9d9e13e640 1 --2- 172.21.15.88:0/1329266005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d980d1410 0x7f9d980c87d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.630+0000 7f9d9e13e640 1 --2- 172.21.15.88:0/1329266005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d980cdee0 0x7f9d980cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.630+0000 7f9d9e13e640 1 -- 172.21.15.88:0/1329266005 >> 172.21.15.88:0/1329266005 conn(0x7f9d980b4470 msgr2=0x7f9d980b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.630+0000 7f9d9e13e640 1 -- 172.21.15.88:0/1329266005 shutdown_connections 2023-11-20T07:00:31.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:31.630+0000 7f9d9e13e640 1 -- 172.21.15.88:0/1329266005 wait complete. 2023-11-20T07:00:31.651 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-20T07:00:31.651 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-20T07:00:31.672 INFO:tasks.ceph.mgr.y.smithi088.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-20T07:00:31.672 INFO:tasks.ceph.mgr.y.smithi088.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-20T07:00:31.672 INFO:tasks.ceph.mgr.y.smithi088.stderr: from numpy import show_config as show_numpy_config 2023-11-20T07:00:31.687 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:31.687+0000 7f184f6db180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-20T07:00:31.720 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:31.718+0000 7f86cc418180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-20T07:00:31.855 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:31.854+0000 7f86cc418180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-20T07:00:31.868 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:31.867+0000 7f184f6db180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-20T07:00:31.940 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:31.939+0000 7f184f6db180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-20T07:00:32.035 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-11-20T07:00:32.034+0000 7fef51804640 -1 Falling back to public interface 2023-11-20T07:00:32.039 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:32.038+0000 7f86cc418180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-20T07:00:32.042 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-11-20T07:00:32.043+0000 7f4c9bee0640 -1 Falling back to public interface 2023-11-20T07:00:32.054 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-11-20T07:00:32.055+0000 7f981e62b640 -1 Falling back to public interface 2023-11-20T07:00:32.054 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-11-20T07:00:32.055+0000 7f502b287640 -1 Falling back to public interface 2023-11-20T07:00:32.054 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-11-20T07:00:32.054+0000 7f8db3dc6640 -1 Falling back to public interface 2023-11-20T07:00:32.058 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-11-20T07:00:32.059+0000 7f0ec88ae640 -1 Falling back to public interface 2023-11-20T07:00:32.066 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-11-20T07:00:32.066+0000 7f40af048640 -1 Falling back to public interface 2023-11-20T07:00:32.070 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-11-20T07:00:32.070+0000 7f0bb53ef640 -1 Falling back to public interface 2023-11-20T07:00:32.087 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:32.087+0000 7f184f6db180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-20T07:00:32.120 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:32.118+0000 7f86cc418180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-20T07:00:32.257 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:32.254+0000 7f86cc418180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-20T07:00:32.456 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-20T07:00:32.586 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff9a05d3640 1 Processor -- start 2023-11-20T07:00:32.586 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff9a05d3640 1 -- start start 2023-11-20T07:00:32.587 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff9a05d3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff99815ddb0 0x7ff998160670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:32.587 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff9a05d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9980b0680 0x7ff998160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:32.587 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff9a05d3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff998070210 con 0x7ff99815cb60 2023-11-20T07:00:32.588 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff9a05d3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99815d920 con 0x7ff99815ddb0 2023-11-20T07:00:32.588 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff9a05d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9981610f0 con 0x7ff9980b0680 2023-11-20T07:00:32.588 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff99e36f640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff99815cb60 0x7ff9980aff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:50352/0 (socket says 172.21.15.88:50352) 2023-11-20T07:00:32.588 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff99e36f640 1 -- 172.21.15.88:0/3263359241 learned_addr learned my addr 172.21.15.88:0/3263359241 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:00:32.588 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff99eb70640 1 --2- 172.21.15.88:0/3263359241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9980b0680 0x7ff998160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:32.588 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff99db6e640 1 --2- 172.21.15.88:0/3263359241 >> v2:172.21.15.175:3300/0 conn(0x7ff99815ddb0 0x7ff998160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:32.589 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff99d36d640 1 -- 172.21.15.88:0/3263359241 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856909946 0 0) 0x7ff998070210 con 0x7ff99815cb60 2023-11-20T07:00:32.589 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff99d36d640 1 -- 172.21.15.88:0/3263359241 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff984003530 con 0x7ff99815cb60 2023-11-20T07:00:32.589 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff99eb70640 1 -- 172.21.15.88:0/3263359241 >> v2:172.21.15.175:3300/0 conn(0x7ff99815ddb0 msgr2=0x7ff998160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:32.589 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff99eb70640 1 --2- 172.21.15.88:0/3263359241 >> v2:172.21.15.175:3300/0 conn(0x7ff99815ddb0 0x7ff998160670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:32.589 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff99eb70640 1 -- 172.21.15.88:0/3263359241 >> v1:172.21.15.88:6789/0 conn(0x7ff99815cb60 legacy=0x7ff9980aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:32.589 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.586+0000 7ff99eb70640 1 -- 172.21.15.88:0/3263359241 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9981613c0 con 0x7ff9980b0680 2023-11-20T07:00:32.592 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.590+0000 7ff99eb70640 1 --2- 172.21.15.88:0/3263359241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9980b0680 0x7ff998160bb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff990009d90 tx=0x7ff99001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f48a6cf385dced1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:32.593 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.590+0000 7ff99d36d640 1 -- 172.21.15.88:0/3263359241 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900a58d0 con 0x7ff9980b0680 2023-11-20T07:00:32.593 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.590+0000 7ff99d36d640 1 -- 172.21.15.88:0/3263359241 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9900a5a30 con 0x7ff9980b0680 2023-11-20T07:00:32.593 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.590+0000 7ff99d36d640 1 -- 172.21.15.88:0/3263359241 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900a5dc0 con 0x7ff9980b0680 2023-11-20T07:00:32.594 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 -- 172.21.15.88:0/3263359241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9980b0680 msgr2=0x7ff998160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:32.594 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 --2- 172.21.15.88:0/3263359241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9980b0680 0x7ff998160bb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff990009d90 tx=0x7ff99001c920 comp rx=0 tx=0).stop 2023-11-20T07:00:32.594 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 -- 172.21.15.88:0/3263359241 shutdown_connections 2023-11-20T07:00:32.595 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 --2- 172.21.15.88:0/3263359241 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9980b0680 0x7ff998160bb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:32.595 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 --2- 172.21.15.88:0/3263359241 >> v2:172.21.15.175:3300/0 conn(0x7ff99815ddb0 0x7ff998160670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:32.595 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 -- 172.21.15.88:0/3263359241 >> 172.21.15.88:0/3263359241 conn(0x7ff99806c1b0 msgr2=0x7ff99806c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:32.595 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 -- 172.21.15.88:0/3263359241 shutdown_connections 2023-11-20T07:00:32.595 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 -- 172.21.15.88:0/3263359241 wait complete. 2023-11-20T07:00:32.596 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 Processor -- start 2023-11-20T07:00:32.596 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 -- start start 2023-11-20T07:00:32.598 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9980b0680 0x7ff998157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:32.598 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff99815cb60 0x7ff99815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:32.598 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff99815ddb0 0x7ff9980af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:32.599 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff998160dd0 con 0x7ff9980b0680 2023-11-20T07:00:32.599 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980b3690 con 0x7ff99815cb60 2023-11-20T07:00:32.599 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff9a05d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9981582e0 con 0x7ff99815ddb0 2023-11-20T07:00:32.599 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff99e36f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9980b0680 0x7ff998157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:32.599 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff99e36f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9980b0680 0x7ff998157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53090/0 (socket says 172.21.15.88:53090) 2023-11-20T07:00:32.599 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff99e36f640 1 -- 172.21.15.88:0/2577650727 learned_addr learned my addr 172.21.15.88:0/2577650727 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:32.599 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.594+0000 7ff99eb70640 1 --2- 172.21.15.88:0/2577650727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff99815ddb0 0x7ff9980af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:32.599 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff99db6e640 1 --2- 172.21.15.88:0/2577650727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff99815cb60 0x7ff99815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:32.599 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff99e36f640 1 -- 172.21.15.88:0/2577650727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff99815ddb0 msgr2=0x7ff9980af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:32.599 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff99e36f640 1 --2- 172.21.15.88:0/2577650727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff99815ddb0 0x7ff9980af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:32.599 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff99e36f640 1 -- 172.21.15.88:0/2577650727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff99815cb60 msgr2=0x7ff99815a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:32.600 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff99e36f640 1 --2- 172.21.15.88:0/2577650727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff99815cb60 0x7ff99815a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:32.600 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff99e36f640 1 -- 172.21.15.88:0/2577650727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff990009a70 con 0x7ff9980b0680 2023-11-20T07:00:32.600 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff99e36f640 1 --2- 172.21.15.88:0/2577650727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9980b0680 0x7ff998157da0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff99400c4d0 tx=0x7ff99400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:32.600 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff98effd640 1 -- 172.21.15.88:0/2577650727 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994005cf0 con 0x7ff9980b0680 2023-11-20T07:00:32.600 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff98effd640 1 -- 172.21.15.88:0/2577650727 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff994005e50 con 0x7ff9980b0680 2023-11-20T07:00:32.600 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff98effd640 1 -- 172.21.15.88:0/2577650727 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994007270 con 0x7ff9980b0680 2023-11-20T07:00:32.600 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff9a05d3640 1 -- 172.21.15.88:0/2577650727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9980b2a80 con 0x7ff9980b0680 2023-11-20T07:00:32.600 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff9a05d3640 1 -- 172.21.15.88:0/2577650727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9980b3040 con 0x7ff9980b0680 2023-11-20T07:00:32.600 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff98effd640 1 -- 172.21.15.88:0/2577650727 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff99401c440 con 0x7ff9980b0680 2023-11-20T07:00:32.600 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff98effd640 1 -- 172.21.15.88:0/2577650727 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff99401cdc0 con 0x7ff9980b0680 2023-11-20T07:00:32.601 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.598+0000 7ff9a05d3640 1 -- 172.21.15.88:0/2577650727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9980b3800 con 0x7ff9980b0680 2023-11-20T07:00:32.601 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.602+0000 7ff98effd640 1 -- 172.21.15.88:0/2577650727 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff994021060 con 0x7ff9980b0680 2023-11-20T07:00:32.658 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.658+0000 7ff9a05d3640 1 -- 172.21.15.88:0/2577650727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff99804e170 con 0x7ff9980b0680 2023-11-20T07:00:32.658 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.658+0000 7ff98effd640 1 -- 172.21.15.88:0/2577650727 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff994017070 con 0x7ff9980b0680 2023-11-20T07:00:32.659 INFO:teuthology.misc.health.smithi088.stdout: 2023-11-20T07:00:32.659 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":10,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:31.315058+0000","last_up_change":"0.000000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:00:32.660 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.658+0000 7ff9a05d3640 1 -- 172.21.15.88:0/2577650727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9980b0680 msgr2=0x7ff998157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:32.660 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.658+0000 7ff9a05d3640 1 --2- 172.21.15.88:0/2577650727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9980b0680 0x7ff998157da0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff99400c4d0 tx=0x7ff99400c990 comp rx=0 tx=0).stop 2023-11-20T07:00:32.660 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.658+0000 7ff9a05d3640 1 -- 172.21.15.88:0/2577650727 shutdown_connections 2023-11-20T07:00:32.660 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.658+0000 7ff9a05d3640 1 --2- 172.21.15.88:0/2577650727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff99815ddb0 0x7ff9980af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:32.660 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.658+0000 7ff9a05d3640 1 --2- 172.21.15.88:0/2577650727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff99815cb60 0x7ff99815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:32.660 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.658+0000 7ff9a05d3640 1 --2- 172.21.15.88:0/2577650727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9980b0680 0x7ff998157da0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:32.660 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.658+0000 7ff9a05d3640 1 -- 172.21.15.88:0/2577650727 >> 172.21.15.88:0/2577650727 conn(0x7ff99806c1b0 msgr2=0x7ff99815f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:32.660 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.658+0000 7ff9a05d3640 1 -- 172.21.15.88:0/2577650727 shutdown_connections 2023-11-20T07:00:32.660 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:32.658+0000 7ff9a05d3640 1 -- 172.21.15.88:0/2577650727 wait complete. 2023-11-20T07:00:32.676 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-20T07:00:32.760 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:32.758+0000 7f184f6db180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-20T07:00:32.845 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:32.846+0000 7f184f6db180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-20T07:00:32.976 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:32.974+0000 7f86cc418180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-20T07:00:33.034 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:33.034+0000 7f184f6db180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-20T07:00:33.064 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:33.062+0000 7f86cc418180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-20T07:00:33.118 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:33.118+0000 7f184f6db180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-20T07:00:33.253 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:33.250+0000 7f86cc418180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-20T07:00:33.339 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:33.338+0000 7f86cc418180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-20T07:00:33.444 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:33.442+0000 7f184f6db180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-20T07:00:33.512 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:33.510+0000 7f184f6db180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-20T07:00:33.677 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:33.678+0000 7f86cc418180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-20T07:00:33.745 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-11-20T07:00:33.742+0000 7f86cc418180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-20T07:00:34.535 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:34.534+0000 7f17f6d53640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-20T07:00:34.535 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-20T07:00:34.534+0000 7f17f6d53640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-20T07:00:35.892 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-11-20T07:00:35.890+0000 7fef51804640 -1 osd.2 0 log_to_monitors true 2023-11-20T07:00:35.932 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-11-20T07:00:35.930+0000 7f4c9bee0640 -1 osd.4 0 log_to_monitors true 2023-11-20T07:00:36.035 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-11-20T07:00:36.034+0000 7f0bb53ef640 -1 osd.1 0 log_to_monitors true 2023-11-20T07:00:36.256 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-11-20T07:00:36.254+0000 7f8db3dc6640 -1 osd.0 0 log_to_monitors true 2023-11-20T07:00:36.295 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-11-20T07:00:36.294+0000 7f502b287640 -1 osd.5 0 log_to_monitors true 2023-11-20T07:00:36.323 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-11-20T07:00:36.322+0000 7f40af048640 -1 osd.3 0 log_to_monitors true 2023-11-20T07:00:36.342 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-11-20T07:00:36.342+0000 7f0ec88ae640 -1 osd.6 0 log_to_monitors true 2023-11-20T07:00:36.383 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-11-20T07:00:36.382+0000 7f981e62b640 -1 osd.7 0 log_to_monitors true 2023-11-20T07:00:39.483 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-20T07:00:39.699 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.698+0000 7f9052846640 1 Processor -- start 2023-11-20T07:00:39.699 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.698+0000 7f9052846640 1 -- start start 2023-11-20T07:00:39.700 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.698+0000 7f9052846640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 0x7f904c06b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:39.701 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.698+0000 7f9052846640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f904c06b980 0x7f904c0ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:39.701 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.698+0000 7f9052846640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f904c15ce40 0x7f904c0ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:39.701 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.698+0000 7f9052846640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904c0cfd50 con 0x7f904c15ce40 2023-11-20T07:00:39.702 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.698+0000 7f9052846640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904c0d0030 con 0x7f904c06b980 2023-11-20T07:00:39.702 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.698+0000 7f9052846640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0cd520 con 0x7f904c15ca60 2023-11-20T07:00:39.702 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.698+0000 7f904bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 0x7f904c06b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:39.702 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.698+0000 7f904b7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f904c06b980 0x7f904c0ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:39.702 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.702+0000 7f904b7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f904c06b980 0x7f904c0ce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:42370/0 (socket says 172.21.15.88:42370) 2023-11-20T07:00:39.702 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.702+0000 7f904b7fe640 1 -- 172.21.15.88:0/2750197626 learned_addr learned my addr 172.21.15.88:0/2750197626 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:39.703 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.702+0000 7f904bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 0x7f904c06b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:40474/0 (socket says 172.21.15.88:40474) 2023-11-20T07:00:39.703 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.702+0000 7f904b7fe640 1 -- 172.21.15.88:0/2750197626 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 msgr2=0x7f904c06b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:39.703 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.702+0000 7f904b7fe640 1 --2- 172.21.15.88:0/2750197626 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 0x7f904c06b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:39.703 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.702+0000 7f904b7fe640 1 -- 172.21.15.88:0/2750197626 >> v2:172.21.15.88:3300/0 conn(0x7f904c15ce40 msgr2=0x7f904c0ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:39.704 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.702+0000 7f9050de3640 1 --2- 172.21.15.88:0/2750197626 >> v2:172.21.15.88:3300/0 conn(0x7f904c15ce40 0x7f904c0ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:39.704 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.702+0000 7f904b7fe640 1 --2- 172.21.15.88:0/2750197626 >> v2:172.21.15.88:3300/0 conn(0x7f904c15ce40 0x7f904c0ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:39.705 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.702+0000 7f904b7fe640 1 -- 172.21.15.88:0/2750197626 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0cd800 con 0x7f904c06b980 2023-11-20T07:00:39.705 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.702+0000 7f9050de3640 1 --2- 172.21.15.88:0/2750197626 >> v2:172.21.15.88:3300/0 conn(0x7f904c15ce40 0x7f904c0ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:00:39.710 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.706+0000 7f904b7fe640 1 --2- 172.21.15.88:0/2750197626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f904c06b980 0x7f904c0ce000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f904c0d04d0 tx=0x7f903401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c9c8de341de8864 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:39.712 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.710+0000 7f904affd640 1 -- 172.21.15.88:0/2750197626 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340aa610 con 0x7f904c06b980 2023-11-20T07:00:39.712 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.710+0000 7f904affd640 1 -- 172.21.15.88:0/2750197626 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90340a6040 con 0x7f904c06b980 2023-11-20T07:00:39.712 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.710+0000 7f904affd640 1 -- 172.21.15.88:0/2750197626 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340aa990 con 0x7f904c06b980 2023-11-20T07:00:39.712 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.710+0000 7f9052846640 1 -- 172.21.15.88:0/2750197626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f904c06b980 msgr2=0x7f904c0ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:39.712 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.710+0000 7f9052846640 1 --2- 172.21.15.88:0/2750197626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f904c06b980 0x7f904c0ce000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f904c0d04d0 tx=0x7f903401c4d0 comp rx=0 tx=0).stop 2023-11-20T07:00:39.713 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.710+0000 7f9052846640 1 -- 172.21.15.88:0/2750197626 shutdown_connections 2023-11-20T07:00:39.713 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.710+0000 7f9052846640 1 --2- 172.21.15.88:0/2750197626 >> v2:172.21.15.88:3300/0 conn(0x7f904c15ce40 0x7f904c0ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:39.713 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.710+0000 7f9052846640 1 --2- 172.21.15.88:0/2750197626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f904c06b980 0x7f904c0ce000 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:39.713 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.710+0000 7f9052846640 1 --2- 172.21.15.88:0/2750197626 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 0x7f904c06b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:39.713 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.710+0000 7f9052846640 1 -- 172.21.15.88:0/2750197626 >> 172.21.15.88:0/2750197626 conn(0x7f904c08c350 msgr2=0x7f904c09bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:39.714 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.710+0000 7f9052846640 1 -- 172.21.15.88:0/2750197626 shutdown_connections 2023-11-20T07:00:39.714 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.710+0000 7f9052846640 1 -- 172.21.15.88:0/2750197626 wait complete. 2023-11-20T07:00:39.715 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f9052846640 1 Processor -- start 2023-11-20T07:00:39.715 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f9052846640 1 -- start start 2023-11-20T07:00:39.716 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f9052846640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f904c06b980 0x7f904c151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:39.716 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f9052846640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 0x7f904c15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:39.716 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f9052846640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f904c15ce40 0x7f904c15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:39.716 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f9052846640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c157740 con 0x7f904c06b980 2023-11-20T07:00:39.717 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f9052846640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c157a20 con 0x7f904c15ce40 2023-11-20T07:00:39.717 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f9052846640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c157d00 con 0x7f904c15ca60 2023-11-20T07:00:39.717 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f904b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 0x7f904c15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:39.717 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f904b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 0x7f904c15a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:40484/0 (socket says 172.21.15.88:40484) 2023-11-20T07:00:39.717 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f904b7fe640 1 -- 172.21.15.88:0/3731665736 learned_addr learned my addr 172.21.15.88:0/3731665736 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:39.717 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f904bfff640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f904c06b980 0x7f904c151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:39.717 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f904b7fe640 1 -- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f904c15ce40 msgr2=0x7f904c15ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:39.717 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f904b7fe640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f904c15ce40 0x7f904c15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:39.717 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f904b7fe640 1 -- 172.21.15.88:0/3731665736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f904c06b980 msgr2=0x7f904c151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:39.717 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f904b7fe640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f904c06b980 0x7f904c151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:39.717 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f904b7fe640 1 -- 172.21.15.88:0/3731665736 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90340094d0 con 0x7f904c15ca60 2023-11-20T07:00:39.718 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.714+0000 7f904b7fe640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 0x7f904c15a7c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f903401ab80 tx=0x7f903401ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:39.718 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.718+0000 7f9048ff9640 1 -- 172.21.15.88:0/3731665736 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340bd5f0 con 0x7f904c15ca60 2023-11-20T07:00:39.718 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.718+0000 7f9048ff9640 1 -- 172.21.15.88:0/3731665736 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90340bd750 con 0x7f904c15ca60 2023-11-20T07:00:39.718 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.718+0000 7f9048ff9640 1 -- 172.21.15.88:0/3731665736 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340bdb00 con 0x7f904c15ca60 2023-11-20T07:00:39.718 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.718+0000 7f9052846640 1 -- 172.21.15.88:0/3731665736 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c157fe0 con 0x7f904c15ca60 2023-11-20T07:00:39.719 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.718+0000 7f9052846640 1 -- 172.21.15.88:0/3731665736 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c151650 con 0x7f904c15ca60 2023-11-20T07:00:39.720 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.718+0000 7f9052846640 1 -- 172.21.15.88:0/3731665736 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904c15d530 con 0x7f904c15ca60 2023-11-20T07:00:39.727 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.722+0000 7f9048ff9640 1 -- 172.21.15.88:0/3731665736 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7f90340b3600 con 0x7f904c15ca60 2023-11-20T07:00:39.727 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.726+0000 7f9048ff9640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f902c066460 0x7f902c068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:39.727 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.726+0000 7f9048ff9640 1 -- 172.21.15.88:0/3731665736 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f903411e1a0 con 0x7f904c15ca60 2023-11-20T07:00:39.728 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.726+0000 7f904bfff640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f902c066460 0x7f902c068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:39.732 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.730+0000 7f904bfff640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f902c066460 0x7f902c068920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f903c009ac0 tx=0x7f903c006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:39.734 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:39.734+0000 7f9048ff9640 1 -- 172.21.15.88:0/3731665736 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90340ec750 con 0x7f904c15ca60 2023-11-20T07:00:39.965 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-11-20T07:00:39.962+0000 7f0ec4856640 -1 osd.6 0 waiting for initial osdmap 2023-11-20T07:00:39.988 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-11-20T07:00:39.986+0000 7f9819b96640 -1 osd.7 0 waiting for initial osdmap 2023-11-20T07:00:39.994 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-11-20T07:00:39.994+0000 7f0ebc68b640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T07:00:39.997 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-11-20T07:00:39.994+0000 7f0bb1399640 -1 osd.1 0 waiting for initial osdmap 2023-11-20T07:00:39.998 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-11-20T07:00:39.998+0000 7fef4d7ae640 -1 osd.2 0 waiting for initial osdmap 2023-11-20T07:00:40.011 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-11-20T07:00:40.006+0000 7f8db0582640 -1 osd.0 0 waiting for initial osdmap 2023-11-20T07:00:40.014 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-11-20T07:00:40.014+0000 7f98119cb640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T07:00:40.046 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-11-20T07:00:40.046+0000 7fef455e3640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T07:00:40.046 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.046+0000 7f9052846640 1 -- 172.21.15.88:0/3731665736 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f904c15d530 con 0x7f904c15ca60 2023-11-20T07:00:40.047 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.046+0000 7f9048ff9640 1 -- 172.21.15.88:0/3731665736 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f904c15d530 con 0x7f904c15ca60 2023-11-20T07:00:40.047 INFO:teuthology.misc.health.smithi088.stdout: 2023-11-20T07:00:40.047 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":12,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:37.556547+0000","last_up_change":"0.000000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:00:40.051 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.050+0000 7f9052846640 1 -- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f902c066460 msgr2=0x7f902c068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:40.051 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.050+0000 7f9052846640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f902c066460 0x7f902c068920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f903c009ac0 tx=0x7f903c006f90 comp rx=0 tx=0).stop 2023-11-20T07:00:40.051 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.050+0000 7f9052846640 1 -- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 msgr2=0x7f904c15a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:40.051 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.050+0000 7f9052846640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 0x7f904c15a7c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f903401ab80 tx=0x7f903401ad10 comp rx=0 tx=0).stop 2023-11-20T07:00:40.051 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.050+0000 7f9052846640 1 -- 172.21.15.88:0/3731665736 shutdown_connections 2023-11-20T07:00:40.051 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.050+0000 7f9052846640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f902c066460 0x7f902c068920 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:40.051 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.050+0000 7f9052846640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f904c15ca60 0x7f904c15a7c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:40.051 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.050+0000 7f9052846640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f904c15ce40 0x7f904c15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:40.051 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.050+0000 7f9052846640 1 --2- 172.21.15.88:0/3731665736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f904c06b980 0x7f904c151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:40.052 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.050+0000 7f9052846640 1 -- 172.21.15.88:0/3731665736 >> 172.21.15.88:0/3731665736 conn(0x7f904c08c350 msgr2=0x7f904c0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:40.052 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.050+0000 7f9052846640 1 -- 172.21.15.88:0/3731665736 shutdown_connections 2023-11-20T07:00:40.052 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:40.050+0000 7f9052846640 1 -- 172.21.15.88:0/3731665736 wait complete. 2023-11-20T07:00:40.058 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-11-20T07:00:40.058+0000 7f0ba91ce640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T07:00:40.076 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-20T07:00:40.078 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-11-20T07:00:40.078+0000 7f8da7ba3640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T07:00:40.081 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-11-20T07:00:40.078+0000 7f4c9869c640 -1 osd.4 0 waiting for initial osdmap 2023-11-20T07:00:40.097 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-11-20T07:00:40.098+0000 7f502722f640 -1 osd.5 0 waiting for initial osdmap 2023-11-20T07:00:40.102 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-11-20T07:00:40.102+0000 7f4c8fcbd640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T07:00:40.130 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-11-20T07:00:40.130+0000 7f501f064640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T07:00:40.161 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-11-20T07:00:40.158+0000 7f40aaff0640 -1 osd.3 0 waiting for initial osdmap 2023-11-20T07:00:40.194 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-11-20T07:00:40.194+0000 7f40a2e25640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-20T07:00:46.528 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:00:46.532 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:00:46.883 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-20T07:00:47.019 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc35e46640 1 Processor -- start 2023-11-20T07:00:47.019 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc35e46640 1 -- start start 2023-11-20T07:00:47.020 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc35e46640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc3015ca60 0x7fbc3006b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.020 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc35e46640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc3006b980 0x7fbc300ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.020 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc35e46640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbc3015ce40 0x7fbc300ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.021 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc35e46640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc300cfd50 con 0x7fbc3015ca60 2023-11-20T07:00:47.021 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc35e46640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc300d0030 con 0x7fbc3015ce40 2023-11-20T07:00:47.021 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc35e46640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300cd520 con 0x7fbc3006b980 2023-11-20T07:00:47.021 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc2f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc3015ca60 0x7fbc3006b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.021 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc2f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc3015ca60 0x7fbc3006b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40638/0 (socket says 172.21.15.88:40638) 2023-11-20T07:00:47.021 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc2f7fe640 1 -- 172.21.15.88:0/3289665303 learned_addr learned my addr 172.21.15.88:0/3289665303 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:47.021 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc2f7fe640 1 -- 172.21.15.88:0/3289665303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc3006b980 msgr2=0x7fbc300ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:47.022 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc2f7fe640 1 --2- 172.21.15.88:0/3289665303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc3006b980 0x7fbc300ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.022 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc2f7fe640 1 -- 172.21.15.88:0/3289665303 >> v2:172.21.15.175:3300/0 conn(0x7fbc3015ce40 msgr2=0x7fbc300ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:47.022 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc2f7fe640 1 --2- 172.21.15.88:0/3289665303 >> v2:172.21.15.175:3300/0 conn(0x7fbc3015ce40 0x7fbc300ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.022 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.018+0000 7fbc2f7fe640 1 -- 172.21.15.88:0/3289665303 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc300cd800 con 0x7fbc3015ca60 2023-11-20T07:00:47.024 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.022+0000 7fbc2f7fe640 1 --2- 172.21.15.88:0/3289665303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc3015ca60 0x7fbc3006b440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbc3006d050 tx=0x7fbc2001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b05016dbf2fcc4b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:47.024 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.022+0000 7fbc2effd640 1 -- 172.21.15.88:0/3289665303 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc200aa610 con 0x7fbc3015ca60 2023-11-20T07:00:47.024 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.022+0000 7fbc2effd640 1 -- 172.21.15.88:0/3289665303 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc200a6040 con 0x7fbc3015ca60 2023-11-20T07:00:47.024 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.022+0000 7fbc2effd640 1 -- 172.21.15.88:0/3289665303 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc200aa990 con 0x7fbc3015ca60 2023-11-20T07:00:47.025 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.022+0000 7fbc35e46640 1 -- 172.21.15.88:0/3289665303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc3015ca60 msgr2=0x7fbc3006b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.025 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.022+0000 7fbc35e46640 1 --2- 172.21.15.88:0/3289665303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc3015ca60 0x7fbc3006b440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbc3006d050 tx=0x7fbc2001c4d0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.025 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.022+0000 7fbc35e46640 1 -- 172.21.15.88:0/3289665303 shutdown_connections 2023-11-20T07:00:47.025 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.022+0000 7fbc35e46640 1 --2- 172.21.15.88:0/3289665303 >> v2:172.21.15.175:3300/0 conn(0x7fbc3015ce40 0x7fbc300ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.025 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.022+0000 7fbc35e46640 1 --2- 172.21.15.88:0/3289665303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc3006b980 0x7fbc300ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.026 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.022+0000 7fbc35e46640 1 --2- 172.21.15.88:0/3289665303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc3015ca60 0x7fbc3006b440 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.026 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc35e46640 1 -- 172.21.15.88:0/3289665303 >> 172.21.15.88:0/3289665303 conn(0x7fbc3008c350 msgr2=0x7fbc3009bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:47.026 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc35e46640 1 -- 172.21.15.88:0/3289665303 shutdown_connections 2023-11-20T07:00:47.026 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc35e46640 1 -- 172.21.15.88:0/3289665303 wait complete. 2023-11-20T07:00:47.027 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc35e46640 1 Processor -- start 2023-11-20T07:00:47.027 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc35e46640 1 -- start start 2023-11-20T07:00:47.029 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc35e46640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc3006b980 0x7fbc30155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.029 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc35e46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc3015ca60 0x7fbc30150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.029 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc35e46640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc3015ce40 0x7fbc30152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.029 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc35e46640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3015ebc0 con 0x7fbc3015ca60 2023-11-20T07:00:47.029 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc35e46640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3015eea0 con 0x7fbc3006b980 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc35e46640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3015f180 con 0x7fbc3015ce40 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc27fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc3015ca60 0x7fbc30150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc27fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc3015ca60 0x7fbc30150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40640/0 (socket says 172.21.15.88:40640) 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc27fff640 1 -- 172.21.15.88:0/1914857235 learned_addr learned my addr 172.21.15.88:0/1914857235 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc2ffff640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc3015ce40 0x7fbc30152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc2f7fe640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc3006b980 0x7fbc30155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc27fff640 1 -- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc3015ce40 msgr2=0x7fbc30152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc27fff640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc3015ce40 0x7fbc30152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc27fff640 1 -- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc3006b980 msgr2=0x7fbc30155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc27fff640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc3006b980 0x7fbc30155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc27fff640 1 -- 172.21.15.88:0/1914857235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20009480 con 0x7fbc3015ca60 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc2f7fe640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc3006b980 0x7fbc30155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:00:47.030 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.026+0000 7fbc27fff640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc3015ca60 0x7fbc30150530 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800b550 tx=0x7fbc1800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:47.031 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.030+0000 7fbc2cff9640 1 -- 172.21.15.88:0/1914857235 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18010870 con 0x7fbc3015ca60 2023-11-20T07:00:47.031 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.030+0000 7fbc2cff9640 1 -- 172.21.15.88:0/1914857235 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc180109f0 con 0x7fbc3015ca60 2023-11-20T07:00:47.031 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.030+0000 7fbc2cff9640 1 -- 172.21.15.88:0/1914857235 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18010da0 con 0x7fbc3015ca60 2023-11-20T07:00:47.031 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.030+0000 7fbc35e46640 1 -- 172.21.15.88:0/1914857235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3015f460 con 0x7fbc3015ca60 2023-11-20T07:00:47.031 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.030+0000 7fbc35e46640 1 -- 172.21.15.88:0/1914857235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc30155670 con 0x7fbc3015ca60 2023-11-20T07:00:47.031 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.030+0000 7fbc35e46640 1 -- 172.21.15.88:0/1914857235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3004e170 con 0x7fbc3015ca60 2023-11-20T07:00:47.031 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.030+0000 7fbc2cff9640 1 -- 172.21.15.88:0/1914857235 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbc1800f3c0 con 0x7fbc3015ca60 2023-11-20T07:00:47.032 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.030+0000 7fbc2cff9640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbc100664a0 0x7fbc10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.032 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.030+0000 7fbc2cff9640 1 -- 172.21.15.88:0/1914857235 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbc18083ad0 con 0x7fbc3015ca60 2023-11-20T07:00:47.033 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.030+0000 7fbc2f7fe640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbc100664a0 0x7fbc10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.034 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.034+0000 7fbc2f7fe640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbc100664a0 0x7fbc10068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc200ae000 tx=0x7fbc200a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:47.037 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.038+0000 7fbc2cff9640 1 -- 172.21.15.88:0/1914857235 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbc18051340 con 0x7fbc3015ca60 2023-11-20T07:00:47.188 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.186+0000 7fbc35e46640 1 -- 172.21.15.88:0/1914857235 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc3015f910 con 0x7fbc3015ca60 2023-11-20T07:00:47.189 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc2cff9640 1 -- 172.21.15.88:0/1914857235 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7fbc18054960 con 0x7fbc3015ca60 2023-11-20T07:00:47.190 INFO:teuthology.misc.health.smithi088.stdout: 2023-11-20T07:00:47.190 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":16,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:44.017362+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:00:47.191 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc35e46640 1 -- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbc100664a0 msgr2=0x7fbc10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.191 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc35e46640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbc100664a0 0x7fbc10068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc200ae000 tx=0x7fbc200a7000 comp rx=0 tx=0).stop 2023-11-20T07:00:47.191 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc35e46640 1 -- 172.21.15.88:0/1914857235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc3015ca60 msgr2=0x7fbc30150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.192 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc35e46640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc3015ca60 0x7fbc30150530 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800b550 tx=0x7fbc1800ba10 comp rx=0 tx=0).stop 2023-11-20T07:00:47.192 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc35e46640 1 -- 172.21.15.88:0/1914857235 shutdown_connections 2023-11-20T07:00:47.192 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc35e46640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbc100664a0 0x7fbc10068960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.192 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc35e46640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc3015ce40 0x7fbc30152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.192 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc35e46640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc3015ca60 0x7fbc30150530 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.192 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc35e46640 1 --2- 172.21.15.88:0/1914857235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc3006b980 0x7fbc30155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.192 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc35e46640 1 -- 172.21.15.88:0/1914857235 >> 172.21.15.88:0/1914857235 conn(0x7fbc3008c350 msgr2=0x7fbc300af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:47.192 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc35e46640 1 -- 172.21.15.88:0/1914857235 shutdown_connections 2023-11-20T07:00:47.192 INFO:teuthology.misc.health.smithi088.stderr:2023-11-20T07:00:47.190+0000 7fbc35e46640 1 -- 172.21.15.88:0/1914857235 wait complete. 2023-11-20T07:00:47.209 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-20T07:00:47.209 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-20T07:00:47.209 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-20T07:00:47.209 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-20T07:00:47.213 INFO:tasks.ceph.mds.a:Started 2023-11-20T07:00:47.213 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-20T07:00:47.213 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-20T07:00:47.216 INFO:tasks.ceph.mds.c:Started 2023-11-20T07:00:47.216 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-20T07:00:47.217 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-20T07:00:47.220 INFO:tasks.ceph.mds.b:Started 2023-11-20T07:00:47.220 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-20T07:00:47.220 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-20T07:00:47.224 INFO:tasks.ceph.mds.d:Started 2023-11-20T07:00:47.224 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-20T07:00:47.224 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:00:47.311 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-11-20T07:00:47.311 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-11-20T07:00:47.329 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-11-20T07:00:47.329 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-11-20T07:00:47.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.370+0000 7f7b6e0c9640 1 Processor -- start 2023-11-20T07:00:47.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.370+0000 7f7b6e0c9640 1 -- start start 2023-11-20T07:00:47.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b6e0c9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b681597c0 0x7f7b680ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b6e0c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b680723d0 con 0x7f7b680adc10 2023-11-20T07:00:47.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b6e0c9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b680717c0 con 0x7f7b68159ba0 2023-11-20T07:00:47.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b6e0c9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b68071aa0 con 0x7f7b681597c0 2023-11-20T07:00:47.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b677fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b681597c0 0x7f7b680ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b677fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b681597c0 0x7f7b680ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40672/0 (socket says 172.21.15.88:40672) 2023-11-20T07:00:47.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b677fe640 1 -- 172.21.15.88:0/872573835 learned_addr learned my addr 172.21.15.88:0/872573835 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:47.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b677fe640 1 -- 172.21.15.88:0/872573835 >> v1:172.21.15.175:6789/0 conn(0x7f7b68159ba0 legacy=0x7f7b680cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:47.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b677fe640 1 -- 172.21.15.88:0/872573835 >> v1:172.21.15.88:6789/0 conn(0x7f7b680adc10 legacy=0x7f7b6815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b677fe640 1 -- 172.21.15.88:0/872573835 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b68071d80 con 0x7f7b681597c0 2023-11-20T07:00:47.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b677fe640 1 --2- 172.21.15.88:0/872573835 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b681597c0 0x7f7b680ad6d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009870 tx=0x7f7b5801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3178d02d1ffb51 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:47.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b66ffd640 1 -- 172.21.15.88:0/872573835 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580ab670 con 0x7f7b681597c0 2023-11-20T07:00:47.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b66ffd640 1 -- 172.21.15.88:0/872573835 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b580ab7d0 con 0x7f7b681597c0 2023-11-20T07:00:47.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.374+0000 7f7b66ffd640 1 -- 172.21.15.88:0/872573835 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580abb60 con 0x7f7b681597c0 2023-11-20T07:00:47.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/872573835 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b681597c0 msgr2=0x7f7b680ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 --2- 172.21.15.88:0/872573835 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b681597c0 0x7f7b680ad6d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009870 tx=0x7f7b5801c4d0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/872573835 shutdown_connections 2023-11-20T07:00:47.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 --2- 172.21.15.88:0/872573835 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b681597c0 0x7f7b680ad6d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/872573835 >> 172.21.15.88:0/872573835 conn(0x7f7b6806c190 msgr2=0x7f7b6806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:47.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/872573835 shutdown_connections 2023-11-20T07:00:47.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/872573835 wait complete. 2023-11-20T07:00:47.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 Processor -- start 2023-11-20T07:00:47.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 -- start start 2023-11-20T07:00:47.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b680adc10 0x7f7b680c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b681597c0 0x7f7b680c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b68159ba0 0x7f7b680c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680c7530 con 0x7f7b68159ba0 2023-11-20T07:00:47.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b68147210 con 0x7f7b680adc10 2023-11-20T07:00:47.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b6e0c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b681479d0 con 0x7f7b681597c0 2023-11-20T07:00:47.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b67fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b68159ba0 0x7f7b680c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b677fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b680adc10 0x7f7b680c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b67fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b68159ba0 0x7f7b680c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40684/0 (socket says 172.21.15.88:40684) 2023-11-20T07:00:47.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b677fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b680adc10 0x7f7b680c6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:58898/0 (socket says 172.21.15.88:58898) 2023-11-20T07:00:47.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b67fff640 1 -- 172.21.15.88:0/3102885178 learned_addr learned my addr 172.21.15.88:0/3102885178 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:47.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.378+0000 7f7b5ffff640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b681597c0 0x7f7b680c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b67fff640 1 -- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b681597c0 msgr2=0x7f7b680c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b67fff640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b681597c0 0x7f7b680c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b67fff640 1 -- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b680adc10 msgr2=0x7f7b680c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b67fff640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b680adc10 0x7f7b680c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b67fff640 1 -- 172.21.15.88:0/3102885178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b580094d0 con 0x7f7b68159ba0 2023-11-20T07:00:47.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b67fff640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b68159ba0 0x7f7b680c7c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000c6c0 tx=0x7f7b6000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:47.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b64ff9640 1 -- 172.21.15.88:0/3102885178 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b60003b80 con 0x7f7b68159ba0 2023-11-20T07:00:47.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b64ff9640 1 -- 172.21.15.88:0/3102885178 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b60003ce0 con 0x7f7b68159ba0 2023-11-20T07:00:47.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b64ff9640 1 -- 172.21.15.88:0/3102885178 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b600052f0 con 0x7f7b68159ba0 2023-11-20T07:00:47.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/3102885178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b68146600 con 0x7f7b68159ba0 2023-11-20T07:00:47.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/3102885178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b68146bc0 con 0x7f7b68159ba0 2023-11-20T07:00:47.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/3102885178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b68074010 con 0x7f7b68159ba0 2023-11-20T07:00:47.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b64ff9640 1 -- 172.21.15.88:0/3102885178 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7b60005450 con 0x7f7b68159ba0 2023-11-20T07:00:47.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b64ff9640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7b480664a0 0x7f7b48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.382+0000 7f7b64ff9640 1 -- 172.21.15.88:0/3102885178 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7b600836f0 con 0x7f7b68159ba0 2023-11-20T07:00:47.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.386+0000 7f7b677fe640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7b480664a0 0x7f7b48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.386+0000 7f7b677fe640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7b480664a0 0x7f7b48068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b580af000 tx=0x7f7b580b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.390+0000 7f7b64ff9640 1 -- 172.21.15.88:0/3102885178 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7b60051000 con 0x7f7b68159ba0 2023-11-20T07:00:47.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/3102885178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b6814c770 con 0x7f7b68159ba0 2023-11-20T07:00:47.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b64ff9640 1 -- 172.21.15.88:0/3102885178 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f7b60054620 con 0x7f7b68159ba0 2023-11-20T07:00:47.543 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:00:47.543 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:44.017362+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:00:47.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7b480664a0 msgr2=0x7f7b48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7b480664a0 0x7f7b48068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b580af000 tx=0x7f7b580b6040 comp rx=0 tx=0).stop 2023-11-20T07:00:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/3102885178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b68159ba0 msgr2=0x7f7b680c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b68159ba0 0x7f7b680c7c30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000c6c0 tx=0x7f7b6000cb80 comp rx=0 tx=0).stop 2023-11-20T07:00:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/3102885178 shutdown_connections 2023-11-20T07:00:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7b480664a0 0x7f7b48068960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b681597c0 0x7f7b680c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b68159ba0 0x7f7b680c7c30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 --2- 172.21.15.88:0/3102885178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b680adc10 0x7f7b680c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/3102885178 >> 172.21.15.88:0/3102885178 conn(0x7f7b6806c190 msgr2=0x7f7b6814fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/3102885178 shutdown_connections 2023-11-20T07:00:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.542+0000 7f7b6e0c9640 1 -- 172.21.15.88:0/3102885178 wait complete. 2023-11-20T07:00:47.564 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-20T07:00:47.565 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:00:47.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.702+0000 7f9ad88bb640 1 Processor -- start 2023-11-20T07:00:47.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.702+0000 7f9ad88bb640 1 -- start start 2023-11-20T07:00:47.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad88bb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ad415cdc0 0x7f9ad40cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad88bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9ad40b3cb0 0x7f9ad40cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad88bb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad40d0880 con 0x7f9ad40cf210 2023-11-20T07:00:47.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad88bb640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad40b1c00 con 0x7f9ad40b3cb0 2023-11-20T07:00:47.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad88bb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad40b1ee0 con 0x7f9ad415cdc0 2023-11-20T07:00:47.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9ad40b3cb0 0x7f9ad40cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9ad40b3cb0 0x7f9ad40cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40696/0 (socket says 172.21.15.88:40696) 2023-11-20T07:00:47.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad3fff640 1 -- 172.21.15.88:0/2384523796 learned_addr learned my addr 172.21.15.88:0/2384523796 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:47.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad37fe640 1 --1- 172.21.15.88:0/2384523796 >> v1:172.21.15.88:6789/0 conn(0x7f9ad40cf210 0x7f9ad40cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60746/0 (socket says 172.21.15.88:60746) 2023-11-20T07:00:47.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9acbfff640 1 --2- 172.21.15.88:0/2384523796 >> v2:172.21.15.175:3300/0 conn(0x7f9ad415cdc0 0x7f9ad40cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad3fff640 1 -- 172.21.15.88:0/2384523796 >> v2:172.21.15.175:3300/0 conn(0x7f9ad415cdc0 msgr2=0x7f9ad40cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:47.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad3fff640 1 --2- 172.21.15.88:0/2384523796 >> v2:172.21.15.175:3300/0 conn(0x7f9ad415cdc0 0x7f9ad40cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad3fff640 1 -- 172.21.15.88:0/2384523796 >> v1:172.21.15.88:6789/0 conn(0x7f9ad40cf210 legacy=0x7f9ad40cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad2ffd640 1 -- 172.21.15.88:0/2384523796 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634051915 0 0) 0x7f9ad40d0880 con 0x7f9ad40cf210 2023-11-20T07:00:47.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.706+0000 7f9ad3fff640 1 -- 172.21.15.88:0/2384523796 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad40b21c0 con 0x7f9ad40b3cb0 2023-11-20T07:00:47.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad3fff640 1 --2- 172.21.15.88:0/2384523796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad40b3cb0 0x7f9ad40cda00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40b88b0 tx=0x7f9acc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adc69264d85d84e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:47.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad2ffd640 1 -- 172.21.15.88:0/2384523796 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc0a5770 con 0x7f9ad40b3cb0 2023-11-20T07:00:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad2ffd640 1 -- 172.21.15.88:0/2384523796 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc0a58d0 con 0x7f9ad40b3cb0 2023-11-20T07:00:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad2ffd640 1 -- 172.21.15.88:0/2384523796 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc0a5c60 con 0x7f9ad40b3cb0 2023-11-20T07:00:47.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 -- 172.21.15.88:0/2384523796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad40b3cb0 msgr2=0x7f9ad40cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 --2- 172.21.15.88:0/2384523796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad40b3cb0 0x7f9ad40cda00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40b88b0 tx=0x7f9acc01c9a0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 -- 172.21.15.88:0/2384523796 shutdown_connections 2023-11-20T07:00:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 --2- 172.21.15.88:0/2384523796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad40b3cb0 0x7f9ad40cda00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 --2- 172.21.15.88:0/2384523796 >> v2:172.21.15.175:3300/0 conn(0x7f9ad415cdc0 0x7f9ad40cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 -- 172.21.15.88:0/2384523796 >> 172.21.15.88:0/2384523796 conn(0x7f9ad40d2800 msgr2=0x7f9ad40d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 -- 172.21.15.88:0/2384523796 shutdown_connections 2023-11-20T07:00:47.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 -- 172.21.15.88:0/2384523796 wait complete. 2023-11-20T07:00:47.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 Processor -- start 2023-11-20T07:00:47.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 -- start start 2023-11-20T07:00:47.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad40b3cb0 0x7f9ad40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad40cf210 0x7f9ad41585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad415cdc0 0x7f9ad4158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad4159040 con 0x7f9ad415cdc0 2023-11-20T07:00:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40c8560 con 0x7f9ad40b3cb0 2023-11-20T07:00:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad88bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad4159270 con 0x7f9ad40cf210 2023-11-20T07:00:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.710+0000 7f9ad3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad415cdc0 0x7f9ad4158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad415cdc0 0x7f9ad4158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40706/0 (socket says 172.21.15.88:40706) 2023-11-20T07:00:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad3fff640 1 -- 172.21.15.88:0/3917490890 learned_addr learned my addr 172.21.15.88:0/3917490890 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad37fe640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad40b3cb0 0x7f9ad40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9acbfff640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad40cf210 0x7f9ad41585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad3fff640 1 -- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad40cf210 msgr2=0x7f9ad41585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad3fff640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad40cf210 0x7f9ad41585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad3fff640 1 -- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad40b3cb0 msgr2=0x7f9ad40c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad3fff640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad40b3cb0 0x7f9ad40c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad3fff640 1 -- 172.21.15.88:0/3917490890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc009b30 con 0x7f9ad415cdc0 2023-11-20T07:00:47.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad37fe640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad40b3cb0 0x7f9ad40c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:00:47.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad3fff640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad415cdc0 0x7f9ad4158b00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9acc01b050 tx=0x7f9acc019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad0ff9640 1 -- 172.21.15.88:0/3917490890 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc0b8470 con 0x7f9ad415cdc0 2023-11-20T07:00:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad0ff9640 1 -- 172.21.15.88:0/3917490890 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc0b85d0 con 0x7f9ad415cdc0 2023-11-20T07:00:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad88bb640 1 -- 172.21.15.88:0/3917490890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad4159550 con 0x7f9ad415cdc0 2023-11-20T07:00:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad0ff9640 1 -- 172.21.15.88:0/3917490890 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc0b8960 con 0x7f9ad415cdc0 2023-11-20T07:00:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad88bb640 1 -- 172.21.15.88:0/3917490890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad40c87b0 con 0x7f9ad415cdc0 2023-11-20T07:00:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad88bb640 1 -- 172.21.15.88:0/3917490890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad40cb360 con 0x7f9ad415cdc0 2023-11-20T07:00:47.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad0ff9640 1 -- 172.21.15.88:0/3917490890 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9acc0b8ac0 con 0x7f9ad415cdc0 2023-11-20T07:00:47.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad0ff9640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ab40664a0 0x7f9ab4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:47.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.714+0000 7f9ad0ff9640 1 -- 172.21.15.88:0/3917490890 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9acc11ea40 con 0x7f9ad415cdc0 2023-11-20T07:00:47.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.718+0000 7f9ad37fe640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ab40664a0 0x7f9ab4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:47.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.718+0000 7f9ad37fe640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ab40664a0 0x7f9ab4068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4001030 tx=0x7f9ac4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:47.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.718+0000 7f9ad0ff9640 1 -- 172.21.15.88:0/3917490890 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9ad40cb360 con 0x7f9ad415cdc0 2023-11-20T07:00:47.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.870+0000 7f9ad88bb640 1 -- 172.21.15.88:0/3917490890 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ad40cb360 con 0x7f9ad415cdc0 2023-11-20T07:00:47.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.870+0000 7f9ad0ff9640 1 -- 172.21.15.88:0/3917490890 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ad40cb360 con 0x7f9ad415cdc0 2023-11-20T07:00:47.873 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:00:47.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.874+0000 7f9ad88bb640 1 -- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ab40664a0 msgr2=0x7f9ab4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.874+0000 7f9ad88bb640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ab40664a0 0x7f9ab4068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4001030 tx=0x7f9ac4009040 comp rx=0 tx=0).stop 2023-11-20T07:00:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.874+0000 7f9ad88bb640 1 -- 172.21.15.88:0/3917490890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad415cdc0 msgr2=0x7f9ad4158b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.874+0000 7f9ad88bb640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad415cdc0 0x7f9ad4158b00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9acc01b050 tx=0x7f9acc019740 comp rx=0 tx=0).stop 2023-11-20T07:00:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.874+0000 7f9ad88bb640 1 -- 172.21.15.88:0/3917490890 shutdown_connections 2023-11-20T07:00:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.874+0000 7f9ad88bb640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ab40664a0 0x7f9ab4068960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.874+0000 7f9ad88bb640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad40cf210 0x7f9ad41585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.874+0000 7f9ad88bb640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad415cdc0 0x7f9ad4158b00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.874+0000 7f9ad88bb640 1 --2- 172.21.15.88:0/3917490890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad40b3cb0 0x7f9ad40c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.874+0000 7f9ad88bb640 1 -- 172.21.15.88:0/3917490890 >> 172.21.15.88:0/3917490890 conn(0x7f9ad40d2800 msgr2=0x7f9ad40cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.874+0000 7f9ad88bb640 1 -- 172.21.15.88:0/3917490890 shutdown_connections 2023-11-20T07:00:47.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:47.874+0000 7f9ad88bb640 1 -- 172.21.15.88:0/3917490890 wait complete. 2023-11-20T07:00:47.893 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:00:48.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b0cfd3640 1 Processor -- start 2023-11-20T07:00:48.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b0cfd3640 1 -- start start 2023-11-20T07:00:48.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b0cfd3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9b0815ca70 0x7f9b080d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:48.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b0cfd3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b080d3550 0x7f9b080cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:48.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b0cfd3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b080cf5d0 0x7f9b080d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:48.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b0cfd3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b080ce820 con 0x7f9b080cf5d0 2023-11-20T07:00:48.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b0cfd3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b080cfa40 con 0x7f9b0815ca70 2023-11-20T07:00:48.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b0cfd3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b080c65f0 con 0x7f9b080d3550 2023-11-20T07:00:48.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b06d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b080cf5d0 0x7f9b080d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:48.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b06d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b080cf5d0 0x7f9b080d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40710/0 (socket says 172.21.15.88:40710) 2023-11-20T07:00:48.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b06d9d640 1 -- 172.21.15.88:0/2351924791 learned_addr learned my addr 172.21.15.88:0/2351924791 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:48.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b0659c640 1 --2- 172.21.15.88:0/2351924791 >> v2:172.21.15.175:3300/0 conn(0x7f9b0815ca70 0x7f9b080d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:48.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b05d9b640 1 --2- 172.21.15.88:0/2351924791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b080d3550 0x7f9b080cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:48.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b06d9d640 1 -- 172.21.15.88:0/2351924791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b080d3550 msgr2=0x7f9b080cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:48.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b06d9d640 1 --2- 172.21.15.88:0/2351924791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b080d3550 0x7f9b080cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b06d9d640 1 -- 172.21.15.88:0/2351924791 >> v2:172.21.15.175:3300/0 conn(0x7f9b0815ca70 msgr2=0x7f9b080d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:48.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b06d9d640 1 --2- 172.21.15.88:0/2351924791 >> v2:172.21.15.175:3300/0 conn(0x7f9b0815ca70 0x7f9b080d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.030+0000 7f9b06d9d640 1 -- 172.21.15.88:0/2351924791 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b080cdf80 con 0x7f9b080cf5d0 2023-11-20T07:00:48.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b06d9d640 1 --2- 172.21.15.88:0/2351924791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b080cf5d0 0x7f9b080d0980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9b0808a880 tx=0x7f9b0001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d236d2a6d1a7c164 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:48.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b0559a640 1 -- 172.21.15.88:0/2351924791 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b000a5560 con 0x7f9b080cf5d0 2023-11-20T07:00:48.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b0559a640 1 -- 172.21.15.88:0/2351924791 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b000a56c0 con 0x7f9b080cf5d0 2023-11-20T07:00:48.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b0559a640 1 -- 172.21.15.88:0/2351924791 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b000a5a50 con 0x7f9b080cf5d0 2023-11-20T07:00:48.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2351924791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b080cf5d0 msgr2=0x7f9b080d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:48.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b0cfd3640 1 --2- 172.21.15.88:0/2351924791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b080cf5d0 0x7f9b080d0980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9b0808a880 tx=0x7f9b0001c6e0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2351924791 shutdown_connections 2023-11-20T07:00:48.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b0cfd3640 1 --2- 172.21.15.88:0/2351924791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b080cf5d0 0x7f9b080d0980 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b0cfd3640 1 --2- 172.21.15.88:0/2351924791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b080d3550 0x7f9b080cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b0cfd3640 1 --2- 172.21.15.88:0/2351924791 >> v2:172.21.15.175:3300/0 conn(0x7f9b0815ca70 0x7f9b080d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2351924791 >> 172.21.15.88:0/2351924791 conn(0x7f9b0809bc50 msgr2=0x7f9b080d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2351924791 shutdown_connections 2023-11-20T07:00:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.034+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2351924791 wait complete. 2023-11-20T07:00:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b0cfd3640 1 Processor -- start 2023-11-20T07:00:48.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b0cfd3640 1 -- start start 2023-11-20T07:00:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b0cfd3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b080cf5d0 0x7f9b0806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b0cfd3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b080d3550 0x7f9b0815f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:48.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b0cfd3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0815ca70 0x7f9b0814ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b0cfd3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b080b7290 con 0x7f9b080d3550 2023-11-20T07:00:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b0cfd3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b080b6330 con 0x7f9b0815ca70 2023-11-20T07:00:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b0cfd3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b080b6610 con 0x7f9b080cf5d0 2023-11-20T07:00:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b05d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b080d3550 0x7f9b0815f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:48.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b05d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b080d3550 0x7f9b0815f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40720/0 (socket says 172.21.15.88:40720) 2023-11-20T07:00:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b05d9b640 1 -- 172.21.15.88:0/2561526933 learned_addr learned my addr 172.21.15.88:0/2561526933 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b06d9d640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0815ca70 0x7f9b0814ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b0659c640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b080cf5d0 0x7f9b0806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b05d9b640 1 -- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b080cf5d0 msgr2=0x7f9b0806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b05d9b640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b080cf5d0 0x7f9b0806c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b05d9b640 1 -- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0815ca70 msgr2=0x7f9b0814ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:48.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b05d9b640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0815ca70 0x7f9b0814ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b05d9b640 1 -- 172.21.15.88:0/2561526933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b00009b30 con 0x7f9b080d3550 2023-11-20T07:00:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b06d9d640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0815ca70 0x7f9b0814ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:00:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b05d9b640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b080d3550 0x7f9b0815f110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00d800 tx=0x7f9afc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9af6ffd640 1 -- 172.21.15.88:0/2561526933 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc00b6c0 con 0x7f9b080d3550 2023-11-20T07:00:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9af6ffd640 1 -- 172.21.15.88:0/2561526933 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc00b820 con 0x7f9b080d3550 2023-11-20T07:00:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2561526933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b080b68f0 con 0x7f9b080d3550 2023-11-20T07:00:48.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9af6ffd640 1 -- 172.21.15.88:0/2561526933 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc00bb90 con 0x7f9b080d3550 2023-11-20T07:00:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.038+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2561526933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b080b5f00 con 0x7f9b080d3550 2023-11-20T07:00:48.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.042+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2561526933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b080b70f0 con 0x7f9b080d3550 2023-11-20T07:00:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.042+0000 7f9af6ffd640 1 -- 172.21.15.88:0/2561526933 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9afc00bcf0 con 0x7f9b080d3550 2023-11-20T07:00:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.042+0000 7f9af6ffd640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ae80664a0 0x7f9ae8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.042+0000 7f9af6ffd640 1 -- 172.21.15.88:0/2561526933 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9afc084030 con 0x7f9b080d3550 2023-11-20T07:00:48.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.042+0000 7f9b0659c640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ae80664a0 0x7f9ae8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.042+0000 7f9b0659c640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ae80664a0 0x7f9ae8068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9af8006fd0 tx=0x7f9af8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:48.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.046+0000 7f9af6ffd640 1 -- 172.21.15.88:0/2561526933 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b080b70f0 con 0x7f9b080d3550 2023-11-20T07:00:48.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2561526933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b080b70f0 con 0x7f9b080d3550 2023-11-20T07:00:48.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9af6ffd640 1 -- 172.21.15.88:0/2561526933 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f9b080b70f0 con 0x7f9b080d3550 2023-11-20T07:00:48.227 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:00:48.227 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/438678526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":438678526},{"type":"v1","addr":"172.21.15.88:6834","nonce":438678526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-20T07:00:48.227 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 2 2023-11-20T07:00:48.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ae80664a0 msgr2=0x7f9ae8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:48.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ae80664a0 0x7f9ae8068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9af8006fd0 tx=0x7f9af8008040 comp rx=0 tx=0).stop 2023-11-20T07:00:48.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2561526933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b080d3550 msgr2=0x7f9b0815f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:48.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b080d3550 0x7f9b0815f110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00d800 tx=0x7f9afc00dcc0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2561526933 shutdown_connections 2023-11-20T07:00:48.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ae80664a0 0x7f9ae8068960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0815ca70 0x7f9b0814ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b080d3550 0x7f9b0815f110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 --2- 172.21.15.88:0/2561526933 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b080cf5d0 0x7f9b0806c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:48.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2561526933 >> 172.21.15.88:0/2561526933 conn(0x7f9b0809bc50 msgr2=0x7f9b0815bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:48.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2561526933 shutdown_connections 2023-11-20T07:00:48.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:48.226+0000 7f9b0cfd3640 1 -- 172.21.15.88:0/2561526933 wait complete. 2023-11-20T07:00:50.247 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:00:50.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f4802454640 1 Processor -- start 2023-11-20T07:00:50.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f4802454640 1 -- start start 2023-11-20T07:00:50.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f4802454640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f47fc15cb90 0x7f47fc0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:50.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f4802454640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc0d3010 0x7f47fc0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:50.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f4802454640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc0ce770 con 0x7f47fc0d1400 2023-11-20T07:00:50.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f4802454640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47fc0d1890 con 0x7f47fc15cb90 2023-11-20T07:00:50.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f4802454640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc0d0600 con 0x7f47fc0d3010 2023-11-20T07:00:50.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f48009f1640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f47fc0d1400 0x7f47fc0cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60750/0 (socket says 172.21.15.88:60750) 2023-11-20T07:00:50.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f48009f1640 1 -- 172.21.15.88:0/2990724465 learned_addr learned my addr 172.21.15.88:0/2990724465 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:00:50.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f47fbfff640 1 --2- 172.21.15.88:0/2990724465 >> v2:172.21.15.175:3300/0 conn(0x7f47fc15cb90 0x7f47fc0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:50.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f47fb7fe640 1 --2- 172.21.15.88:0/2990724465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc0d3010 0x7f47fc0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:50.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f47faffd640 1 -- 172.21.15.88:0/2990724465 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677425666 0 0) 0x7f47fc0ce770 con 0x7f47fc0d1400 2023-11-20T07:00:50.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f47faffd640 1 -- 172.21.15.88:0/2990724465 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e4003530 con 0x7f47fc0d1400 2023-11-20T07:00:50.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f47fbfff640 1 -- 172.21.15.88:0/2990724465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc0d3010 msgr2=0x7f47fc0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:50.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f47fbfff640 1 --2- 172.21.15.88:0/2990724465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc0d3010 0x7f47fc0d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f47fbfff640 1 -- 172.21.15.88:0/2990724465 >> v1:172.21.15.88:6789/0 conn(0x7f47fc0d1400 legacy=0x7f47fc0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:50.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f47fbfff640 1 -- 172.21.15.88:0/2990724465 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc0c6450 con 0x7f47fc15cb90 2023-11-20T07:00:50.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.386+0000 7f47fb7fe640 1 --2- 172.21.15.88:0/2990724465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc0d3010 0x7f47fc0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:00:50.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.390+0000 7f47fbfff640 1 --2- 172.21.15.88:0/2990724465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc15cb90 0x7f47fc0cfb10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0097a0 tx=0x7f47ec01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e2046fe79aa8aaf server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:50.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.390+0000 7f47faffd640 1 -- 172.21.15.88:0/2990724465 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0ac600 con 0x7f47fc15cb90 2023-11-20T07:00:50.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.390+0000 7f47faffd640 1 -- 172.21.15.88:0/2990724465 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec0a8050 con 0x7f47fc15cb90 2023-11-20T07:00:50.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.390+0000 7f47faffd640 1 -- 172.21.15.88:0/2990724465 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0ac980 con 0x7f47fc15cb90 2023-11-20T07:00:50.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.390+0000 7f4802454640 1 -- 172.21.15.88:0/2990724465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc15cb90 msgr2=0x7f47fc0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:50.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.390+0000 7f4802454640 1 --2- 172.21.15.88:0/2990724465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc15cb90 0x7f47fc0cfb10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0097a0 tx=0x7f47ec01c3a0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.390+0000 7f4802454640 1 -- 172.21.15.88:0/2990724465 shutdown_connections 2023-11-20T07:00:50.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.390+0000 7f4802454640 1 --2- 172.21.15.88:0/2990724465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc0d3010 0x7f47fc0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.390+0000 7f4802454640 1 --2- 172.21.15.88:0/2990724465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc15cb90 0x7f47fc0cfb10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.390+0000 7f4802454640 1 -- 172.21.15.88:0/2990724465 >> 172.21.15.88:0/2990724465 conn(0x7f47fc09bc50 msgr2=0x7f47fc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:50.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.390+0000 7f4802454640 1 -- 172.21.15.88:0/2990724465 shutdown_connections 2023-11-20T07:00:50.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.390+0000 7f4802454640 1 -- 172.21.15.88:0/2990724465 wait complete. 2023-11-20T07:00:50.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f4802454640 1 Processor -- start 2023-11-20T07:00:50.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f4802454640 1 -- start start 2023-11-20T07:00:50.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f4802454640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0d1400 0x7f47fc14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:50.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f4802454640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc0d3010 0x7f47fc14b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:50.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f4802454640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47fc15cb90 0x7f47fc0c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:50.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f4802454640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc15ac20 con 0x7f47fc15cb90 2023-11-20T07:00:50.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f4802454640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc14b7a0 con 0x7f47fc0d1400 2023-11-20T07:00:50.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f4802454640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc157c00 con 0x7f47fc0d3010 2023-11-20T07:00:50.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f48009f1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47fc15cb90 0x7f47fc0c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:50.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f48009f1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47fc15cb90 0x7f47fc0c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40730/0 (socket says 172.21.15.88:40730) 2023-11-20T07:00:50.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f48009f1640 1 -- 172.21.15.88:0/991456125 learned_addr learned my addr 172.21.15.88:0/991456125 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:50.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f47fbfff640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0d1400 0x7f47fc14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:50.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f47fb7fe640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc0d3010 0x7f47fc14b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:50.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f48009f1640 1 -- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc0d3010 msgr2=0x7f47fc14b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:50.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f48009f1640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc0d3010 0x7f47fc14b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f48009f1640 1 -- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0d1400 msgr2=0x7f47fc14f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:50.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f48009f1640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0d1400 0x7f47fc14f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f48009f1640 1 -- 172.21.15.88:0/991456125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f0009420 con 0x7f47fc15cb90 2023-11-20T07:00:50.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f48009f1640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47fc15cb90 0x7f47fc0c80c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47f400caa0 tx=0x7f47f400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:50.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f47f8ff9640 1 -- 172.21.15.88:0/991456125 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400ac00 con 0x7f47fc15cb90 2023-11-20T07:00:50.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f47f8ff9640 1 -- 172.21.15.88:0/991456125 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f400ad60 con 0x7f47fc15cb90 2023-11-20T07:00:50.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f4802454640 1 -- 172.21.15.88:0/991456125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec0093b0 con 0x7f47fc15cb90 2023-11-20T07:00:50.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f47f8ff9640 1 -- 172.21.15.88:0/991456125 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4012620 con 0x7f47fc15cb90 2023-11-20T07:00:50.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.394+0000 7f4802454640 1 -- 172.21.15.88:0/991456125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc1581c0 con 0x7f47fc15cb90 2023-11-20T07:00:50.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.398+0000 7f4802454640 1 -- 172.21.15.88:0/991456125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47fc15ad90 con 0x7f47fc15cb90 2023-11-20T07:00:50.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.398+0000 7f47f8ff9640 1 -- 172.21.15.88:0/991456125 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f47f4007070 con 0x7f47fc15cb90 2023-11-20T07:00:50.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.398+0000 7f47f8ff9640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f47e80664d0 0x7f47e8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:50.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.398+0000 7f47f8ff9640 1 -- 172.21.15.88:0/991456125 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f47f4083a10 con 0x7f47fc15cb90 2023-11-20T07:00:50.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.398+0000 7f47fbfff640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f47e80664d0 0x7f47e8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:50.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.398+0000 7f47fbfff640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f47e80664d0 0x7f47e8068990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0ae000 tx=0x7f47ec0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:50.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.402+0000 7f47f8ff9640 1 -- 172.21.15.88:0/991456125 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f47fc15ad90 con 0x7f47fc15cb90 2023-11-20T07:00:50.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 -- 172.21.15.88:0/991456125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47fc15ad60 con 0x7f47fc15cb90 2023-11-20T07:00:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f47f8ff9640 1 -- 172.21.15.88:0/991456125 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7f47f4017090 con 0x7f47fc15cb90 2023-11-20T07:00:50.587 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:00:50.587 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/1097293366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1097293366},{"type":"v1","addr":"172.21.15.175:6836","nonce":1097293366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/438678526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":438678526},{"type":"v1","addr":"172.21.15.88:6834","nonce":438678526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1083863684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":1083863684},{"type":"v1","addr":"172.21.15.88:6835","nonce":1083863684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3413113678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3413113678},{"type":"v1","addr":"172.21.15.175:6837","nonce":3413113678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-20T07:00:50.587 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 3 2023-11-20T07:00:50.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 -- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f47e80664d0 msgr2=0x7f47e8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:50.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f47e80664d0 0x7f47e8068990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f47ec0ae000 tx=0x7f47ec0a7000 comp rx=0 tx=0).stop 2023-11-20T07:00:50.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 -- 172.21.15.88:0/991456125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47fc15cb90 msgr2=0x7f47fc0c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:50.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47fc15cb90 0x7f47fc0c80c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47f400caa0 tx=0x7f47f400cf60 comp rx=0 tx=0).stop 2023-11-20T07:00:50.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 -- 172.21.15.88:0/991456125 shutdown_connections 2023-11-20T07:00:50.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f47e80664d0 0x7f47e8068990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc0d3010 0x7f47fc14b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47fc15cb90 0x7f47fc0c80c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 --2- 172.21.15.88:0/991456125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0d1400 0x7f47fc14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 -- 172.21.15.88:0/991456125 >> 172.21.15.88:0/991456125 conn(0x7f47fc09bc50 msgr2=0x7f47fc1556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:50.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 -- 172.21.15.88:0/991456125 shutdown_connections 2023-11-20T07:00:50.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.586+0000 7f4802454640 1 -- 172.21.15.88:0/991456125 wait complete. 2023-11-20T07:00:50.608 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:00:50.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe814ea640 1 Processor -- start 2023-11-20T07:00:50.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe814ea640 1 -- start start 2023-11-20T07:00:50.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe814ea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbe7c15cb90 0x7fbe7c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:50.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe814ea640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbe7c0d3010 0x7fbe7c0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:50.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe814ea640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c0d1850 con 0x7fbe7c0d1400 2023-11-20T07:00:50.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe814ea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c0ce770 con 0x7fbe7c15cb90 2023-11-20T07:00:50.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe814ea640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c0d0600 con 0x7fbe7c0d3010 2023-11-20T07:00:50.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe7affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbe7c15cb90 0x7fbe7c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:50.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe7affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbe7c15cb90 0x7fbe7c0cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40734/0 (socket says 172.21.15.88:40734) 2023-11-20T07:00:50.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe7affd640 1 -- 172.21.15.88:0/2252632308 learned_addr learned my addr 172.21.15.88:0/2252632308 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:50.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe727fc640 1 --2- 172.21.15.88:0/2252632308 >> v2:172.21.15.175:3300/0 conn(0x7fbe7c0d3010 0x7fbe7c0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:50.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe7affd640 1 -- 172.21.15.88:0/2252632308 >> v2:172.21.15.175:3300/0 conn(0x7fbe7c0d3010 msgr2=0x7fbe7c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:50.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe7affd640 1 --2- 172.21.15.88:0/2252632308 >> v2:172.21.15.175:3300/0 conn(0x7fbe7c0d3010 0x7fbe7c0d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe7affd640 1 -- 172.21.15.88:0/2252632308 >> v1:172.21.15.175:6789/0 conn(0x7fbe7c0d1400 legacy=0x7fbe7c0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:50.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.746+0000 7fbe7affd640 1 -- 172.21.15.88:0/2252632308 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0c6450 con 0x7fbe7c15cb90 2023-11-20T07:00:50.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.750+0000 7fbe7affd640 1 --2- 172.21.15.88:0/2252632308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c15cb90 0x7fbe7c0cfb10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c08a880 tx=0x7fbe6401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b899f8a026d7271 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:50.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.750+0000 7fbe7a7fc640 1 -- 172.21.15.88:0/2252632308 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640ab600 con 0x7fbe7c15cb90 2023-11-20T07:00:50.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.750+0000 7fbe7a7fc640 1 -- 172.21.15.88:0/2252632308 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640ab760 con 0x7fbe7c15cb90 2023-11-20T07:00:50.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.750+0000 7fbe7a7fc640 1 -- 172.21.15.88:0/2252632308 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640abaf0 con 0x7fbe7c15cb90 2023-11-20T07:00:50.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.750+0000 7fbe814ea640 1 -- 172.21.15.88:0/2252632308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c15cb90 msgr2=0x7fbe7c0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:50.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.750+0000 7fbe814ea640 1 --2- 172.21.15.88:0/2252632308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c15cb90 0x7fbe7c0cfb10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c08a880 tx=0x7fbe6401c400 comp rx=0 tx=0).stop 2023-11-20T07:00:50.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.750+0000 7fbe814ea640 1 -- 172.21.15.88:0/2252632308 shutdown_connections 2023-11-20T07:00:50.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.750+0000 7fbe814ea640 1 --2- 172.21.15.88:0/2252632308 >> v2:172.21.15.175:3300/0 conn(0x7fbe7c0d3010 0x7fbe7c0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.750+0000 7fbe814ea640 1 --2- 172.21.15.88:0/2252632308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c15cb90 0x7fbe7c0cfb10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.750+0000 7fbe814ea640 1 -- 172.21.15.88:0/2252632308 >> 172.21.15.88:0/2252632308 conn(0x7fbe7c09bc50 msgr2=0x7fbe7c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:50.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.750+0000 7fbe814ea640 1 -- 172.21.15.88:0/2252632308 shutdown_connections 2023-11-20T07:00:50.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.750+0000 7fbe814ea640 1 -- 172.21.15.88:0/2252632308 wait complete. 2023-11-20T07:00:50.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe814ea640 1 Processor -- start 2023-11-20T07:00:50.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe814ea640 1 -- start start 2023-11-20T07:00:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe814ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c0d1400 0x7fbe7c15a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe814ea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe7c0d3010 0x7fbe7c15ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe814ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe7c15cb90 0x7fbe7c153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe814ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0cbd20 con 0x7fbe7c0d1400 2023-11-20T07:00:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe814ea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0cc000 con 0x7fbe7c0d3010 2023-11-20T07:00:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe814ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0cc2e0 con 0x7fbe7c15cb90 2023-11-20T07:00:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe7affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c0d1400 0x7fbe7c15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe7affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c0d1400 0x7fbe7c15a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40738/0 (socket says 172.21.15.88:40738) 2023-11-20T07:00:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe7affd640 1 -- 172.21.15.88:0/3449858101 learned_addr learned my addr 172.21.15.88:0/3449858101 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe727fc640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe7c0d3010 0x7fbe7c15ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:50.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe7b7fe640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe7c15cb90 0x7fbe7c153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:50.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe7affd640 1 -- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe7c15cb90 msgr2=0x7fbe7c153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:50.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe7affd640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe7c15cb90 0x7fbe7c153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe7affd640 1 -- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe7c0d3010 msgr2=0x7fbe7c15ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:50.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe7affd640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe7c0d3010 0x7fbe7c15ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe7affd640 1 -- 172.21.15.88:0/3449858101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe64009480 con 0x7fbe7c0d1400 2023-11-20T07:00:50.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe7b7fe640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe7c15cb90 0x7fbe7c153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:00:50.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe7affd640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c0d1400 0x7fbe7c15a900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbe6401a030 tx=0x7fbe640191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:50.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe73fff640 1 -- 172.21.15.88:0/3449858101 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640abce0 con 0x7fbe7c0d1400 2023-11-20T07:00:50.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe73fff640 1 -- 172.21.15.88:0/3449858101 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640abe60 con 0x7fbe7c0d1400 2023-11-20T07:00:50.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe814ea640 1 -- 172.21.15.88:0/3449858101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c0cc5c0 con 0x7fbe7c0d1400 2023-11-20T07:00:50.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe73fff640 1 -- 172.21.15.88:0/3449858101 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64003860 con 0x7fbe7c0d1400 2023-11-20T07:00:50.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.754+0000 7fbe814ea640 1 -- 172.21.15.88:0/3449858101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c154420 con 0x7fbe7c0d1400 2023-11-20T07:00:50.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.758+0000 7fbe814ea640 1 -- 172.21.15.88:0/3449858101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c074010 con 0x7fbe7c0d1400 2023-11-20T07:00:50.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.758+0000 7fbe73fff640 1 -- 172.21.15.88:0/3449858101 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbe640039c0 con 0x7fbe7c0d1400 2023-11-20T07:00:50.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.758+0000 7fbe73fff640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbe5c0664d0 0x7fbe5c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:50.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.758+0000 7fbe73fff640 1 -- 172.21.15.88:0/3449858101 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe6411e530 con 0x7fbe7c0d1400 2023-11-20T07:00:50.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.758+0000 7fbe727fc640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbe5c0664d0 0x7fbe5c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:50.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.758+0000 7fbe727fc640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbe5c0664d0 0x7fbe5c068990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0cb970 tx=0x7fbe6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:50.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.762+0000 7fbe73fff640 1 -- 172.21.15.88:0/3449858101 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbe640ebc60 con 0x7fbe7c0d1400 2023-11-20T07:00:50.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 -- 172.21.15.88:0/3449858101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe7c0d1850 con 0x7fbe7c0d1400 2023-11-20T07:00:50.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe73fff640 1 -- 172.21.15.88:0/3449858101 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7fbe7c0d1850 con 0x7fbe7c0d1400 2023-11-20T07:00:50.919 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:00:50.919 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:44.017362+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:00:50.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 -- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbe5c0664d0 msgr2=0x7fbe5c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:50.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbe5c0664d0 0x7fbe5c068990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0cb970 tx=0x7fbe6c008040 comp rx=0 tx=0).stop 2023-11-20T07:00:50.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 -- 172.21.15.88:0/3449858101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c0d1400 msgr2=0x7fbe7c15a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:50.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c0d1400 0x7fbe7c15a900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbe6401a030 tx=0x7fbe640191a0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 -- 172.21.15.88:0/3449858101 shutdown_connections 2023-11-20T07:00:50.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbe5c0664d0 0x7fbe5c068990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe7c15cb90 0x7fbe7c153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe7c0d3010 0x7fbe7c15ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 --2- 172.21.15.88:0/3449858101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe7c0d1400 0x7fbe7c15a900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:50.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 -- 172.21.15.88:0/3449858101 >> 172.21.15.88:0/3449858101 conn(0x7fbe7c09bc50 msgr2=0x7fbe7c06bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:50.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 -- 172.21.15.88:0/3449858101 shutdown_connections 2023-11-20T07:00:50.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:50.918+0000 7fbe814ea640 1 -- 172.21.15.88:0/3449858101 wait complete. 2023-11-20T07:00:50.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-20T07:00:50.940 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:00:51.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0dc9d3640 1 Processor -- start 2023-11-20T07:00:51.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0dc9d3640 1 -- start start 2023-11-20T07:00:51.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0dc9d3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd0d806d010 0x7fd0d80c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0dc9d3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d815ae30 con 0x7fd0d80c26b0 2023-11-20T07:00:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0dc9d3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d80ca510 con 0x7fd0d8069e90 2023-11-20T07:00:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0dc9d3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d80cb090 con 0x7fd0d806d010 2023-11-20T07:00:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0cffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd0d806d010 0x7fd0d80c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0cffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd0d806d010 0x7fd0d80c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40750/0 (socket says 172.21.15.88:40750) 2023-11-20T07:00:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0cffff640 1 -- 172.21.15.88:0/776786152 learned_addr learned my addr 172.21.15.88:0/776786152 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:51.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0d6d9d640 1 --1- 172.21.15.88:0/776786152 >> v1:172.21.15.88:6789/0 conn(0x7fd0d80c26b0 0x7fd0d80c2b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60752/0 (socket says 172.21.15.88:60752) 2023-11-20T07:00:51.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0cffff640 1 -- 172.21.15.88:0/776786152 >> v1:172.21.15.175:6789/0 conn(0x7fd0d8069e90 legacy=0x7fd0d806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0cffff640 1 -- 172.21.15.88:0/776786152 >> v1:172.21.15.88:6789/0 conn(0x7fd0d80c26b0 legacy=0x7fd0d80c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.078+0000 7fd0cffff640 1 -- 172.21.15.88:0/776786152 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d80ca7f0 con 0x7fd0d806d010 2023-11-20T07:00:51.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.082+0000 7fd0cffff640 1 --2- 172.21.15.88:0/776786152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d806d010 0x7fd0d80c9ce0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009870 tx=0x7fd0c001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d01a87e9bb4c5a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:51.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.082+0000 7fd0d5d9b640 1 -- 172.21.15.88:0/776786152 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00a8a30 con 0x7fd0d806d010 2023-11-20T07:00:51.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.082+0000 7fd0d5d9b640 1 -- 172.21.15.88:0/776786152 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c00a8b90 con 0x7fd0d806d010 2023-11-20T07:00:51.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.082+0000 7fd0d5d9b640 1 -- 172.21.15.88:0/776786152 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00b0440 con 0x7fd0d806d010 2023-11-20T07:00:51.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.082+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/776786152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d806d010 msgr2=0x7fd0d80c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.082+0000 7fd0dc9d3640 1 --2- 172.21.15.88:0/776786152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d806d010 0x7fd0d80c9ce0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0009870 tx=0x7fd0c001ed30 comp rx=0 tx=0).stop 2023-11-20T07:00:51.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.082+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/776786152 shutdown_connections 2023-11-20T07:00:51.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.082+0000 7fd0dc9d3640 1 --2- 172.21.15.88:0/776786152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d806d010 0x7fd0d80c9ce0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.082+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/776786152 >> 172.21.15.88:0/776786152 conn(0x7fd0d80b0da0 msgr2=0x7fd0d80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:51.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.082+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/776786152 shutdown_connections 2023-11-20T07:00:51.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.082+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/776786152 wait complete. 2023-11-20T07:00:51.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0dc9d3640 1 Processor -- start 2023-11-20T07:00:51.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0dc9d3640 1 -- start start 2023-11-20T07:00:51.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0dc9d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0d8069e90 0x7fd0d8140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0dc9d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d806d010 0x7fd0d80c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0dc9d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0d80c26b0 0x7fd0d80c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0dc9d3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d815d7e0 con 0x7fd0d806d010 2023-11-20T07:00:51.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0dc9d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d80c8300 con 0x7fd0d80c26b0 2023-11-20T07:00:51.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0dc9d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d815da80 con 0x7fd0d8069e90 2023-11-20T07:00:51.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0cffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d806d010 0x7fd0d80c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0cffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d806d010 0x7fd0d80c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40756/0 (socket says 172.21.15.88:40756) 2023-11-20T07:00:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0cffff640 1 -- 172.21.15.88:0/745051232 learned_addr learned my addr 172.21.15.88:0/745051232 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0d6d9d640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0d80c26b0 0x7fd0d80c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0d659c640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0d8069e90 0x7fd0d8140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0cffff640 1 -- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0d8069e90 msgr2=0x7fd0d8140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0cffff640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0d8069e90 0x7fd0d8140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0cffff640 1 -- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0d80c26b0 msgr2=0x7fd0d80c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0cffff640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0d80c26b0 0x7fd0d80c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0cffff640 1 -- 172.21.15.88:0/745051232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c00094d0 con 0x7fd0d806d010 2023-11-20T07:00:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0d6d9d640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0d80c26b0 0x7fd0d80c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:00:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0d659c640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0d8069e90 0x7fd0d8140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:00:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0cffff640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d806d010 0x7fd0d80c3770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd0c001b940 tx=0x7fd0c001bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0ceffd640 1 -- 172.21.15.88:0/745051232 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00be070 con 0x7fd0d806d010 2023-11-20T07:00:51.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0ceffd640 1 -- 172.21.15.88:0/745051232 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c00ba400 con 0x7fd0d806d010 2023-11-20T07:00:51.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/745051232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d815dd60 con 0x7fd0d806d010 2023-11-20T07:00:51.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.086+0000 7fd0ceffd640 1 -- 172.21.15.88:0/745051232 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00ba7b0 con 0x7fd0d806d010 2023-11-20T07:00:51.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.090+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/745051232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d80c41f0 con 0x7fd0d806d010 2023-11-20T07:00:51.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.090+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/745051232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d804e170 con 0x7fd0d806d010 2023-11-20T07:00:51.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.090+0000 7fd0ceffd640 1 -- 172.21.15.88:0/745051232 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd0c00ba910 con 0x7fd0d806d010 2023-11-20T07:00:51.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.090+0000 7fd0ceffd640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd0b80664a0 0x7fd0b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.090+0000 7fd0ceffd640 1 -- 172.21.15.88:0/745051232 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd0c01219c0 con 0x7fd0d806d010 2023-11-20T07:00:51.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.090+0000 7fd0d659c640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd0b80664a0 0x7fd0b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.094+0000 7fd0d659c640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd0b80664a0 0x7fd0b8068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8000f70 tx=0x7fd0c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:51.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.094+0000 7fd0ceffd640 1 -- 172.21.15.88:0/745051232 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0c00ef180 con 0x7fd0d806d010 2023-11-20T07:00:51.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.242+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/745051232 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0d80c2090 con 0x7fd0d806d010 2023-11-20T07:00:51.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0ceffd640 1 -- 172.21.15.88:0/745051232 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0c00b50a0 con 0x7fd0d806d010 2023-11-20T07:00:51.245 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:00:51.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd0b80664a0 msgr2=0x7fd0b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0dc9d3640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd0b80664a0 0x7fd0b8068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8000f70 tx=0x7fd0c8009040 comp rx=0 tx=0).stop 2023-11-20T07:00:51.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/745051232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d806d010 msgr2=0x7fd0d80c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0dc9d3640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d806d010 0x7fd0d80c3770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd0c001b940 tx=0x7fd0c001bad0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/745051232 shutdown_connections 2023-11-20T07:00:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0dc9d3640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd0b80664a0 0x7fd0b8068960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0dc9d3640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0d80c26b0 0x7fd0d80c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0dc9d3640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0d806d010 0x7fd0d80c3770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0dc9d3640 1 --2- 172.21.15.88:0/745051232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0d8069e90 0x7fd0d8140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/745051232 >> 172.21.15.88:0/745051232 conn(0x7fd0d80b0da0 msgr2=0x7fd0d80ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/745051232 shutdown_connections 2023-11-20T07:00:51.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.246+0000 7fd0dc9d3640 1 -- 172.21.15.88:0/745051232 wait complete. 2023-11-20T07:00:51.266 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-20T07:00:51.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.402+0000 7f77f759e640 1 Processor -- start 2023-11-20T07:00:51.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.402+0000 7f77f759e640 1 -- start start 2023-11-20T07:00:51.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.402+0000 7f77f759e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77f815c980 0x7f77f806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.402+0000 7f77f759e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77f80d1490 0x7f77f80b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.402+0000 7f77f759e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f80d3510 con 0x7f77f815cd60 2023-11-20T07:00:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.402+0000 7f77f759e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f80cd2b0 con 0x7f77f815c980 2023-11-20T07:00:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.402+0000 7f77f759e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f80d2f50 con 0x7f77f80d1490 2023-11-20T07:00:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.406+0000 7f77f659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77f815c980 0x7f77f806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.406+0000 7f77f5d9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f77f815cd60 0x7f77f80d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60762/0 (socket says 172.21.15.88:60762) 2023-11-20T07:00:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.406+0000 7f77f5d9b640 1 -- 172.21.15.88:0/3443173543 learned_addr learned my addr 172.21.15.88:0/3443173543 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:00:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.406+0000 7f77f6d9d640 1 --2- 172.21.15.88:0/3443173543 >> v2:172.21.15.175:3300/0 conn(0x7f77f80d1490 0x7f77f80b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.406+0000 7f77f659c640 1 -- 172.21.15.88:0/3443173543 >> v2:172.21.15.175:3300/0 conn(0x7f77f80d1490 msgr2=0x7f77f80b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.406+0000 7f77f659c640 1 --2- 172.21.15.88:0/3443173543 >> v2:172.21.15.175:3300/0 conn(0x7f77f80d1490 0x7f77f80b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.406+0000 7f77f659c640 1 -- 172.21.15.88:0/3443173543 >> v1:172.21.15.88:6789/0 conn(0x7f77f815cd60 legacy=0x7f77f80d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.406+0000 7f77f659c640 1 -- 172.21.15.88:0/3443173543 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f80d3230 con 0x7f77f815c980 2023-11-20T07:00:51.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.406+0000 7f77f659c640 1 --2- 172.21.15.88:0/3443173543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f815c980 0x7f77f806af90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f77f80d1ec0 tx=0x7f77e801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfa3427e905f820 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:51.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.406+0000 7f77f559a640 1 -- 172.21.15.88:0/3443173543 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e80a58b0 con 0x7f77f815c980 2023-11-20T07:00:51.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.406+0000 7f77f559a640 1 -- 172.21.15.88:0/3443173543 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e80a5a10 con 0x7f77f815c980 2023-11-20T07:00:51.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.406+0000 7f77f559a640 1 -- 172.21.15.88:0/3443173543 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e80a5da0 con 0x7f77f815c980 2023-11-20T07:00:51.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 -- 172.21.15.88:0/3443173543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f815c980 msgr2=0x7f77f806af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 --2- 172.21.15.88:0/3443173543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f815c980 0x7f77f806af90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f77f80d1ec0 tx=0x7f77e801d340 comp rx=0 tx=0).stop 2023-11-20T07:00:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 -- 172.21.15.88:0/3443173543 shutdown_connections 2023-11-20T07:00:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 --2- 172.21.15.88:0/3443173543 >> v2:172.21.15.175:3300/0 conn(0x7f77f80d1490 0x7f77f80b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 --2- 172.21.15.88:0/3443173543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f815c980 0x7f77f806af90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 -- 172.21.15.88:0/3443173543 >> 172.21.15.88:0/3443173543 conn(0x7f77f809ba80 msgr2=0x7f77f80d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 -- 172.21.15.88:0/3443173543 shutdown_connections 2023-11-20T07:00:51.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 -- 172.21.15.88:0/3443173543 wait complete. 2023-11-20T07:00:51.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 Processor -- start 2023-11-20T07:00:51.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 -- start start 2023-11-20T07:00:51.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f80d1490 0x7f77f8155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f815c980 0x7f77f80c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f815cd60 0x7f77f80c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80c76b0 con 0x7f77f80d1490 2023-11-20T07:00:51.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80c7990 con 0x7f77f815c980 2023-11-20T07:00:51.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80c7c70 con 0x7f77f815cd60 2023-11-20T07:00:51.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f80d1490 0x7f77f8155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f80d1490 0x7f77f8155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40770/0 (socket says 172.21.15.88:40770) 2023-11-20T07:00:51.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f659c640 1 -- 172.21.15.88:0/2287313026 learned_addr learned my addr 172.21.15.88:0/2287313026 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:51.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f659c640 1 -- 172.21.15.88:0/2287313026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f815cd60 msgr2=0x7f77f80c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f659c640 1 --2- 172.21.15.88:0/2287313026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f815cd60 0x7f77f80c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f659c640 1 -- 172.21.15.88:0/2287313026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f815c980 msgr2=0x7f77f80c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f659c640 1 --2- 172.21.15.88:0/2287313026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f815c980 0x7f77f80c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.410+0000 7f77f659c640 1 -- 172.21.15.88:0/2287313026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e8009a70 con 0x7f77f80d1490 2023-11-20T07:00:51.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.414+0000 7f77f659c640 1 --2- 172.21.15.88:0/2287313026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f80d1490 0x7f77f8155bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f77e80b0040 tx=0x7f77e8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:51.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.414+0000 7f77e6ffd640 1 -- 172.21.15.88:0/2287313026 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e80be070 con 0x7f77f80d1490 2023-11-20T07:00:51.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.414+0000 7f77e6ffd640 1 -- 172.21.15.88:0/2287313026 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e80ad650 con 0x7f77f80d1490 2023-11-20T07:00:51.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.414+0000 7f77e6ffd640 1 -- 172.21.15.88:0/2287313026 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e80ad9e0 con 0x7f77f80d1490 2023-11-20T07:00:51.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.414+0000 7f77f759e640 1 -- 172.21.15.88:0/2287313026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f80c7f50 con 0x7f77f80d1490 2023-11-20T07:00:51.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.414+0000 7f77f759e640 1 -- 172.21.15.88:0/2287313026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f8156130 con 0x7f77f80d1490 2023-11-20T07:00:51.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.414+0000 7f77f759e640 1 -- 172.21.15.88:0/2287313026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f804e9c0 con 0x7f77f80d1490 2023-11-20T07:00:51.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.414+0000 7f77e6ffd640 1 -- 172.21.15.88:0/2287313026 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f77e80b4040 con 0x7f77f80d1490 2023-11-20T07:00:51.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.414+0000 7f77e6ffd640 1 --2- 172.21.15.88:0/2287313026 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f77d80664a0 0x7f77d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.414+0000 7f77e6ffd640 1 -- 172.21.15.88:0/2287313026 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f77e811dfc0 con 0x7f77f80d1490 2023-11-20T07:00:51.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.414+0000 7f77f5d9b640 1 --2- 172.21.15.88:0/2287313026 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f77d80664a0 0x7f77d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.418+0000 7f77f5d9b640 1 --2- 172.21.15.88:0/2287313026 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f77d80664a0 0x7f77d8068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f77f80c5e50 tx=0x7f77ec007a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:51.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.418+0000 7f77e6ffd640 1 -- 172.21.15.88:0/2287313026 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f77e80eb780 con 0x7f77f80d1490 2023-11-20T07:00:51.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.570+0000 7f77f759e640 1 -- 172.21.15.88:0/2287313026 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f77f80c8400 con 0x7f77f80d1490 2023-11-20T07:00:51.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.570+0000 7f77e6ffd640 1 -- 172.21.15.88:0/2287313026 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f77e80b2070 con 0x7f77f80d1490 2023-11-20T07:00:51.572 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:00:51.573 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-11-20T07:00:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:00:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-11-20T07:00:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-11-20T07:00:51.573 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:00:51.573 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-11-20T07:00:51.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.574+0000 7f77f759e640 1 -- 172.21.15.88:0/2287313026 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f77d80664a0 msgr2=0x7f77d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.574+0000 7f77f759e640 1 --2- 172.21.15.88:0/2287313026 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f77d80664a0 0x7f77d8068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f77f80c5e50 tx=0x7f77ec007a50 comp rx=0 tx=0).stop 2023-11-20T07:00:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.574+0000 7f77f759e640 1 -- 172.21.15.88:0/2287313026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f80d1490 msgr2=0x7f77f8155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.574+0000 7f77f759e640 1 --2- 172.21.15.88:0/2287313026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f80d1490 0x7f77f8155bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f77e80b0040 tx=0x7f77e8019680 comp rx=0 tx=0).stop 2023-11-20T07:00:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.574+0000 7f77f759e640 1 -- 172.21.15.88:0/2287313026 shutdown_connections 2023-11-20T07:00:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.574+0000 7f77f759e640 1 --2- 172.21.15.88:0/2287313026 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f77d80664a0 0x7f77d8068960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.574+0000 7f77f759e640 1 --2- 172.21.15.88:0/2287313026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f815cd60 0x7f77f80c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.574+0000 7f77f759e640 1 --2- 172.21.15.88:0/2287313026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f815c980 0x7f77f80c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.574+0000 7f77f759e640 1 --2- 172.21.15.88:0/2287313026 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77f80d1490 0x7f77f8155bf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.574+0000 7f77f759e640 1 -- 172.21.15.88:0/2287313026 >> 172.21.15.88:0/2287313026 conn(0x7f77f809ba80 msgr2=0x7f77f80af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.574+0000 7f77f759e640 1 -- 172.21.15.88:0/2287313026 shutdown_connections 2023-11-20T07:00:51.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.574+0000 7f77f759e640 1 -- 172.21.15.88:0/2287313026 wait complete. 2023-11-20T07:00:51.593 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-20T07:00:51.593 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-20T07:00:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.734+0000 7fce94f3e640 1 Processor -- start 2023-11-20T07:00:51.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.734+0000 7fce94f3e640 1 -- start start 2023-11-20T07:00:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce94f3e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fce901441a0 0x7fce900b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce94f3e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fce900b1a90 0x7fce900cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce94f3e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9015e5f0 con 0x7fce900cb360 2023-11-20T07:00:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce94f3e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce900b1f20 con 0x7fce900b1a90 2023-11-20T07:00:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce94f3e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9015e8d0 con 0x7fce901441a0 2023-11-20T07:00:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce87fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fce900b1a90 0x7fce900cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce87fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fce900b1a90 0x7fce900cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40786/0 (socket says 172.21.15.88:40786) 2023-11-20T07:00:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce87fff640 1 -- 172.21.15.88:0/1781898396 learned_addr learned my addr 172.21.15.88:0/1781898396 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce8ed9d640 1 --1- 172.21.15.88:0/1781898396 >> v1:172.21.15.88:6789/0 conn(0x7fce900cb360 0x7fce9006c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60774/0 (socket says 172.21.15.88:60774) 2023-11-20T07:00:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce8e59c640 1 --2- 172.21.15.88:0/1781898396 >> v2:172.21.15.175:3300/0 conn(0x7fce901441a0 0x7fce900b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce87fff640 1 -- 172.21.15.88:0/1781898396 >> v2:172.21.15.175:3300/0 conn(0x7fce901441a0 msgr2=0x7fce900b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce87fff640 1 --2- 172.21.15.88:0/1781898396 >> v2:172.21.15.175:3300/0 conn(0x7fce901441a0 0x7fce900b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce87fff640 1 -- 172.21.15.88:0/1781898396 >> v1:172.21.15.88:6789/0 conn(0x7fce900cb360 legacy=0x7fce9006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce87fff640 1 -- 172.21.15.88:0/1781898396 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9015ebb0 con 0x7fce900b1a90 2023-11-20T07:00:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.738+0000 7fce8e59c640 1 --2- 172.21.15.88:0/1781898396 >> v2:172.21.15.175:3300/0 conn(0x7fce901441a0 0x7fce900b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:00:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce87fff640 1 --2- 172.21.15.88:0/1781898396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce900b1a90 0x7fce900cae20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce900cc0c0 tx=0x7fce7801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dda882f14dc1ceb server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce8dd9b640 1 -- 172.21.15.88:0/1781898396 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce780ab600 con 0x7fce900b1a90 2023-11-20T07:00:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce8dd9b640 1 -- 172.21.15.88:0/1781898396 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce780a7050 con 0x7fce900b1a90 2023-11-20T07:00:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce8dd9b640 1 -- 172.21.15.88:0/1781898396 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce780ab980 con 0x7fce900b1a90 2023-11-20T07:00:51.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 -- 172.21.15.88:0/1781898396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce900b1a90 msgr2=0x7fce900cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 --2- 172.21.15.88:0/1781898396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce900b1a90 0x7fce900cae20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce900cc0c0 tx=0x7fce7801c500 comp rx=0 tx=0).stop 2023-11-20T07:00:51.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 -- 172.21.15.88:0/1781898396 shutdown_connections 2023-11-20T07:00:51.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 --2- 172.21.15.88:0/1781898396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce900b1a90 0x7fce900cae20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 --2- 172.21.15.88:0/1781898396 >> v2:172.21.15.175:3300/0 conn(0x7fce901441a0 0x7fce900b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 -- 172.21.15.88:0/1781898396 >> 172.21.15.88:0/1781898396 conn(0x7fce9006a820 msgr2=0x7fce900b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:51.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 -- 172.21.15.88:0/1781898396 shutdown_connections 2023-11-20T07:00:51.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 -- 172.21.15.88:0/1781898396 wait complete. 2023-11-20T07:00:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 Processor -- start 2023-11-20T07:00:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 -- start start 2023-11-20T07:00:51.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce900b1a90 0x7fce900cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce900cb360 0x7fce900cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce901441a0 0x7fce900c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce90140fa0 con 0x7fce900cb360 2023-11-20T07:00:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce901f8300 con 0x7fce900b1a90 2023-11-20T07:00:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.742+0000 7fce94f3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce901f85e0 con 0x7fce901441a0 2023-11-20T07:00:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce87fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce900cb360 0x7fce900cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce87fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce900cb360 0x7fce900cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40790/0 (socket says 172.21.15.88:40790) 2023-11-20T07:00:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce87fff640 1 -- 172.21.15.88:0/251647006 learned_addr learned my addr 172.21.15.88:0/251647006 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce8e59c640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce900b1a90 0x7fce900cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce8ed9d640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce901441a0 0x7fce900c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce87fff640 1 -- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce901441a0 msgr2=0x7fce900c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce87fff640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce901441a0 0x7fce900c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce87fff640 1 -- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce900b1a90 msgr2=0x7fce900cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce87fff640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce900b1a90 0x7fce900cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:51.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce87fff640 1 -- 172.21.15.88:0/251647006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce780094d0 con 0x7fce900cb360 2023-11-20T07:00:51.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce87fff640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce900cb360 0x7fce900cd990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce78019110 tx=0x7fce780192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:51.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce86ffd640 1 -- 172.21.15.88:0/251647006 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce780b3890 con 0x7fce900cb360 2023-11-20T07:00:51.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce86ffd640 1 -- 172.21.15.88:0/251647006 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce780b39f0 con 0x7fce900cb360 2023-11-20T07:00:51.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce94f3e640 1 -- 172.21.15.88:0/251647006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce901f88c0 con 0x7fce900cb360 2023-11-20T07:00:51.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce86ffd640 1 -- 172.21.15.88:0/251647006 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce780b3da0 con 0x7fce900cb360 2023-11-20T07:00:51.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce94f3e640 1 -- 172.21.15.88:0/251647006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce901f8e80 con 0x7fce900cb360 2023-11-20T07:00:51.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce94f3e640 1 -- 172.21.15.88:0/251647006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce901f9070 con 0x7fce900cb360 2023-11-20T07:00:51.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.746+0000 7fce86ffd640 1 -- 172.21.15.88:0/251647006 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fce780b2070 con 0x7fce900cb360 2023-11-20T07:00:51.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.750+0000 7fce86ffd640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fce700664a0 0x7fce70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:51.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.750+0000 7fce86ffd640 1 -- 172.21.15.88:0/251647006 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fce7811ddb0 con 0x7fce900cb360 2023-11-20T07:00:51.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.750+0000 7fce8e59c640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fce700664a0 0x7fce70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:51.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.750+0000 7fce8e59c640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fce700664a0 0x7fce70068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce80006fd0 tx=0x7fce80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:51.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.754+0000 7fce86ffd640 1 -- 172.21.15.88:0/251647006 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fce78122070 con 0x7fce900cb360 2023-11-20T07:00:51.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:51.902+0000 7fce94f3e640 1 -- 172.21.15.88:0/251647006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fce9004e170 con 0x7fce900cb360 2023-11-20T07:00:52.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce86ffd640 1 -- 172.21.15.88:0/251647006 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fce780b00b0 con 0x7fce900cb360 2023-11-20T07:00:52.619 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2023-11-20T07:00:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce94f3e640 1 -- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fce700664a0 msgr2=0x7fce70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce94f3e640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fce700664a0 0x7fce70068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce80006fd0 tx=0x7fce80008040 comp rx=0 tx=0).stop 2023-11-20T07:00:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce94f3e640 1 -- 172.21.15.88:0/251647006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce900cb360 msgr2=0x7fce900cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce94f3e640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce900cb360 0x7fce900cd990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce78019110 tx=0x7fce780192a0 comp rx=0 tx=0).stop 2023-11-20T07:00:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce94f3e640 1 -- 172.21.15.88:0/251647006 shutdown_connections 2023-11-20T07:00:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce94f3e640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fce700664a0 0x7fce70068960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce94f3e640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce901441a0 0x7fce900c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:52.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce94f3e640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce900cb360 0x7fce900cd990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:52.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce94f3e640 1 --2- 172.21.15.88:0/251647006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce900b1a90 0x7fce900cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:52.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce94f3e640 1 -- 172.21.15.88:0/251647006 >> 172.21.15.88:0/251647006 conn(0x7fce9006a820 msgr2=0x7fce90071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:52.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce94f3e640 1 -- 172.21.15.88:0/251647006 shutdown_connections 2023-11-20T07:00:52.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.618+0000 7fce94f3e640 1 -- 172.21.15.88:0/251647006 wait complete. 2023-11-20T07:00:52.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-11-20T07:00:52.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f677bbf8640 1 Processor -- start 2023-11-20T07:00:52.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f677bbf8640 1 -- start start 2023-11-20T07:00:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f677bbf8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67740d0300 0x7f6774167b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f677bbf8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6774161720 con 0x7f67740b89b0 2023-11-20T07:00:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f677bbf8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6774160ba0 con 0x7f67740b85d0 2023-11-20T07:00:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f677bbf8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6774160e80 con 0x7f67740d0300 2023-11-20T07:00:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f6779193640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f67740b89b0 0x7f67740cfbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60788/0 (socket says 172.21.15.88:60788) 2023-11-20T07:00:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f6779193640 1 -- 172.21.15.88:0/2030756345 learned_addr learned my addr 172.21.15.88:0/2030756345 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:00:52.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f677a195640 1 --2- 172.21.15.88:0/2030756345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67740d0300 0x7f6774167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f6778992640 1 -- 172.21.15.88:0/2030756345 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239323489 0 0) 0x7f6774161720 con 0x7f67740b89b0 2023-11-20T07:00:52.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f6778992640 1 -- 172.21.15.88:0/2030756345 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6760003530 con 0x7f67740b89b0 2023-11-20T07:00:52.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f6778992640 1 -- 172.21.15.88:0/2030756345 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118236917 0 0) 0x7f6774160ba0 con 0x7f67740b85d0 2023-11-20T07:00:52.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f6778992640 1 -- 172.21.15.88:0/2030756345 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6774161720 con 0x7f67740b85d0 2023-11-20T07:00:52.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f677a195640 1 -- 172.21.15.88:0/2030756345 >> v1:172.21.15.175:6789/0 conn(0x7f67740b85d0 legacy=0x7f677415dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:52.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f677a195640 1 -- 172.21.15.88:0/2030756345 >> v1:172.21.15.88:6789/0 conn(0x7f67740b89b0 legacy=0x7f67740cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:52.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.790+0000 7f677a195640 1 -- 172.21.15.88:0/2030756345 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6774161160 con 0x7f67740d0300 2023-11-20T07:00:52.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.794+0000 7f677a195640 1 --2- 172.21.15.88:0/2030756345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67740d0300 0x7f6774167b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f676c009dc0 tx=0x7f676c01d3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4670986a7a8bdd23 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:52.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.794+0000 7f6778992640 1 -- 172.21.15.88:0/2030756345 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c0a5a20 con 0x7f67740d0300 2023-11-20T07:00:52.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.794+0000 7f6778992640 1 -- 172.21.15.88:0/2030756345 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c0a5b80 con 0x7f67740d0300 2023-11-20T07:00:52.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.794+0000 7f6778992640 1 -- 172.21.15.88:0/2030756345 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c0ad440 con 0x7f67740d0300 2023-11-20T07:00:52.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.794+0000 7f677bbf8640 1 -- 172.21.15.88:0/2030756345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67740d0300 msgr2=0x7f6774167b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:52.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.794+0000 7f677bbf8640 1 --2- 172.21.15.88:0/2030756345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67740d0300 0x7f6774167b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f676c009dc0 tx=0x7f676c01d3a0 comp rx=0 tx=0).stop 2023-11-20T07:00:52.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.794+0000 7f677bbf8640 1 -- 172.21.15.88:0/2030756345 shutdown_connections 2023-11-20T07:00:52.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.794+0000 7f677bbf8640 1 --2- 172.21.15.88:0/2030756345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67740d0300 0x7f6774167b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:52.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.794+0000 7f677bbf8640 1 -- 172.21.15.88:0/2030756345 >> 172.21.15.88:0/2030756345 conn(0x7f677406b750 msgr2=0x7f677406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:52.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.794+0000 7f677bbf8640 1 -- 172.21.15.88:0/2030756345 shutdown_connections 2023-11-20T07:00:52.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.794+0000 7f677bbf8640 1 -- 172.21.15.88:0/2030756345 wait complete. 2023-11-20T07:00:52.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f677bbf8640 1 Processor -- start 2023-11-20T07:00:52.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f677bbf8640 1 -- start start 2023-11-20T07:00:52.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f677bbf8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67740b85d0 0x7f677414e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:52.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f677bbf8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67740b89b0 0x7f677414eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:52.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f677bbf8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67740d0300 0x7f67741f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:52.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f677bbf8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6774156730 con 0x7f67740b85d0 2023-11-20T07:00:52.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f677bbf8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67741544a0 con 0x7f67740b89b0 2023-11-20T07:00:52.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f677bbf8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6774155880 con 0x7f67740d0300 2023-11-20T07:00:52.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f6779994640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67740b85d0 0x7f677414e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:52.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f6779994640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67740b85d0 0x7f677414e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40792/0 (socket says 172.21.15.88:40792) 2023-11-20T07:00:52.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f6779994640 1 -- 172.21.15.88:0/1733620247 learned_addr learned my addr 172.21.15.88:0/1733620247 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:52.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f6779193640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67740b89b0 0x7f677414eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:52.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f677a195640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67740d0300 0x7f67741f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:52.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f6779994640 1 -- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67740d0300 msgr2=0x7f67741f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:52.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f6779994640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67740d0300 0x7f67741f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:52.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f6779994640 1 -- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67740b89b0 msgr2=0x7f677414eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:52.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f6779994640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67740b89b0 0x7f677414eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:52.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f6779994640 1 -- 172.21.15.88:0/1733620247 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c009a70 con 0x7f67740b85d0 2023-11-20T07:00:52.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f6779994640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67740b85d0 0x7f677414e3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f677000c490 tx=0x7f677000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:52.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f676a7fc640 1 -- 172.21.15.88:0/1733620247 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700052d0 con 0x7f67740b85d0 2023-11-20T07:00:52.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f676a7fc640 1 -- 172.21.15.88:0/1733620247 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6770005430 con 0x7f67740b85d0 2023-11-20T07:00:52.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f677bbf8640 1 -- 172.21.15.88:0/1733620247 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6774155ab0 con 0x7f67740b85d0 2023-11-20T07:00:52.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f676a7fc640 1 -- 172.21.15.88:0/1733620247 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770012870 con 0x7f67740b85d0 2023-11-20T07:00:52.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.798+0000 7f677bbf8640 1 -- 172.21.15.88:0/1733620247 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6774156350 con 0x7f67740b85d0 2023-11-20T07:00:52.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.802+0000 7f677bbf8640 1 -- 172.21.15.88:0/1733620247 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677404e170 con 0x7f67740b85d0 2023-11-20T07:00:52.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.802+0000 7f676a7fc640 1 -- 172.21.15.88:0/1733620247 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f67700129d0 con 0x7f67740b85d0 2023-11-20T07:00:52.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.802+0000 7f676a7fc640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f67580664a0 0x7f6758068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:52.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.802+0000 7f676a7fc640 1 -- 172.21.15.88:0/1733620247 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f67700837f0 con 0x7f67740b85d0 2023-11-20T07:00:52.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.802+0000 7f6779193640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f67580664a0 0x7f6758068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:52.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.802+0000 7f6779193640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f67580664a0 0x7f6758068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6774157740 tx=0x7f6764009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:52.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.806+0000 7f676a7fc640 1 -- 172.21.15.88:0/1733620247 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6770050ee0 con 0x7f67740b85d0 2023-11-20T07:00:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:52.958+0000 7f677bbf8640 1 -- 172.21.15.88:0/1733620247 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f67740d0900 con 0x7f67740b85d0 2023-11-20T07:00:53.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.622+0000 7f676a7fc640 1 -- 172.21.15.88:0/1733620247 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f6770054500 con 0x7f67740b85d0 2023-11-20T07:00:53.622 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2023-11-20T07:00:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.622+0000 7f677bbf8640 1 -- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f67580664a0 msgr2=0x7f6758068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.622+0000 7f677bbf8640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f67580664a0 0x7f6758068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6774157740 tx=0x7f6764009040 comp rx=0 tx=0).stop 2023-11-20T07:00:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.626+0000 7f677bbf8640 1 -- 172.21.15.88:0/1733620247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67740b85d0 msgr2=0x7f677414e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.626+0000 7f677bbf8640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67740b85d0 0x7f677414e3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f677000c490 tx=0x7f677000c950 comp rx=0 tx=0).stop 2023-11-20T07:00:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.626+0000 7f677bbf8640 1 -- 172.21.15.88:0/1733620247 shutdown_connections 2023-11-20T07:00:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.626+0000 7f677bbf8640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f67580664a0 0x7f6758068960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.626+0000 7f677bbf8640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67740d0300 0x7f67741f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.626+0000 7f677bbf8640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67740b89b0 0x7f677414eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.626+0000 7f677bbf8640 1 --2- 172.21.15.88:0/1733620247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67740b85d0 0x7f677414e3c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.626+0000 7f677bbf8640 1 -- 172.21.15.88:0/1733620247 >> 172.21.15.88:0/1733620247 conn(0x7f677406b750 msgr2=0x7f677406bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.626+0000 7f677bbf8640 1 -- 172.21.15.88:0/1733620247 shutdown_connections 2023-11-20T07:00:53.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.626+0000 7f677bbf8640 1 -- 172.21.15.88:0/1733620247 wait complete. 2023-11-20T07:00:53.668 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-20T07:00:53.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.806+0000 7fdab2f96640 1 Processor -- start 2023-11-20T07:00:53.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.806+0000 7fdab2f96640 1 -- start start 2023-11-20T07:00:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab2f96640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdaac0cf210 0x7fdaac0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab2f96640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdaac15cdc0 0x7fdaac0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab2f96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaac0d3320 0x7fdaac0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab2f96640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac0cfb30 con 0x7fdaac0cf210 2023-11-20T07:00:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab2f96640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac0d0880 con 0x7fdaac15cdc0 2023-11-20T07:00:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab2f96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0b1c00 con 0x7fdaac0d3320 2023-11-20T07:00:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab1f94640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdaac0cf210 0x7fdaac0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab1f94640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdaac0cf210 0x7fdaac0cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40802/0 (socket says 172.21.15.88:40802) 2023-11-20T07:00:53.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab1f94640 1 -- 172.21.15.88:0/999130035 learned_addr learned my addr 172.21.15.88:0/999130035 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab2795640 1 --2- 172.21.15.88:0/999130035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaac0d3320 0x7fdaac0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab1793640 1 --2- 172.21.15.88:0/999130035 >> v2:172.21.15.175:3300/0 conn(0x7fdaac15cdc0 0x7fdaac0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab1f94640 1 -- 172.21.15.88:0/999130035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaac0d3320 msgr2=0x7fdaac0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab1f94640 1 --2- 172.21.15.88:0/999130035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaac0d3320 0x7fdaac0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab1f94640 1 -- 172.21.15.88:0/999130035 >> v2:172.21.15.175:3300/0 conn(0x7fdaac15cdc0 msgr2=0x7fdaac0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab1f94640 1 --2- 172.21.15.88:0/999130035 >> v2:172.21.15.175:3300/0 conn(0x7fdaac15cdc0 0x7fdaac0b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab1f94640 1 -- 172.21.15.88:0/999130035 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac0b1ee0 con 0x7fdaac0cf210 2023-11-20T07:00:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab2795640 1 --2- 172.21.15.88:0/999130035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaac0d3320 0x7fdaac0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:00:53.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.810+0000 7fdab1793640 1 --2- 172.21.15.88:0/999130035 >> v2:172.21.15.175:3300/0 conn(0x7fdaac15cdc0 0x7fdaac0b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:00:53.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab1f94640 1 --2- 172.21.15.88:0/999130035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdaac0cf210 0x7fdaac0cf5f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0b88b0 tx=0x7fdaa801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c05564a94c6cbf server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:53.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab0f92640 1 -- 172.21.15.88:0/999130035 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa80ac600 con 0x7fdaac0cf210 2023-11-20T07:00:53.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab0f92640 1 -- 172.21.15.88:0/999130035 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa80a8050 con 0x7fdaac0cf210 2023-11-20T07:00:53.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab0f92640 1 -- 172.21.15.88:0/999130035 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa80ac980 con 0x7fdaac0cf210 2023-11-20T07:00:53.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab2f96640 1 -- 172.21.15.88:0/999130035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdaac0cf210 msgr2=0x7fdaac0cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:53.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab2f96640 1 --2- 172.21.15.88:0/999130035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdaac0cf210 0x7fdaac0cf5f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0b88b0 tx=0x7fdaa801c4d0 comp rx=0 tx=0).stop 2023-11-20T07:00:53.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab2f96640 1 -- 172.21.15.88:0/999130035 shutdown_connections 2023-11-20T07:00:53.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab2f96640 1 --2- 172.21.15.88:0/999130035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaac0d3320 0x7fdaac0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:53.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab2f96640 1 --2- 172.21.15.88:0/999130035 >> v2:172.21.15.175:3300/0 conn(0x7fdaac15cdc0 0x7fdaac0b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:53.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab2f96640 1 --2- 172.21.15.88:0/999130035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdaac0cf210 0x7fdaac0cf5f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:53.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab2f96640 1 -- 172.21.15.88:0/999130035 >> 172.21.15.88:0/999130035 conn(0x7fdaac0d2800 msgr2=0x7fdaac0d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:53.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab2f96640 1 -- 172.21.15.88:0/999130035 shutdown_connections 2023-11-20T07:00:53.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab2f96640 1 -- 172.21.15.88:0/999130035 wait complete. 2023-11-20T07:00:53.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab2f96640 1 Processor -- start 2023-11-20T07:00:53.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.814+0000 7fdab2f96640 1 -- start start 2023-11-20T07:00:53.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2f96640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaac0cf210 0x7fdaac155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:53.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2f96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaac0d3320 0x7fdaac157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:53.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2f96640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdaac15cdc0 0x7fdaac151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:53.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2f96640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac15c6b0 con 0x7fdaac15cdc0 2023-11-20T07:00:53.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2f96640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac15d9d0 con 0x7fdaac0cf210 2023-11-20T07:00:53.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2f96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac15c3d0 con 0x7fdaac0d3320 2023-11-20T07:00:53.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2795640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdaac15cdc0 0x7fdaac151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:53.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab1f94640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaac0cf210 0x7fdaac155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:53.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2795640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdaac15cdc0 0x7fdaac151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40808/0 (socket says 172.21.15.88:40808) 2023-11-20T07:00:53.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2795640 1 -- 172.21.15.88:0/1024946469 learned_addr learned my addr 172.21.15.88:0/1024946469 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:53.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab1793640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaac0d3320 0x7fdaac157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:53.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2795640 1 -- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaac0d3320 msgr2=0x7fdaac157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:53.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2795640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaac0d3320 0x7fdaac157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:53.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2795640 1 -- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaac0cf210 msgr2=0x7fdaac155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:53.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2795640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaac0cf210 0x7fdaac155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2795640 1 -- 172.21.15.88:0/1024946469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa8009480 con 0x7fdaac15cdc0 2023-11-20T07:00:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2795640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdaac15cdc0 0x7fdaac151b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400cef0 tx=0x7fdaa400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdaa27fc640 1 -- 172.21.15.88:0/1024946469 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa400d840 con 0x7fdaac15cdc0 2023-11-20T07:00:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdaa27fc640 1 -- 172.21.15.88:0/1024946469 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa400d9a0 con 0x7fdaac15cdc0 2023-11-20T07:00:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdaa27fc640 1 -- 172.21.15.88:0/1024946469 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa400dd50 con 0x7fdaac15cdc0 2023-11-20T07:00:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2f96640 1 -- 172.21.15.88:0/1024946469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac15d380 con 0x7fdaac15cdc0 2023-11-20T07:00:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2f96640 1 -- 172.21.15.88:0/1024946469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac152800 con 0x7fdaac15cdc0 2023-11-20T07:00:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdab2f96640 1 -- 172.21.15.88:0/1024946469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac15d1e0 con 0x7fdaac15cdc0 2023-11-20T07:00:53.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.818+0000 7fdaa27fc640 1 -- 172.21.15.88:0/1024946469 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdaa401e3b0 con 0x7fdaac15cdc0 2023-11-20T07:00:53.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.822+0000 7fdaa27fc640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fda900664a0 0x7fda90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:53.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.822+0000 7fdaa27fc640 1 -- 172.21.15.88:0/1024946469 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fdaa40847b0 con 0x7fdaac15cdc0 2023-11-20T07:00:53.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.822+0000 7fdab1f94640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fda900664a0 0x7fda90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:53.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.822+0000 7fdab1f94640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fda900664a0 0x7fda90068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80ae000 tx=0x7fdaa8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:53.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:53.826+0000 7fdaa27fc640 1 -- 172.21.15.88:0/1024946469 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdaac15d1e0 con 0x7fdaac15cdc0 2023-11-20T07:00:54.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.006+0000 7fdab2f96640 1 -- 172.21.15.88:0/1024946469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdaac15d1e0 con 0x7fdaac15cdc0 2023-11-20T07:00:54.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.650+0000 7fdaa27fc640 1 -- 172.21.15.88:0/1024946469 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdaac15d1e0 con 0x7fdaac15cdc0 2023-11-20T07:00:54.653 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 2 and data pool 3 2023-11-20T07:00:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.654+0000 7fdab2f96640 1 -- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fda900664a0 msgr2=0x7fda90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.654+0000 7fdab2f96640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fda900664a0 0x7fda90068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80ae000 tx=0x7fdaa8008040 comp rx=0 tx=0).stop 2023-11-20T07:00:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.654+0000 7fdab2f96640 1 -- 172.21.15.88:0/1024946469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdaac15cdc0 msgr2=0x7fdaac151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.654+0000 7fdab2f96640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdaac15cdc0 0x7fdaac151b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400cef0 tx=0x7fdaa400a710 comp rx=0 tx=0).stop 2023-11-20T07:00:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.654+0000 7fdab2f96640 1 -- 172.21.15.88:0/1024946469 shutdown_connections 2023-11-20T07:00:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.654+0000 7fdab2f96640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fda900664a0 0x7fda90068960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.654+0000 7fdab2f96640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaac0d3320 0x7fdaac157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.654+0000 7fdab2f96640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdaac15cdc0 0x7fdaac151b10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:54.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.654+0000 7fdab2f96640 1 --2- 172.21.15.88:0/1024946469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaac0cf210 0x7fdaac155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:54.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.654+0000 7fdab2f96640 1 -- 172.21.15.88:0/1024946469 >> 172.21.15.88:0/1024946469 conn(0x7fdaac0d2800 msgr2=0x7fdaac0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:54.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.654+0000 7fdab2f96640 1 -- 172.21.15.88:0/1024946469 shutdown_connections 2023-11-20T07:00:54.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.654+0000 7fdab2f96640 1 -- 172.21.15.88:0/1024946469 wait complete. 2023-11-20T07:00:54.679 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-11-20T07:00:54.679 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-11-20T07:00:54.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f144359e640 1 Processor -- start 2023-11-20T07:00:54.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f144359e640 1 -- start start 2023-11-20T07:00:54.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f144359e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f144415ffb0 0x7f14440cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:54.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f144359e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f14440d1590 0x7f14440ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:54.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f144359e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14440d04f0 con 0x7f14440cf090 2023-11-20T07:00:54.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f144359e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14440d2000 con 0x7f14440d1590 2023-11-20T07:00:54.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f144359e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14440d07d0 con 0x7f144415ffb0 2023-11-20T07:00:54.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f143bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f14440d1590 0x7f14440ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:54.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f143bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f14440d1590 0x7f14440ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:59058/0 (socket says 172.21.15.88:59058) 2023-11-20T07:00:54.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f143bfff640 1 -- 172.21.15.88:0/1259561230 learned_addr learned my addr 172.21.15.88:0/1259561230 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:54.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f144259c640 1 --2- 172.21.15.88:0/1259561230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f144415ffb0 0x7f14440cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:54.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f143bfff640 1 -- 172.21.15.88:0/1259561230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f144415ffb0 msgr2=0x7f14440cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:54.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f143bfff640 1 --2- 172.21.15.88:0/1259561230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f144415ffb0 0x7f14440cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:54.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f143bfff640 1 -- 172.21.15.88:0/1259561230 >> v1:172.21.15.175:6789/0 conn(0x7f14440cf090 legacy=0x7f1444160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:54.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f143bfff640 1 -- 172.21.15.88:0/1259561230 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14440d0ab0 con 0x7f14440d1590 2023-11-20T07:00:54.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.822+0000 7f144259c640 1 --2- 172.21.15.88:0/1259561230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f144415ffb0 0x7f14440cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:00:54.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.826+0000 7f143bfff640 1 --2- 172.21.15.88:0/1259561230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440d1590 0x7f14440ce440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f142c009870 tx=0x7f142c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8194cb1b98f418e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.826+0000 7f1441d9b640 1 -- 172.21.15.88:0/1259561230 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0a7070 con 0x7f14440d1590 2023-11-20T07:00:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.826+0000 7f1441d9b640 1 -- 172.21.15.88:0/1259561230 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c0ab430 con 0x7f14440d1590 2023-11-20T07:00:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.826+0000 7f1441d9b640 1 -- 172.21.15.88:0/1259561230 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c0ab7c0 con 0x7f14440d1590 2023-11-20T07:00:54.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.826+0000 7f144359e640 1 -- 172.21.15.88:0/1259561230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440d1590 msgr2=0x7f14440ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:54.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.826+0000 7f144359e640 1 --2- 172.21.15.88:0/1259561230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440d1590 0x7f14440ce440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f142c009870 tx=0x7f142c01c540 comp rx=0 tx=0).stop 2023-11-20T07:00:54.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.826+0000 7f144359e640 1 -- 172.21.15.88:0/1259561230 shutdown_connections 2023-11-20T07:00:54.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.826+0000 7f144359e640 1 --2- 172.21.15.88:0/1259561230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440d1590 0x7f14440ce440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:54.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.826+0000 7f144359e640 1 --2- 172.21.15.88:0/1259561230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f144415ffb0 0x7f14440cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:54.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.826+0000 7f144359e640 1 -- 172.21.15.88:0/1259561230 >> 172.21.15.88:0/1259561230 conn(0x7f14440d27a0 msgr2=0x7f14440d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:54.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.826+0000 7f144359e640 1 -- 172.21.15.88:0/1259561230 shutdown_connections 2023-11-20T07:00:54.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.826+0000 7f144359e640 1 -- 172.21.15.88:0/1259561230 wait complete. 2023-11-20T07:00:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f144359e640 1 Processor -- start 2023-11-20T07:00:54.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f144359e640 1 -- start start 2023-11-20T07:00:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f144359e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440cf090 0x7f144415b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f144359e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440d1590 0x7f14440c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f144359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144415ffb0 0x7f14440b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f144359e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144415bdb0 con 0x7f144415ffb0 2023-11-20T07:00:54.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f144359e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144415bb10 con 0x7f14440cf090 2023-11-20T07:00:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f144359e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14440b5560 con 0x7f14440d1590 2023-11-20T07:00:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f1442d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144415ffb0 0x7f14440b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f1442d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144415ffb0 0x7f14440b7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40824/0 (socket says 172.21.15.88:40824) 2023-11-20T07:00:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f1442d9d640 1 -- 172.21.15.88:0/2567645618 learned_addr learned my addr 172.21.15.88:0/2567645618 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f144259c640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440cf090 0x7f144415b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f143bfff640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440d1590 0x7f14440c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f1442d9d640 1 -- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440d1590 msgr2=0x7f14440c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f1442d9d640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440d1590 0x7f14440c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f1442d9d640 1 -- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440cf090 msgr2=0x7f144415b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f1442d9d640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440cf090 0x7f144415b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f1442d9d640 1 -- 172.21.15.88:0/2567645618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14340093b0 con 0x7f144415ffb0 2023-11-20T07:00:54.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f1442d9d640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144415ffb0 0x7f14440b7610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f143c00c770 tx=0x7f143c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f143affd640 1 -- 172.21.15.88:0/2567645618 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c003b80 con 0x7f144415ffb0 2023-11-20T07:00:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f143affd640 1 -- 172.21.15.88:0/2567645618 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c003ce0 con 0x7f144415ffb0 2023-11-20T07:00:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f144359e640 1 -- 172.21.15.88:0/2567645618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c0094d0 con 0x7f144415ffb0 2023-11-20T07:00:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f143affd640 1 -- 172.21.15.88:0/2567645618 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c00aa90 con 0x7f144415ffb0 2023-11-20T07:00:54.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.830+0000 7f144359e640 1 -- 172.21.15.88:0/2567645618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14440b5b20 con 0x7f144415ffb0 2023-11-20T07:00:54.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.834+0000 7f144359e640 1 -- 172.21.15.88:0/2567645618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144404e9c0 con 0x7f144415ffb0 2023-11-20T07:00:54.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.834+0000 7f143affd640 1 -- 172.21.15.88:0/2567645618 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f143c00abf0 con 0x7f144415ffb0 2023-11-20T07:00:54.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.834+0000 7f143affd640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f14240664a0 0x7f1424068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:54.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.834+0000 7f143affd640 1 -- 172.21.15.88:0/2567645618 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f143c083b80 con 0x7f144415ffb0 2023-11-20T07:00:54.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.834+0000 7f144259c640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f14240664a0 0x7f1424068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:54.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.834+0000 7f144259c640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f14240664a0 0x7f1424068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14440b0470 tx=0x7f1434006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:54.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.838+0000 7f143affd640 1 -- 172.21.15.88:0/2567645618 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f143c0510a0 con 0x7f144415ffb0 2023-11-20T07:00:54.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:54.994+0000 7f144359e640 1 -- 172.21.15.88:0/2567645618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f14440c5e80 con 0x7f144415ffb0 2023-11-20T07:00:55.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.286+0000 7f143affd640 1 -- 172.21.15.88:0/2567645618 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f143c0546c0 con 0x7f144415ffb0 2023-11-20T07:00:55.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.290+0000 7f144359e640 1 -- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f14240664a0 msgr2=0x7f1424068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:55.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.290+0000 7f144359e640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f14240664a0 0x7f1424068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14440b0470 tx=0x7f1434006f90 comp rx=0 tx=0).stop 2023-11-20T07:00:55.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.290+0000 7f144359e640 1 -- 172.21.15.88:0/2567645618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144415ffb0 msgr2=0x7f14440b7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:55.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.290+0000 7f144359e640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144415ffb0 0x7f14440b7610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f143c00c770 tx=0x7f143c00cc30 comp rx=0 tx=0).stop 2023-11-20T07:00:55.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.290+0000 7f144359e640 1 -- 172.21.15.88:0/2567645618 shutdown_connections 2023-11-20T07:00:55.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.290+0000 7f144359e640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f14240664a0 0x7f1424068960 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:55.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.290+0000 7f144359e640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440d1590 0x7f14440c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:55.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.290+0000 7f144359e640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f144415ffb0 0x7f14440b7610 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:55.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.290+0000 7f144359e640 1 --2- 172.21.15.88:0/2567645618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440cf090 0x7f144415b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:55.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.290+0000 7f144359e640 1 -- 172.21.15.88:0/2567645618 >> 172.21.15.88:0/2567645618 conn(0x7f14440d27a0 msgr2=0x7f144406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:55.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.290+0000 7f144359e640 1 -- 172.21.15.88:0/2567645618 shutdown_connections 2023-11-20T07:00:55.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.290+0000 7f144359e640 1 -- 172.21.15.88:0/2567645618 wait complete. 2023-11-20T07:00:55.310 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-11-20T07:00:55.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a32846640 1 Processor -- start 2023-11-20T07:00:55.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a32846640 1 -- start start 2023-11-20T07:00:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a32846640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a2c15cc30 0x7f1a2c070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a32846640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1a2c1611a0 0x7f1a2c069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a32846640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c071550 con 0x7f1a2c0710f0 2023-11-20T07:00:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a32846640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c161800 con 0x7f1a2c1611a0 2023-11-20T07:00:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a32846640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0ccc80 con 0x7f1a2c15cc30 2023-11-20T07:00:55.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1a2c0710f0 0x7f1a2c160a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60804/0 (socket says 172.21.15.88:60804) 2023-11-20T07:00:55.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2b7fe640 1 -- 172.21.15.88:0/418947584 learned_addr learned my addr 172.21.15.88:0/418947584 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:00:55.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2bfff640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a2c15cc30 0x7f1a2c070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:55.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783386395 0 0) 0x7f1a2c071550 con 0x7f1a2c0710f0 2023-11-20T07:00:55.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a30de3640 1 --2- 172.21.15.88:0/418947584 >> v2:172.21.15.175:3300/0 conn(0x7f1a2c1611a0 0x7f1a2c069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a14003530 con 0x7f1a2c0710f0 2023-11-20T07:00:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3208461518 0 0) 0x7f1a14003530 con 0x7f1a2c0710f0 2023-11-20T07:00:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a2c15cc30 msgr2=0x7f1a2c070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a2c15cc30 0x7f1a2c070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 >> v2:172.21.15.175:3300/0 conn(0x7f1a2c1611a0 msgr2=0x7f1a2c069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 --2- 172.21.15.88:0/418947584 >> v2:172.21.15.175:3300/0 conn(0x7f1a2c1611a0 0x7f1a2c069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c0ccf60 con 0x7f1a2c0710f0 2023-11-20T07:00:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f1a20001680 con 0x7f1a2c0710f0 2023-11-20T07:00:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 >> v1:172.21.15.88:6789/0 conn(0x7f1a2c0710f0 legacy=0x7f1a2c160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a14003980 0x7f1a14003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a140047d0 0x7f1a14004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:55.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a2c15cc30 0x7f1a14005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c161800 con 0x7f1a14003980 2023-11-20T07:00:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0ccc80 con 0x7f1a140047d0 2023-11-20T07:00:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1400b990 con 0x7f1a2c15cc30 2023-11-20T07:00:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2bfff640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a14003980 0x7f1a14003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2b7fe640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a140047d0 0x7f1a14004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a30de3640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a2c15cc30 0x7f1a14005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2bfff640 1 -- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a2c15cc30 msgr2=0x7f1a14005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2bfff640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a2c15cc30 0x7f1a14005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2bfff640 1 -- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a140047d0 msgr2=0x7f1a14004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2bfff640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a140047d0 0x7f1a14004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2bfff640 1 -- 172.21.15.88:0/418947584 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14003530 con 0x7f1a14003980 2023-11-20T07:00:55.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a2b7fe640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a140047d0 0x7f1a14004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:00:55.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.458+0000 7f1a30de3640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a2c15cc30 0x7f1a14005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:00:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.462+0000 7f1a2bfff640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a14003980 0x7f1a14003da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009ae0 tx=0x7f1a1c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e930a4ae4c5865a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.462+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0a9450 con 0x7f1a14003980 2023-11-20T07:00:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.462+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0a95b0 con 0x7f1a14003980 2023-11-20T07:00:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.462+0000 7f1a2affd640 1 -- 172.21.15.88:0/418947584 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0a9960 con 0x7f1a14003980 2023-11-20T07:00:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.462+0000 7f1a32846640 1 -- 172.21.15.88:0/418947584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a14003980 msgr2=0x7f1a14003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.462+0000 7f1a32846640 1 --2- 172.21.15.88:0/418947584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a14003980 0x7f1a14003da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009ae0 tx=0x7f1a1c01ca50 comp rx=0 tx=0).stop 2023-11-20T07:00:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.462+0000 7f1a30de3640 1 -- 172.21.15.88:0/418947584 reap_dead start 2023-11-20T07:00:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.462+0000 7f1a32846640 1 -- 172.21.15.88:0/418947584 shutdown_connections 2023-11-20T07:00:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.462+0000 7f1a32846640 1 -- 172.21.15.88:0/418947584 >> 172.21.15.88:0/418947584 conn(0x7f1a2c0cef10 msgr2=0x7f1a2c0cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.462+0000 7f1a32846640 1 -- 172.21.15.88:0/418947584 shutdown_connections 2023-11-20T07:00:55.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.462+0000 7f1a32846640 1 -- 172.21.15.88:0/418947584 wait complete. 2023-11-20T07:00:55.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a32846640 1 Processor -- start 2023-11-20T07:00:55.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a32846640 1 -- start start 2023-11-20T07:00:55.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a32846640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a14003980 0x7f1a2c0c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:55.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a32846640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a2c14e7b0 0x7f1a2c0c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:55.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a32846640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a2c0b3ba0 0x7f1a2c0b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:55.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a32846640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0b4560 con 0x7f1a2c14e7b0 2023-11-20T07:00:55.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a32846640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c14ec30 con 0x7f1a2c0b3ba0 2023-11-20T07:00:55.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a32846640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0c9380 con 0x7f1a14003980 2023-11-20T07:00:55.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a2b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a2c14e7b0 0x7f1a2c0c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:55.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a2b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a2c14e7b0 0x7f1a2c0c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40846/0 (socket says 172.21.15.88:40846) 2023-11-20T07:00:55.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a2b7fe640 1 -- 172.21.15.88:0/3480019452 learned_addr learned my addr 172.21.15.88:0/3480019452 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:55.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a30de3640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a2c0b3ba0 0x7f1a2c0b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:55.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a2bfff640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a14003980 0x7f1a2c0c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:55.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a2b7fe640 1 -- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a14003980 msgr2=0x7f1a2c0c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:55.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a2b7fe640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a14003980 0x7f1a2c0c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:55.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a2b7fe640 1 -- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a2c0b3ba0 msgr2=0x7f1a2c0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:55.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a2b7fe640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a2c0b3ba0 0x7f1a2c0b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:55.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a2b7fe640 1 -- 172.21.15.88:0/3480019452 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c0c8dc0 con 0x7f1a2c14e7b0 2023-11-20T07:00:55.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a2b7fe640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a2c14e7b0 0x7f1a2c0c8570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000e780 tx=0x7f1a2000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:55.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a28ff9640 1 -- 172.21.15.88:0/3480019452 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000ee30 con 0x7f1a2c14e7b0 2023-11-20T07:00:55.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a28ff9640 1 -- 172.21.15.88:0/3480019452 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2000c850 con 0x7f1a2c14e7b0 2023-11-20T07:00:55.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a32846640 1 -- 172.21.15.88:0/3480019452 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c0c90a0 con 0x7f1a2c14e7b0 2023-11-20T07:00:55.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a28ff9640 1 -- 172.21.15.88:0/3480019452 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000cbc0 con 0x7f1a2c14e7b0 2023-11-20T07:00:55.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.466+0000 7f1a32846640 1 -- 172.21.15.88:0/3480019452 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c0c9ff0 con 0x7f1a2c14e7b0 2023-11-20T07:00:55.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.470+0000 7f1a32846640 1 -- 172.21.15.88:0/3480019452 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c04e170 con 0x7f1a2c14e7b0 2023-11-20T07:00:55.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.470+0000 7f1a28ff9640 1 -- 172.21.15.88:0/3480019452 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1a2000cd20 con 0x7f1a2c14e7b0 2023-11-20T07:00:55.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.470+0000 7f1a28ff9640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1a180664d0 0x7f1a18068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:55.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.470+0000 7f1a28ff9640 1 -- 172.21.15.88:0/3480019452 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f1a20083c70 con 0x7f1a2c14e7b0 2023-11-20T07:00:55.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.470+0000 7f1a2bfff640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1a180664d0 0x7f1a18068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:55.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.470+0000 7f1a2bfff640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1a180664d0 0x7f1a18068990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0ae000 tx=0x7f1a1c0b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:55.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.474+0000 7f1a28ff9640 1 -- 172.21.15.88:0/3480019452 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1a200510b0 con 0x7f1a2c14e7b0 2023-11-20T07:00:55.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:55.622+0000 7f1a32846640 1 -- 172.21.15.88:0/3480019452 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1a2c0717b0 con 0x7f1a2c14e7b0 2023-11-20T07:00:57.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a28ff9640 1 -- 172.21.15.88:0/3480019452 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f1a200546d0 con 0x7f1a2c14e7b0 2023-11-20T07:00:57.294 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data_ec' created 2023-11-20T07:00:57.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a32846640 1 -- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1a180664d0 msgr2=0x7f1a18068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:57.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a32846640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1a180664d0 0x7f1a18068990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0ae000 tx=0x7f1a1c0b3040 comp rx=0 tx=0).stop 2023-11-20T07:00:57.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a32846640 1 -- 172.21.15.88:0/3480019452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a2c14e7b0 msgr2=0x7f1a2c0c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:57.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a32846640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a2c14e7b0 0x7f1a2c0c8570 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000e780 tx=0x7f1a2000ec40 comp rx=0 tx=0).stop 2023-11-20T07:00:57.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a32846640 1 -- 172.21.15.88:0/3480019452 shutdown_connections 2023-11-20T07:00:57.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a32846640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1a180664d0 0x7f1a18068990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:57.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a32846640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a2c0b3ba0 0x7f1a2c0b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:57.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a32846640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a2c14e7b0 0x7f1a2c0c8570 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:57.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a32846640 1 --2- 172.21.15.88:0/3480019452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a14003980 0x7f1a2c0c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:57.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a32846640 1 -- 172.21.15.88:0/3480019452 >> 172.21.15.88:0/3480019452 conn(0x7f1a2c0cef10 msgr2=0x7f1a2c0cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:57.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a32846640 1 -- 172.21.15.88:0/3480019452 shutdown_connections 2023-11-20T07:00:57.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.294+0000 7f1a32846640 1 -- 172.21.15.88:0/3480019452 wait complete. 2023-11-20T07:00:57.329 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-11-20T07:00:57.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb14b72640 1 Processor -- start 2023-11-20T07:00:57.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb14b72640 1 -- start start 2023-11-20T07:00:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb14b72640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb101441a0 0x7fdb100b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb14b72640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb100cb530 0x7fdb100c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb14b72640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1015e5f0 con 0x7fdb100b1a90 2023-11-20T07:00:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb14b72640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb100b1f20 con 0x7fdb101441a0 2023-11-20T07:00:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb14b72640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1015e8d0 con 0x7fdb100cb530 2023-11-20T07:00:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb0e59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb101441a0 0x7fdb100b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb0dd9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdb100b1a90 0x7fdb100cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40830/0 (socket says 172.21.15.88:40830) 2023-11-20T07:00:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb0dd9b640 1 -- 172.21.15.88:0/3069783998 learned_addr learned my addr 172.21.15.88:0/3069783998 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:00:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb0ed9d640 1 --2- 172.21.15.88:0/3069783998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb100cb530 0x7fdb100c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb0e59c640 1 -- 172.21.15.88:0/3069783998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb100cb530 msgr2=0x7fdb100c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:57.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb0e59c640 1 --2- 172.21.15.88:0/3069783998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb100cb530 0x7fdb100c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:57.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb0e59c640 1 -- 172.21.15.88:0/3069783998 >> v1:172.21.15.88:6789/0 conn(0x7fdb100b1a90 legacy=0x7fdb100cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:57.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb0d59a640 1 -- 172.21.15.88:0/3069783998 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749697480 0 0) 0x7fdb1015e5f0 con 0x7fdb100b1a90 2023-11-20T07:00:57.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.474+0000 7fdb0e59c640 1 -- 172.21.15.88:0/3069783998 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1015ebb0 con 0x7fdb101441a0 2023-11-20T07:00:57.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.478+0000 7fdb0e59c640 1 --2- 172.21.15.88:0/3069783998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb101441a0 0x7fdb100b1550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdb000097c0 tx=0x7fdb0001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d3033931a619bc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:57.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.478+0000 7fdb0d59a640 1 -- 172.21.15.88:0/3069783998 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb000ab600 con 0x7fdb101441a0 2023-11-20T07:00:57.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.478+0000 7fdb0d59a640 1 -- 172.21.15.88:0/3069783998 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb000a7050 con 0x7fdb101441a0 2023-11-20T07:00:57.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.478+0000 7fdb0d59a640 1 -- 172.21.15.88:0/3069783998 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb000ab980 con 0x7fdb101441a0 2023-11-20T07:00:57.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.478+0000 7fdb14b72640 1 -- 172.21.15.88:0/3069783998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb101441a0 msgr2=0x7fdb100b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:57.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.478+0000 7fdb14b72640 1 --2- 172.21.15.88:0/3069783998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb101441a0 0x7fdb100b1550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdb000097c0 tx=0x7fdb0001c480 comp rx=0 tx=0).stop 2023-11-20T07:00:57.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.478+0000 7fdb14b72640 1 -- 172.21.15.88:0/3069783998 shutdown_connections 2023-11-20T07:00:57.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.478+0000 7fdb14b72640 1 --2- 172.21.15.88:0/3069783998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb100cb530 0x7fdb100c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:57.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.478+0000 7fdb14b72640 1 --2- 172.21.15.88:0/3069783998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb101441a0 0x7fdb100b1550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:57.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.478+0000 7fdb14b72640 1 -- 172.21.15.88:0/3069783998 >> 172.21.15.88:0/3069783998 conn(0x7fdb1006a820 msgr2=0x7fdb100b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:57.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.478+0000 7fdb14b72640 1 -- 172.21.15.88:0/3069783998 shutdown_connections 2023-11-20T07:00:57.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.478+0000 7fdb14b72640 1 -- 172.21.15.88:0/3069783998 wait complete. 2023-11-20T07:00:57.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb14b72640 1 Processor -- start 2023-11-20T07:00:57.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb14b72640 1 -- start start 2023-11-20T07:00:57.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb14b72640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb100b1a90 0x7fdb1012a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:57.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb14b72640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb100cb530 0x7fdb1013aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:57.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb14b72640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb101441a0 0x7fdb1015c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:57.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb14b72640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1012a6e0 con 0x7fdb100cb530 2023-11-20T07:00:57.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb14b72640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1015d400 con 0x7fdb101441a0 2023-11-20T07:00:57.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb14b72640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb101f46f0 con 0x7fdb100b1a90 2023-11-20T07:00:57.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb0dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb100cb530 0x7fdb1013aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb0dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb100cb530 0x7fdb1013aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56866/0 (socket says 172.21.15.88:56866) 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb0dd9b640 1 -- 172.21.15.88:0/1312394413 learned_addr learned my addr 172.21.15.88:0/1312394413 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb0e59c640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb100b1a90 0x7fdb1012a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb0ed9d640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb101441a0 0x7fdb1015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb0dd9b640 1 -- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb100b1a90 msgr2=0x7fdb1012a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb0dd9b640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb100b1a90 0x7fdb1012a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb0dd9b640 1 -- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb101441a0 msgr2=0x7fdb1015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb0dd9b640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb101441a0 0x7fdb1015c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb0dd9b640 1 -- 172.21.15.88:0/1312394413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00009420 con 0x7fdb100cb530 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb0ed9d640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb101441a0 0x7fdb1015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb0dd9b640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb100cb530 0x7fdb1013aca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdb040011f0 tx=0x7fdb0400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdafeffd640 1 -- 172.21.15.88:0/1312394413 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb040074e0 con 0x7fdb100cb530 2023-11-20T07:00:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdafeffd640 1 -- 172.21.15.88:0/1312394413 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb04007640 con 0x7fdb100cb530 2023-11-20T07:00:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb14b72640 1 -- 172.21.15.88:0/1312394413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb101f49d0 con 0x7fdb100cb530 2023-11-20T07:00:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdafeffd640 1 -- 172.21.15.88:0/1312394413 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04004a10 con 0x7fdb100cb530 2023-11-20T07:00:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb14b72640 1 -- 172.21.15.88:0/1312394413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb101f4f90 con 0x7fdb100cb530 2023-11-20T07:00:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.482+0000 7fdb14b72640 1 -- 172.21.15.88:0/1312394413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1004e170 con 0x7fdb100cb530 2023-11-20T07:00:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.486+0000 7fdafeffd640 1 -- 172.21.15.88:0/1312394413 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdb04004b70 con 0x7fdb100cb530 2023-11-20T07:00:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.486+0000 7fdafeffd640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdaf00664a0 0x7fdaf0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.486+0000 7fdafeffd640 1 -- 172.21.15.88:0/1312394413 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fdb04083730 con 0x7fdb100cb530 2023-11-20T07:00:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.486+0000 7fdb0e59c640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdaf00664a0 0x7fdaf0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:57.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.486+0000 7fdb0e59c640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdaf00664a0 0x7fdaf0068960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdb000ad000 tx=0x7fdb000a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.490+0000 7fdafeffd640 1 -- 172.21.15.88:0/1312394413 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdb040508e0 con 0x7fdb100cb530 2023-11-20T07:00:57.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:57.642+0000 7fdb14b72640 1 -- 172.21.15.88:0/1312394413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fdb100af770 con 0x7fdb100cb530 2023-11-20T07:00:58.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.298+0000 7fdafeffd640 1 -- 172.21.15.88:0/1312394413 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdb04053f00 con 0x7fdb100cb530 2023-11-20T07:00:58.299 INFO:teuthology.orchestra.run.smithi088.stderr:set pool 4 allow_ec_overwrites to true 2023-11-20T07:00:58.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.302+0000 7fdb14b72640 1 -- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdaf00664a0 msgr2=0x7fdaf0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:58.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.302+0000 7fdb14b72640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdaf00664a0 0x7fdaf0068960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdb000ad000 tx=0x7fdb000a6000 comp rx=0 tx=0).stop 2023-11-20T07:00:58.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.302+0000 7fdb14b72640 1 -- 172.21.15.88:0/1312394413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb100cb530 msgr2=0x7fdb1013aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:58.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.302+0000 7fdb14b72640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb100cb530 0x7fdb1013aca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdb040011f0 tx=0x7fdb0400c9b0 comp rx=0 tx=0).stop 2023-11-20T07:00:58.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.302+0000 7fdb14b72640 1 -- 172.21.15.88:0/1312394413 shutdown_connections 2023-11-20T07:00:58.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.302+0000 7fdb14b72640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdaf00664a0 0x7fdaf0068960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:58.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.302+0000 7fdb14b72640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb101441a0 0x7fdb1015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:58.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.302+0000 7fdb14b72640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb100cb530 0x7fdb1013aca0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:58.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.302+0000 7fdb14b72640 1 --2- 172.21.15.88:0/1312394413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb100b1a90 0x7fdb1012a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.302+0000 7fdb14b72640 1 -- 172.21.15.88:0/1312394413 >> 172.21.15.88:0/1312394413 conn(0x7fdb1006a820 msgr2=0x7fdb10156b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.302+0000 7fdb14b72640 1 -- 172.21.15.88:0/1312394413 shutdown_connections 2023-11-20T07:00:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.302+0000 7fdb14b72640 1 -- 172.21.15.88:0/1312394413 wait complete. 2023-11-20T07:00:58.338 INFO:tasks.ceph.mds.d.smithi175.stderr:2023-11-20T07:00:58.333+0000 7fc53f0a1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-20T07:00:58.344 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-11-20T07:00:58.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f056a3c5640 1 Processor -- start 2023-11-20T07:00:58.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f056a3c5640 1 -- start start 2023-11-20T07:00:58.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f056a3c5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05640d0210 0x7f05640d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:58.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f056a3c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05640b84e0 0x7f05640b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:58.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f056a3c5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05640d1670 con 0x7f056415cba0 2023-11-20T07:00:58.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f056a3c5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05640d1460 con 0x7f05640d0210 2023-11-20T07:00:58.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f056a3c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05640d1950 con 0x7f05640b84e0 2023-11-20T07:00:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f05637fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05640d0210 0x7f05640d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f05637fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05640d0210 0x7f05640d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:44192/0 (socket says 172.21.15.88:44192) 2023-11-20T07:00:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f0568962640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05640b84e0 0x7f05640b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f05637fe640 1 -- 172.21.15.88:0/2730787981 learned_addr learned my addr 172.21.15.88:0/2730787981 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f0563fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f056415cba0 0x7f05640cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:59632/0 (socket says 172.21.15.88:59632) 2023-11-20T07:00:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f0568962640 1 -- 172.21.15.88:0/2730787981 >> v2:172.21.15.175:3300/0 conn(0x7f05640d0210 msgr2=0x7f05640d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f0568962640 1 --2- 172.21.15.88:0/2730787981 >> v2:172.21.15.175:3300/0 conn(0x7f05640d0210 0x7f05640d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f0568962640 1 -- 172.21.15.88:0/2730787981 >> v1:172.21.15.175:6789/0 conn(0x7f056415cba0 legacy=0x7f05640cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f0568962640 1 -- 172.21.15.88:0/2730787981 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640d1c30 con 0x7f05640b84e0 2023-11-20T07:00:58.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f0562ffd640 1 -- 172.21.15.88:0/2730787981 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994584997 0 0) 0x7f05640d1670 con 0x7f056415cba0 2023-11-20T07:00:58.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.482+0000 7f05637fe640 1 --2- 172.21.15.88:0/2730787981 >> v2:172.21.15.175:3300/0 conn(0x7f05640d0210 0x7f05640d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:00:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.486+0000 7f0568962640 1 --2- 172.21.15.88:0/2730787981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05640b84e0 0x7f05640b5cf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f055c009d90 tx=0x7f055c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ec0a5da1891c2d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.486+0000 7f0562ffd640 1 -- 172.21.15.88:0/2730787981 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0a5a10 con 0x7f05640b84e0 2023-11-20T07:00:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.486+0000 7f0562ffd640 1 -- 172.21.15.88:0/2730787981 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c0a5b70 con 0x7f05640b84e0 2023-11-20T07:00:58.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.486+0000 7f0562ffd640 1 -- 172.21.15.88:0/2730787981 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0ad440 con 0x7f05640b84e0 2023-11-20T07:00:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.486+0000 7f056a3c5640 1 -- 172.21.15.88:0/2730787981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05640b84e0 msgr2=0x7f05640b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.486+0000 7f056a3c5640 1 --2- 172.21.15.88:0/2730787981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05640b84e0 0x7f05640b5cf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f055c009d90 tx=0x7f055c01c950 comp rx=0 tx=0).stop 2023-11-20T07:00:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.486+0000 7f056a3c5640 1 -- 172.21.15.88:0/2730787981 shutdown_connections 2023-11-20T07:00:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.486+0000 7f056a3c5640 1 --2- 172.21.15.88:0/2730787981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05640b84e0 0x7f05640b5cf0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.486+0000 7f056a3c5640 1 --2- 172.21.15.88:0/2730787981 >> v2:172.21.15.175:3300/0 conn(0x7f05640d0210 0x7f05640d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.486+0000 7f056a3c5640 1 -- 172.21.15.88:0/2730787981 >> 172.21.15.88:0/2730787981 conn(0x7f05640719c0 msgr2=0x7f0564071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.486+0000 7f056a3c5640 1 -- 172.21.15.88:0/2730787981 shutdown_connections 2023-11-20T07:00:58.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.486+0000 7f056a3c5640 1 -- 172.21.15.88:0/2730787981 wait complete. 2023-11-20T07:00:58.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.490+0000 7f056a3c5640 1 Processor -- start 2023-11-20T07:00:58.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.490+0000 7f056a3c5640 1 -- start start 2023-11-20T07:00:58.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.490+0000 7f056a3c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05640b84e0 0x7f05640c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:58.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.490+0000 7f056a3c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05640d0210 0x7f05640c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:58.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.490+0000 7f056a3c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f056415cba0 0x7f0564140a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:58.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.490+0000 7f056a3c5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056414ffe0 con 0x7f05640d0210 2023-11-20T07:00:58.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.490+0000 7f056a3c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05640c7b80 con 0x7f056415cba0 2023-11-20T07:00:58.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.490+0000 7f056a3c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05640c7e60 con 0x7f05640b84e0 2023-11-20T07:00:58.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.490+0000 7f05637fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05640d0210 0x7f05640c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:58.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.490+0000 7f05637fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05640d0210 0x7f05640c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56874/0 (socket says 172.21.15.88:56874) 2023-11-20T07:00:58.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.490+0000 7f05637fe640 1 -- 172.21.15.88:0/2496590218 learned_addr learned my addr 172.21.15.88:0/2496590218 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:58.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.490+0000 7f0563fff640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05640b84e0 0x7f05640c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:58.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.494+0000 7f05637fe640 1 -- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05640b84e0 msgr2=0x7f05640c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:58.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.494+0000 7f05637fe640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05640b84e0 0x7f05640c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:58.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.494+0000 7f05637fe640 1 -- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f056415cba0 msgr2=0x7f0564140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:58.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.494+0000 7f05637fe640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f056415cba0 0x7f0564140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:58.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.494+0000 7f05637fe640 1 -- 172.21.15.88:0/2496590218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05580094d0 con 0x7f05640d0210 2023-11-20T07:00:58.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.494+0000 7f05637fe640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05640d0210 0x7f05640c8c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f055800e9b0 tx=0x7f055800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:58.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.494+0000 7f0560ff9640 1 -- 172.21.15.88:0/2496590218 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800ca00 con 0x7f05640d0210 2023-11-20T07:00:58.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.494+0000 7f0560ff9640 1 -- 172.21.15.88:0/2496590218 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055800cb60 con 0x7f05640d0210 2023-11-20T07:00:58.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.494+0000 7f0560ff9640 1 -- 172.21.15.88:0/2496590218 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558013470 con 0x7f05640d0210 2023-11-20T07:00:58.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.494+0000 7f056a3c5640 1 -- 172.21.15.88:0/2496590218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c009a70 con 0x7f05640d0210 2023-11-20T07:00:58.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.494+0000 7f056a3c5640 1 -- 172.21.15.88:0/2496590218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05640c8420 con 0x7f05640d0210 2023-11-20T07:00:58.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.494+0000 7f056a3c5640 1 -- 172.21.15.88:0/2496590218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056404e170 con 0x7f05640d0210 2023-11-20T07:00:58.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.498+0000 7f0560ff9640 1 -- 172.21.15.88:0/2496590218 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f05580135d0 con 0x7f05640d0210 2023-11-20T07:00:58.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.498+0000 7f0560ff9640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f05500664a0 0x7f0550068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:58.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.498+0000 7f0560ff9640 1 -- 172.21.15.88:0/2496590218 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f0558084450 con 0x7f05640d0210 2023-11-20T07:00:58.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.498+0000 7f0563fff640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f05500664a0 0x7f0550068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:58.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.502+0000 7f0563fff640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f05500664a0 0x7f0550068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0554000f70 tx=0x7f0554007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:58.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.506+0000 7f0560ff9640 1 -- 172.21.15.88:0/2496590218 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0558051560 con 0x7f05640d0210 2023-11-20T07:00:58.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:58.686+0000 7f056a3c5640 1 -- 172.21.15.88:0/2496590218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f05640ce830 con 0x7f05640d0210 2023-11-20T07:00:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.306+0000 7f0560ff9640 1 -- 172.21.15.88:0/2496590218 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f0558054b80 con 0x7f05640d0210 2023-11-20T07:00:59.309 INFO:teuthology.orchestra.run.smithi088.stderr:added data pool 4 to fsmap 2023-11-20T07:00:59.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.310+0000 7f056a3c5640 1 -- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f05500664a0 msgr2=0x7f0550068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:59.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.310+0000 7f056a3c5640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f05500664a0 0x7f0550068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0554000f70 tx=0x7f0554007c10 comp rx=0 tx=0).stop 2023-11-20T07:00:59.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.310+0000 7f056a3c5640 1 -- 172.21.15.88:0/2496590218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05640d0210 msgr2=0x7f05640c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:59.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.310+0000 7f056a3c5640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05640d0210 0x7f05640c8c20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f055800e9b0 tx=0x7f055800ee70 comp rx=0 tx=0).stop 2023-11-20T07:00:59.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.310+0000 7f056a3c5640 1 -- 172.21.15.88:0/2496590218 shutdown_connections 2023-11-20T07:00:59.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.310+0000 7f056a3c5640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f05500664a0 0x7f0550068960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.310+0000 7f056a3c5640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f056415cba0 0x7f0564140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.310+0000 7f056a3c5640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05640d0210 0x7f05640c8c20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.310+0000 7f056a3c5640 1 --2- 172.21.15.88:0/2496590218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05640b84e0 0x7f05640c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.310+0000 7f056a3c5640 1 -- 172.21.15.88:0/2496590218 >> 172.21.15.88:0/2496590218 conn(0x7f05640719c0 msgr2=0x7f0564071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:59.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.310+0000 7f056a3c5640 1 -- 172.21.15.88:0/2496590218 shutdown_connections 2023-11-20T07:00:59.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.310+0000 7f056a3c5640 1 -- 172.21.15.88:0/2496590218 wait complete. 2023-11-20T07:00:59.333 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:00:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.470+0000 7f7adaa46640 1 Processor -- start 2023-11-20T07:00:59.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.470+0000 7f7adaa46640 1 -- start start 2023-11-20T07:00:59.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.470+0000 7f7adaa46640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ad415cf90 0x7f7ad406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.470+0000 7f7adaa46640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ad40ce310 0x7f7ad40ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.470+0000 7f7adaa46640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad415d4e0 con 0x7f7ad40b2ad0 2023-11-20T07:00:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.470+0000 7f7adaa46640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad40cece0 con 0x7f7ad40ce310 2023-11-20T07:00:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.470+0000 7f7adaa46640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad4160580 con 0x7f7ad415cf90 2023-11-20T07:00:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.470+0000 7f7ad8fe3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ad40ce310 0x7f7ad40ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.470+0000 7f7ad8fe3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ad40ce310 0x7f7ad40ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56888/0 (socket says 172.21.15.88:56888) 2023-11-20T07:00:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.474+0000 7f7ad8fe3640 1 -- 172.21.15.88:0/531696364 learned_addr learned my addr 172.21.15.88:0/531696364 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.474+0000 7f7ad37fe640 1 --2- 172.21.15.88:0/531696364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ad415cf90 0x7f7ad406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.474+0000 7f7ad8fe3640 1 -- 172.21.15.88:0/531696364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ad415cf90 msgr2=0x7f7ad406c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:59.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.474+0000 7f7ad8fe3640 1 --2- 172.21.15.88:0/531696364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ad415cf90 0x7f7ad406c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.474+0000 7f7ad8fe3640 1 -- 172.21.15.88:0/531696364 >> v1:172.21.15.175:6789/0 conn(0x7f7ad40b2ad0 legacy=0x7f7ad406b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:59.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.474+0000 7f7ad8fe3640 1 -- 172.21.15.88:0/531696364 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad415d7c0 con 0x7f7ad40ce310 2023-11-20T07:00:59.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.474+0000 7f7ad2ffd640 1 -- 172.21.15.88:0/531696364 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781708942 0 0) 0x7f7ad415d4e0 con 0x7f7ad40b2ad0 2023-11-20T07:00:59.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.474+0000 7f7ad8fe3640 1 --2- 172.21.15.88:0/531696364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ad40ce310 0x7f7ad40ce7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009e50 tx=0x7f7acc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7461440d6a1e6f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:59.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.474+0000 7f7ad2ffd640 1 -- 172.21.15.88:0/531696364 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0a58a0 con 0x7f7ad40ce310 2023-11-20T07:00:59.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.474+0000 7f7ad2ffd640 1 -- 172.21.15.88:0/531696364 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc0a5a00 con 0x7f7ad40ce310 2023-11-20T07:00:59.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.474+0000 7f7ad2ffd640 1 -- 172.21.15.88:0/531696364 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0a5d90 con 0x7f7ad40ce310 2023-11-20T07:00:59.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 -- 172.21.15.88:0/531696364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ad40ce310 msgr2=0x7f7ad40ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:59.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 --2- 172.21.15.88:0/531696364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ad40ce310 0x7f7ad40ce7a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009e50 tx=0x7f7acc01c9e0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 -- 172.21.15.88:0/531696364 shutdown_connections 2023-11-20T07:00:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 --2- 172.21.15.88:0/531696364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ad40ce310 0x7f7ad40ce7a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 --2- 172.21.15.88:0/531696364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ad415cf90 0x7f7ad406c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 -- 172.21.15.88:0/531696364 >> 172.21.15.88:0/531696364 conn(0x7f7ad40cd1c0 msgr2=0x7f7ad40cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 -- 172.21.15.88:0/531696364 shutdown_connections 2023-11-20T07:00:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 -- 172.21.15.88:0/531696364 wait complete. 2023-11-20T07:00:59.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 Processor -- start 2023-11-20T07:00:59.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 -- start start 2023-11-20T07:00:59.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ad40b2ad0 0x7f7ad4158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:59.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ad40ce310 0x7f7ad414ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:59.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ad415cf90 0x7f7ad40c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:59.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad414d370 con 0x7f7ad40ce310 2023-11-20T07:00:59.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40c5b60 con 0x7f7ad415cf90 2023-11-20T07:00:59.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7adaa46640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad4159100 con 0x7f7ad40b2ad0 2023-11-20T07:00:59.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ad40ce310 0x7f7ad414ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:59.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ad40ce310 0x7f7ad414ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56898/0 (socket says 172.21.15.88:56898) 2023-11-20T07:00:59.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7ad37fe640 1 -- 172.21.15.88:0/1828954179 learned_addr learned my addr 172.21.15.88:0/1828954179 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:59.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7ad8fe3640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ad415cf90 0x7f7ad40c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:59.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7ad37fe640 1 -- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ad40b2ad0 msgr2=0x7f7ad4158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:59.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7ad37fe640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ad40b2ad0 0x7f7ad4158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7ad37fe640 1 -- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ad415cf90 msgr2=0x7f7ad40c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:59.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7ad37fe640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ad415cf90 0x7f7ad40c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7ad37fe640 1 -- 172.21.15.88:0/1828954179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc009b30 con 0x7f7ad40ce310 2023-11-20T07:00:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7ad8fe3640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ad415cf90 0x7f7ad40c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:00:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.478+0000 7f7ad37fe640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ad40ce310 0x7f7ad414ce30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800e930 tx=0x7f7ac800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.482+0000 7f7ad0ff9640 1 -- 172.21.15.88:0/1828954179 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8009690 con 0x7f7ad40ce310 2023-11-20T07:00:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.482+0000 7f7ad0ff9640 1 -- 172.21.15.88:0/1828954179 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac800ca00 con 0x7f7ad40ce310 2023-11-20T07:00:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.482+0000 7f7adaa46640 1 -- 172.21.15.88:0/1828954179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad41593e0 con 0x7f7ad40ce310 2023-11-20T07:00:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.482+0000 7f7ad0ff9640 1 -- 172.21.15.88:0/1828954179 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac800cd70 con 0x7f7ad40ce310 2023-11-20T07:00:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.482+0000 7f7adaa46640 1 -- 172.21.15.88:0/1828954179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad41599a0 con 0x7f7ad40ce310 2023-11-20T07:00:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.482+0000 7f7adaa46640 1 -- 172.21.15.88:0/1828954179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad4074010 con 0x7f7ad40ce310 2023-11-20T07:00:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.482+0000 7f7ad0ff9640 1 -- 172.21.15.88:0/1828954179 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7ac8013470 con 0x7f7ad40ce310 2023-11-20T07:00:59.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.482+0000 7f7ad0ff9640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7ac00664a0 0x7f7ac0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:59.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.482+0000 7f7ad0ff9640 1 -- 172.21.15.88:0/1828954179 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ac80844c0 con 0x7f7ad40ce310 2023-11-20T07:00:59.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.482+0000 7f7ad3fff640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7ac00664a0 0x7f7ac0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:59.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.486+0000 7f7ad3fff640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7ac00664a0 0x7f7ac0068960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4007fd0 tx=0x7f7ac4007940 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:59.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.486+0000 7f7ad0ff9640 1 -- 172.21.15.88:0/1828954179 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ac8051670 con 0x7f7ad40ce310 2023-11-20T07:00:59.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 -- 172.21.15.88:0/1828954179 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ad406b970 con 0x7f7ad40ce310 2023-11-20T07:00:59.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7ad0ff9640 1 -- 172.21.15.88:0/1828954179 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f7ac8054c90 con 0x7f7ad40ce310 2023-11-20T07:00:59.667 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:00:59.667 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/1097293366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1097293366},{"type":"v1","addr":"172.21.15.175:6836","nonce":1097293366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/438678526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":438678526},{"type":"v1","addr":"172.21.15.88:6834","nonce":438678526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1083863684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":1083863684},{"type":"v1","addr":"172.21.15.88:6835","nonce":1083863684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:00:54.012155+0000","modified":"2023-11-20T07:00:58.690662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3413113678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3413113678},{"type":"v1","addr":"172.21.15.175:6837","nonce":3413113678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-20T07:00:59.667 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 7 2023-11-20T07:00:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 -- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7ac00664a0 msgr2=0x7f7ac0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7ac00664a0 0x7f7ac0068960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4007fd0 tx=0x7f7ac4007940 comp rx=0 tx=0).stop 2023-11-20T07:00:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 -- 172.21.15.88:0/1828954179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ad40ce310 msgr2=0x7f7ad414ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ad40ce310 0x7f7ad414ce30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800e930 tx=0x7f7ac800edf0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 -- 172.21.15.88:0/1828954179 shutdown_connections 2023-11-20T07:00:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7ac00664a0 0x7f7ac0068960 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ad415cf90 0x7f7ad40c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ad40ce310 0x7f7ad414ce30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 --2- 172.21.15.88:0/1828954179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ad40b2ad0 0x7f7ad4158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 -- 172.21.15.88:0/1828954179 >> 172.21.15.88:0/1828954179 conn(0x7f7ad40cd1c0 msgr2=0x7f7ad4156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 -- 172.21.15.88:0/1828954179 shutdown_connections 2023-11-20T07:00:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.666+0000 7f7adaa46640 1 -- 172.21.15.88:0/1828954179 wait complete. 2023-11-20T07:00:59.687 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:00:59.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.826+0000 7fb58e832640 1 Processor -- start 2023-11-20T07:00:59.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.826+0000 7fb58e832640 1 -- start start 2023-11-20T07:00:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.826+0000 7fb58e832640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb58815ca70 0x7fb5880d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.826+0000 7fb58e832640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5880c65f0 con 0x7fb5880d3550 2023-11-20T07:00:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.826+0000 7fb58e832640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5880cdf80 con 0x7fb5880cf7a0 2023-11-20T07:00:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.826+0000 7fb58e832640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5880ce820 con 0x7fb58815ca70 2023-11-20T07:00:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.830+0000 7fb587fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb58815ca70 0x7fb5880d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.830+0000 7fb587fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb58815ca70 0x7fb5880d3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56906/0 (socket says 172.21.15.88:56906) 2023-11-20T07:00:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.830+0000 7fb587fff640 1 -- 172.21.15.88:0/2175565888 learned_addr learned my addr 172.21.15.88:0/2175565888 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.830+0000 7fb5877fe640 1 --1- 172.21.15.88:0/2175565888 >> v1:172.21.15.88:6789/0 conn(0x7fb5880d3550 0x7fb5880cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40844/0 (socket says 172.21.15.88:40844) 2023-11-20T07:00:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.830+0000 7fb587fff640 1 -- 172.21.15.88:0/2175565888 >> v1:172.21.15.175:6789/0 conn(0x7fb5880cf7a0 legacy=0x7fb5880c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:00:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.830+0000 7fb587fff640 1 -- 172.21.15.88:0/2175565888 >> v1:172.21.15.88:6789/0 conn(0x7fb5880d3550 legacy=0x7fb5880cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:59.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.830+0000 7fb587fff640 1 -- 172.21.15.88:0/2175565888 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5880ce260 con 0x7fb58815ca70 2023-11-20T07:00:59.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.830+0000 7fb587fff640 1 --2- 172.21.15.88:0/2175565888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb58815ca70 0x7fb5880d3010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb578006fd0 tx=0x7fb57801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f2c1b3314b40f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:59.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.830+0000 7fb586ffd640 1 -- 172.21.15.88:0/2175565888 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5780ab610 con 0x7fb58815ca70 2023-11-20T07:00:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.830+0000 7fb586ffd640 1 -- 172.21.15.88:0/2175565888 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5780ab770 con 0x7fb58815ca70 2023-11-20T07:00:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.830+0000 7fb586ffd640 1 -- 172.21.15.88:0/2175565888 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5780abb00 con 0x7fb58815ca70 2023-11-20T07:00:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 -- 172.21.15.88:0/2175565888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb58815ca70 msgr2=0x7fb5880d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 --2- 172.21.15.88:0/2175565888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb58815ca70 0x7fb5880d3010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb578006fd0 tx=0x7fb57801c4b0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 -- 172.21.15.88:0/2175565888 shutdown_connections 2023-11-20T07:00:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 --2- 172.21.15.88:0/2175565888 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb58815ca70 0x7fb5880d3010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 -- 172.21.15.88:0/2175565888 >> 172.21.15.88:0/2175565888 conn(0x7fb58809bc50 msgr2=0x7fb5880d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:00:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 -- 172.21.15.88:0/2175565888 shutdown_connections 2023-11-20T07:00:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 -- 172.21.15.88:0/2175565888 wait complete. 2023-11-20T07:00:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 Processor -- start 2023-11-20T07:00:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 -- start start 2023-11-20T07:00:59.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5880cf7a0 0x7fb58814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:59.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5880d3550 0x7fb5880b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:59.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb58815ca70 0x7fb588154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:59.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58814ff30 con 0x7fb58815ca70 2023-11-20T07:00:59.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5881501a0 con 0x7fb5880cf7a0 2023-11-20T07:00:59.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58e832640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb588156f80 con 0x7fb5880d3550 2023-11-20T07:00:59.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58cdcf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb58815ca70 0x7fb588154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:59.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58cdcf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb58815ca70 0x7fb588154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56908/0 (socket says 172.21.15.88:56908) 2023-11-20T07:00:59.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58cdcf640 1 -- 172.21.15.88:0/4222820848 learned_addr learned my addr 172.21.15.88:0/4222820848 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:00:59.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb5877fe640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5880d3550 0x7fb5880b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:59.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb587fff640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5880cf7a0 0x7fb58814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:59.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58cdcf640 1 -- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5880d3550 msgr2=0x7fb5880b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:59.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58cdcf640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5880d3550 0x7fb5880b78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58cdcf640 1 -- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5880cf7a0 msgr2=0x7fb58814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:00:59.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58cdcf640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5880cf7a0 0x7fb58814de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:00:59.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.834+0000 7fb58cdcf640 1 -- 172.21.15.88:0/4222820848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb578009480 con 0x7fb58815ca70 2023-11-20T07:00:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.838+0000 7fb58cdcf640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb58815ca70 0x7fb588154320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb58000c780 tx=0x7fb58000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.838+0000 7fb584ff9640 1 -- 172.21.15.88:0/4222820848 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58000a9f0 con 0x7fb58815ca70 2023-11-20T07:00:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.838+0000 7fb584ff9640 1 -- 172.21.15.88:0/4222820848 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58000ce90 con 0x7fb58815ca70 2023-11-20T07:00:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.838+0000 7fb58e832640 1 -- 172.21.15.88:0/4222820848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb588157260 con 0x7fb58815ca70 2023-11-20T07:00:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.838+0000 7fb584ff9640 1 -- 172.21.15.88:0/4222820848 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58000add0 con 0x7fb58815ca70 2023-11-20T07:00:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.838+0000 7fb58e832640 1 -- 172.21.15.88:0/4222820848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb588156c30 con 0x7fb58815ca70 2023-11-20T07:00:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.838+0000 7fb58e832640 1 -- 172.21.15.88:0/4222820848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb588150350 con 0x7fb58815ca70 2023-11-20T07:00:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.838+0000 7fb584ff9640 1 -- 172.21.15.88:0/4222820848 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb580012420 con 0x7fb58815ca70 2023-11-20T07:00:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.838+0000 7fb584ff9640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb5740664a0 0x7fb574068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:00:59.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.838+0000 7fb584ff9640 1 -- 172.21.15.88:0/4222820848 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb580084260 con 0x7fb58815ca70 2023-11-20T07:00:59.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.838+0000 7fb587fff640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb5740664a0 0x7fb574068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:00:59.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.842+0000 7fb587fff640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb5740664a0 0x7fb574068960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb5780af000 tx=0x7fb5780a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:00:59.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.842+0000 7fb584ff9640 1 -- 172.21.15.88:0/4222820848 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb588150350 con 0x7fb58815ca70 2023-11-20T07:00:59.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.994+0000 7fb58e832640 1 -- 172.21.15.88:0/4222820848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb588150310 con 0x7fb58815ca70 2023-11-20T07:00:59.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb584ff9640 1 -- 172.21.15.88:0/4222820848 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fb580051480 con 0x7fb58815ca70 2023-11-20T07:00:59.999 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:00:59.999 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:00.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb58e832640 1 -- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb5740664a0 msgr2=0x7fb574068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb58e832640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb5740664a0 0x7fb574068960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb5780af000 tx=0x7fb5780a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:00.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb58e832640 1 -- 172.21.15.88:0/4222820848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb58815ca70 msgr2=0x7fb588154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb58e832640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb58815ca70 0x7fb588154320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb58000c780 tx=0x7fb58000cc40 comp rx=0 tx=0).stop 2023-11-20T07:01:00.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb58e832640 1 -- 172.21.15.88:0/4222820848 shutdown_connections 2023-11-20T07:01:00.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb58e832640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb5740664a0 0x7fb574068960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb58e832640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5880d3550 0x7fb5880b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb58e832640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb58815ca70 0x7fb588154320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb58e832640 1 --2- 172.21.15.88:0/4222820848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5880cf7a0 0x7fb58814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb58e832640 1 -- 172.21.15.88:0/4222820848 >> 172.21.15.88:0/4222820848 conn(0x7fb58809bc50 msgr2=0x7fb58806c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:00.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb58e832640 1 -- 172.21.15.88:0/4222820848 shutdown_connections 2023-11-20T07:01:00.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:00:59.998+0000 7fb58e832640 1 -- 172.21.15.88:0/4222820848 wait complete. 2023-11-20T07:01:00.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:00.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.154+0000 7ff573c9e640 1 Processor -- start 2023-11-20T07:01:00.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.154+0000 7ff573c9e640 1 -- start start 2023-11-20T07:01:00.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff573c9e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff56c0b2ad0 0x7ff56c06b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff573c9e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff56c0ce310 0x7ff56c0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff573c9e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c06d000 con 0x7ff56c15cf90 2023-11-20T07:01:00.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff573c9e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0ced00 con 0x7ff56c0b2ad0 2023-11-20T07:01:00.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff573c9e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c160580 con 0x7ff56c0ce310 2023-11-20T07:01:00.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff571a3a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff56c0b2ad0 0x7ff56c06b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff571239640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff56c15cf90 0x7ff56c06c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40860/0 (socket says 172.21.15.88:40860) 2023-11-20T07:01:00.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff571239640 1 -- 172.21.15.88:0/3191029669 learned_addr learned my addr 172.21.15.88:0/3191029669 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:00.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff57223b640 1 --2- 172.21.15.88:0/3191029669 >> v2:172.21.15.175:3300/0 conn(0x7ff56c0ce310 0x7ff56c0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff570a38640 1 -- 172.21.15.88:0/3191029669 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016747814 0 0) 0x7ff56c06d000 con 0x7ff56c15cf90 2023-11-20T07:01:00.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff570a38640 1 -- 172.21.15.88:0/3191029669 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff558003530 con 0x7ff56c15cf90 2023-11-20T07:01:00.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff571a3a640 1 -- 172.21.15.88:0/3191029669 >> v2:172.21.15.175:3300/0 conn(0x7ff56c0ce310 msgr2=0x7ff56c0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:00.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff571a3a640 1 --2- 172.21.15.88:0/3191029669 >> v2:172.21.15.175:3300/0 conn(0x7ff56c0ce310 0x7ff56c0ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff571a3a640 1 -- 172.21.15.88:0/3191029669 >> v1:172.21.15.88:6789/0 conn(0x7ff56c15cf90 legacy=0x7ff56c06c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff571a3a640 1 -- 172.21.15.88:0/3191029669 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c15d4e0 con 0x7ff56c0b2ad0 2023-11-20T07:01:00.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.158+0000 7ff571a3a640 1 --2- 172.21.15.88:0/3191029669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff56c0b2ad0 0x7ff56c06b4b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff5680097c0 tx=0x7ff56801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce01eca108a82d57 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:00.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff570a38640 1 -- 172.21.15.88:0/3191029669 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5680ab610 con 0x7ff56c0b2ad0 2023-11-20T07:01:00.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff570a38640 1 -- 172.21.15.88:0/3191029669 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5680ab770 con 0x7ff56c0b2ad0 2023-11-20T07:01:00.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff570a38640 1 -- 172.21.15.88:0/3191029669 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5680abb00 con 0x7ff56c0b2ad0 2023-11-20T07:01:00.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 -- 172.21.15.88:0/3191029669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff56c0b2ad0 msgr2=0x7ff56c06b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 --2- 172.21.15.88:0/3191029669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff56c0b2ad0 0x7ff56c06b4b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff5680097c0 tx=0x7ff56801c410 comp rx=0 tx=0).stop 2023-11-20T07:01:00.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 -- 172.21.15.88:0/3191029669 shutdown_connections 2023-11-20T07:01:00.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 --2- 172.21.15.88:0/3191029669 >> v2:172.21.15.175:3300/0 conn(0x7ff56c0ce310 0x7ff56c0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 --2- 172.21.15.88:0/3191029669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff56c0b2ad0 0x7ff56c06b4b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 -- 172.21.15.88:0/3191029669 >> 172.21.15.88:0/3191029669 conn(0x7ff56c0cd1c0 msgr2=0x7ff56c0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:00.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 -- 172.21.15.88:0/3191029669 shutdown_connections 2023-11-20T07:01:00.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 -- 172.21.15.88:0/3191029669 wait complete. 2023-11-20T07:01:00.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 Processor -- start 2023-11-20T07:01:00.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 -- start start 2023-11-20T07:01:00.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff56c0b2ad0 0x7ff56c152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff56c0ce310 0x7ff56c0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c15cf90 0x7ff56c156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0b34b0 con 0x7ff56c0ce310 2023-11-20T07:01:00.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c153760 con 0x7ff56c15cf90 2023-11-20T07:01:00.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff573c9e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c153a40 con 0x7ff56c0b2ad0 2023-11-20T07:01:00.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff571239640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff56c0ce310 0x7ff56c0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff571239640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff56c0ce310 0x7ff56c0b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56922/0 (socket says 172.21.15.88:56922) 2023-11-20T07:01:00.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff571239640 1 -- 172.21.15.88:0/1385176998 learned_addr learned my addr 172.21.15.88:0/1385176998 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:00.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.162+0000 7ff571a3a640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff56c0b2ad0 0x7ff56c152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff57223b640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c15cf90 0x7ff56c156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff571239640 1 -- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff56c0b2ad0 msgr2=0x7ff56c152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff571239640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff56c0b2ad0 0x7ff56c152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff571239640 1 -- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c15cf90 msgr2=0x7ff56c156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff571239640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c15cf90 0x7ff56c156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff571239640 1 -- 172.21.15.88:0/1385176998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff568009420 con 0x7ff56c0ce310 2023-11-20T07:01:00.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff57223b640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c15cf90 0x7ff56c156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:00.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff571a3a640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff56c0b2ad0 0x7ff56c152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:00.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff571239640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff56c0ce310 0x7ff56c0b1670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00c420 tx=0x7ff55c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:00.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff5627fc640 1 -- 172.21.15.88:0/1385176998 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c005cf0 con 0x7ff56c0ce310 2023-11-20T07:01:00.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff5627fc640 1 -- 172.21.15.88:0/1385176998 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c005e50 con 0x7ff56c0ce310 2023-11-20T07:01:00.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff573c9e640 1 -- 172.21.15.88:0/1385176998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c153d20 con 0x7ff56c0ce310 2023-11-20T07:01:00.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff5627fc640 1 -- 172.21.15.88:0/1385176998 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0072d0 con 0x7ff56c0ce310 2023-11-20T07:01:00.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff573c9e640 1 -- 172.21.15.88:0/1385176998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c1542e0 con 0x7ff56c0ce310 2023-11-20T07:01:00.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff573c9e640 1 -- 172.21.15.88:0/1385176998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c074010 con 0x7ff56c0ce310 2023-11-20T07:01:00.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff5627fc640 1 -- 172.21.15.88:0/1385176998 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff55c007430 con 0x7ff56c0ce310 2023-11-20T07:01:00.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff5627fc640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff5500664a0 0x7ff550068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff5627fc640 1 -- 172.21.15.88:0/1385176998 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff55c083600 con 0x7ff56c0ce310 2023-11-20T07:01:00.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.166+0000 7ff571a3a640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff5500664a0 0x7ff550068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.170+0000 7ff571a3a640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff5500664a0 0x7ff550068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff5680af000 tx=0x7ff5680a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:00.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.170+0000 7ff5627fc640 1 -- 172.21.15.88:0/1385176998 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff55c050840 con 0x7ff56c0ce310 2023-11-20T07:01:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.322+0000 7ff573c9e640 1 -- 172.21.15.88:0/1385176998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff56c0d0870 con 0x7ff56c0ce310 2023-11-20T07:01:00.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.322+0000 7ff5627fc640 1 -- 172.21.15.88:0/1385176998 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7ff55c053e60 con 0x7ff56c0ce310 2023-11-20T07:01:00.324 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:00.324 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:00.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.326+0000 7ff573c9e640 1 -- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff5500664a0 msgr2=0x7ff550068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.326+0000 7ff573c9e640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff5500664a0 0x7ff550068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff5680af000 tx=0x7ff5680a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:00.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.326+0000 7ff573c9e640 1 -- 172.21.15.88:0/1385176998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff56c0ce310 msgr2=0x7ff56c0b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.326+0000 7ff573c9e640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff56c0ce310 0x7ff56c0b1670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00c420 tx=0x7ff55c00c8e0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.326+0000 7ff573c9e640 1 -- 172.21.15.88:0/1385176998 shutdown_connections 2023-11-20T07:01:00.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.326+0000 7ff573c9e640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff5500664a0 0x7ff550068960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.326+0000 7ff573c9e640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff56c15cf90 0x7ff56c156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.326+0000 7ff573c9e640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff56c0ce310 0x7ff56c0b1670 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.326+0000 7ff573c9e640 1 --2- 172.21.15.88:0/1385176998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff56c0b2ad0 0x7ff56c152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.326+0000 7ff573c9e640 1 -- 172.21.15.88:0/1385176998 >> 172.21.15.88:0/1385176998 conn(0x7ff56c0cd1c0 msgr2=0x7ff56c15f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:00.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.326+0000 7ff573c9e640 1 -- 172.21.15.88:0/1385176998 shutdown_connections 2023-11-20T07:01:00.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.326+0000 7ff573c9e640 1 -- 172.21.15.88:0/1385176998 wait complete. 2023-11-20T07:01:00.368 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:01:00.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc20011d640 1 Processor -- start 2023-11-20T07:01:00.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc20011d640 1 -- start start 2023-11-20T07:01:00.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc20011d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1f815cb90 0x7fc1f80cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc20011d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f80d15d0 0x7fc1f80c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc20011d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f80ce770 con 0x7fc1f80d3010 2023-11-20T07:01:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc20011d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f80d0600 con 0x7fc1f815cb90 2023-11-20T07:01:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc20011d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80c6450 con 0x7fc1f80d15d0 2023-11-20T07:01:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc1fdeb9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1f815cb90 0x7fc1f80cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc1fdeb9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1f815cb90 0x7fc1f80cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56934/0 (socket says 172.21.15.88:56934) 2023-11-20T07:01:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc1fdeb9640 1 -- 172.21.15.88:0/1963418194 learned_addr learned my addr 172.21.15.88:0/1963418194 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc1fd6b8640 1 --1- 172.21.15.88:0/1963418194 >> v1:172.21.15.88:6789/0 conn(0x7fc1f80d3010 0x7fc1f80d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40866/0 (socket says 172.21.15.88:40866) 2023-11-20T07:01:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc1fe6ba640 1 --2- 172.21.15.88:0/1963418194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f80d15d0 0x7fc1f80c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc1fdeb9640 1 -- 172.21.15.88:0/1963418194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f80d15d0 msgr2=0x7fc1f80c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc1fdeb9640 1 --2- 172.21.15.88:0/1963418194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f80d15d0 0x7fc1f80c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc1fdeb9640 1 -- 172.21.15.88:0/1963418194 >> v1:172.21.15.88:6789/0 conn(0x7fc1f80d3010 legacy=0x7fc1f80d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.506+0000 7fc1fdeb9640 1 -- 172.21.15.88:0/1963418194 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f80d08a0 con 0x7fc1f815cb90 2023-11-20T07:01:00.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc1fdeb9640 1 --2- 172.21.15.88:0/1963418194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f815cb90 0x7fc1f80cfb10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4006fd0 tx=0x7fc1f401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71dd3ccfa0137f85 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc1fceb7640 1 -- 172.21.15.88:0/1963418194 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f40ab660 con 0x7fc1f815cb90 2023-11-20T07:01:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc1fceb7640 1 -- 172.21.15.88:0/1963418194 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f40ab7c0 con 0x7fc1f815cb90 2023-11-20T07:01:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc1fceb7640 1 -- 172.21.15.88:0/1963418194 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f40abb50 con 0x7fc1f815cb90 2023-11-20T07:01:00.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc20011d640 1 -- 172.21.15.88:0/1963418194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f815cb90 msgr2=0x7fc1f80cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc20011d640 1 --2- 172.21.15.88:0/1963418194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f815cb90 0x7fc1f80cfb10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4006fd0 tx=0x7fc1f401c460 comp rx=0 tx=0).stop 2023-11-20T07:01:00.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc20011d640 1 -- 172.21.15.88:0/1963418194 shutdown_connections 2023-11-20T07:01:00.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc20011d640 1 --2- 172.21.15.88:0/1963418194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f80d15d0 0x7fc1f80c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc20011d640 1 --2- 172.21.15.88:0/1963418194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f815cb90 0x7fc1f80cfb10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc20011d640 1 -- 172.21.15.88:0/1963418194 >> 172.21.15.88:0/1963418194 conn(0x7fc1f809bc50 msgr2=0x7fc1f80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:00.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc20011d640 1 -- 172.21.15.88:0/1963418194 shutdown_connections 2023-11-20T07:01:00.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc20011d640 1 -- 172.21.15.88:0/1963418194 wait complete. 2023-11-20T07:01:00.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc20011d640 1 Processor -- start 2023-11-20T07:01:00.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.510+0000 7fc20011d640 1 -- start start 2023-11-20T07:01:00.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc20011d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f80d15d0 0x7fc1f8158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc20011d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f80d3010 0x7fc1f80af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc20011d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f815cb90 0x7fc1f80afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc20011d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f81585a0 con 0x7fc1f80d3010 2023-11-20T07:01:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc20011d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f815b620 con 0x7fc1f80d15d0 2023-11-20T07:01:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc20011d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f815b900 con 0x7fc1f815cb90 2023-11-20T07:01:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1fd6b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f80d3010 0x7fc1f80af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1fd6b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f80d3010 0x7fc1f80af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56936/0 (socket says 172.21.15.88:56936) 2023-11-20T07:01:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1fd6b8640 1 -- 172.21.15.88:0/1748361552 learned_addr learned my addr 172.21.15.88:0/1748361552 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1fe6ba640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f815cb90 0x7fc1f80afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1fdeb9640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f80d15d0 0x7fc1f8158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1fd6b8640 1 -- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f815cb90 msgr2=0x7fc1f80afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1fd6b8640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f815cb90 0x7fc1f80afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1fd6b8640 1 -- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f80d15d0 msgr2=0x7fc1f8158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1fd6b8640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f80d15d0 0x7fc1f8158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1fd6b8640 1 -- 172.21.15.88:0/1748361552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f4009480 con 0x7fc1f80d3010 2023-11-20T07:01:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1fd6b8640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f80d3010 0x7fc1f80af5b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800c460 tx=0x7fc1e800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1ee7fc640 1 -- 172.21.15.88:0/1748361552 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8007480 con 0x7fc1f80d3010 2023-11-20T07:01:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1ee7fc640 1 -- 172.21.15.88:0/1748361552 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e8007600 con 0x7fc1f80d3010 2023-11-20T07:01:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc20011d640 1 -- 172.21.15.88:0/1748361552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f815bbe0 con 0x7fc1f80d3010 2023-11-20T07:01:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc1ee7fc640 1 -- 172.21.15.88:0/1748361552 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8004a30 con 0x7fc1f80d3010 2023-11-20T07:01:00.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc20011d640 1 -- 172.21.15.88:0/1748361552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f815c1a0 con 0x7fc1f80d3010 2023-11-20T07:01:00.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.514+0000 7fc20011d640 1 -- 172.21.15.88:0/1748361552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f8074010 con 0x7fc1f80d3010 2023-11-20T07:01:00.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.518+0000 7fc1ee7fc640 1 -- 172.21.15.88:0/1748361552 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc1e8004b90 con 0x7fc1f80d3010 2023-11-20T07:01:00.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.518+0000 7fc1ee7fc640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc1dc0664a0 0x7fc1dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.518+0000 7fc1ee7fc640 1 -- 172.21.15.88:0/1748361552 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1e8083230 con 0x7fc1f80d3010 2023-11-20T07:01:00.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.518+0000 7fc1fdeb9640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc1dc0664a0 0x7fc1dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.518+0000 7fc1fdeb9640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc1dc0664a0 0x7fc1dc068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40af000 tx=0x7fc1f40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:00.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.522+0000 7fc1ee7fc640 1 -- 172.21.15.88:0/1748361552 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc1e8050470 con 0x7fc1f80d3010 2023-11-20T07:01:00.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.702+0000 7fc20011d640 1 -- 172.21.15.88:0/1748361552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1f80cdbc0 con 0x7fc1f80d3010 2023-11-20T07:01:00.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.702+0000 7fc1ee7fc640 1 -- 172.21.15.88:0/1748361552 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fc1e8053a90 con 0x7fc1f80d3010 2023-11-20T07:01:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:00.704 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/1097293366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1097293366},{"type":"v1","addr":"172.21.15.175:6836","nonce":1097293366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/438678526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":438678526},{"type":"v1","addr":"172.21.15.88:6834","nonce":438678526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1083863684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":1083863684},{"type":"v1","addr":"172.21.15.88:6835","nonce":1083863684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:00:54.012155+0000","modified":"2023-11-20T07:00:58.690662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3413113678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3413113678},{"type":"v1","addr":"172.21.15.175:6837","nonce":3413113678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-11-20T07:01:00.705 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 7 2023-11-20T07:01:00.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.702+0000 7fc20011d640 1 -- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc1dc0664a0 msgr2=0x7fc1dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.702+0000 7fc20011d640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc1dc0664a0 0x7fc1dc068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40af000 tx=0x7fc1f40a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:00.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.702+0000 7fc20011d640 1 -- 172.21.15.88:0/1748361552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f80d3010 msgr2=0x7fc1f80af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.702+0000 7fc20011d640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f80d3010 0x7fc1f80af5b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800c460 tx=0x7fc1e800c920 comp rx=0 tx=0).stop 2023-11-20T07:01:00.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.702+0000 7fc20011d640 1 -- 172.21.15.88:0/1748361552 shutdown_connections 2023-11-20T07:01:00.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.702+0000 7fc20011d640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc1dc0664a0 0x7fc1dc068960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.702+0000 7fc20011d640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1f815cb90 0x7fc1f80afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.702+0000 7fc20011d640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1f80d3010 0x7fc1f80af5b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.702+0000 7fc20011d640 1 --2- 172.21.15.88:0/1748361552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1f80d15d0 0x7fc1f8158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.702+0000 7fc20011d640 1 -- 172.21.15.88:0/1748361552 >> 172.21.15.88:0/1748361552 conn(0x7fc1f809bc50 msgr2=0x7fc1f80ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:00.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.706+0000 7fc20011d640 1 -- 172.21.15.88:0/1748361552 shutdown_connections 2023-11-20T07:01:00.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.706+0000 7fc20011d640 1 -- 172.21.15.88:0/1748361552 wait complete. 2023-11-20T07:01:00.724 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:00.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.858+0000 7fd7c8ba1640 1 Processor -- start 2023-11-20T07:01:00.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c8ba1640 1 -- start start 2023-11-20T07:01:00.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c8ba1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c4069e90 0x7fd7c406a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c8ba1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7c40ca5f0 0x7fd7c40caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c8ba1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c40ca150 con 0x7fd7c415cd10 2023-11-20T07:01:00.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c8ba1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c406a850 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c8ba1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4161990 con 0x7fd7c4069e90 2023-11-20T07:01:00.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c2d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7c40ca5f0 0x7fd7c40caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c2d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd7c40ca5f0 0x7fd7c40caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56942/0 (socket says 172.21.15.88:56942) 2023-11-20T07:01:00.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c2d9d640 1 -- 172.21.15.88:0/1119252058 learned_addr learned my addr 172.21.15.88:0/1119252058 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:00.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7bbfff640 1 --2- 172.21.15.88:0/1119252058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c4069e90 0x7fd7c406a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c2d9d640 1 -- 172.21.15.88:0/1119252058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c4069e90 msgr2=0x7fd7c406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:00.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c2d9d640 1 --2- 172.21.15.88:0/1119252058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c4069e90 0x7fd7c406a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c2d9d640 1 -- 172.21.15.88:0/1119252058 >> v1:172.21.15.175:6789/0 conn(0x7fd7c415cd10 legacy=0x7fd7c415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:00.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7c2d9d640 1 -- 172.21.15.88:0/1119252058 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c4160e10 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.862+0000 7fd7bbfff640 1 --2- 172.21.15.88:0/1119252058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c4069e90 0x7fd7c406a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:00.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c2d9d640 1 --2- 172.21.15.88:0/1119252058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c40ca5f0 0x7fd7c40caa60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009e50 tx=0x7fd7bc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2371daaa01cedacc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:00.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c1d9b640 1 -- 172.21.15.88:0/1119252058 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0a5820 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c1d9b640 1 -- 172.21.15.88:0/1119252058 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc0a5980 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c1d9b640 1 -- 172.21.15.88:0/1119252058 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0a5d10 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/1119252058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c40ca5f0 msgr2=0x7fd7c40caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c8ba1640 1 --2- 172.21.15.88:0/1119252058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c40ca5f0 0x7fd7c40caa60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009e50 tx=0x7fd7bc01c9a0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/1119252058 shutdown_connections 2023-11-20T07:01:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c8ba1640 1 --2- 172.21.15.88:0/1119252058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c40ca5f0 0x7fd7c40caa60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c8ba1640 1 --2- 172.21.15.88:0/1119252058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c4069e90 0x7fd7c406a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/1119252058 >> 172.21.15.88:0/1119252058 conn(0x7fd7c406d310 msgr2=0x7fd7c406d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/1119252058 shutdown_connections 2023-11-20T07:01:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/1119252058 wait complete. 2023-11-20T07:01:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c8ba1640 1 Processor -- start 2023-11-20T07:01:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.866+0000 7fd7c8ba1640 1 -- start start 2023-11-20T07:01:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7c8ba1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c4069e90 0x7fd7c40c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7c8ba1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c40ca5f0 0x7fd7c4152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7c8ba1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7c415cd10 0x7fd7c41545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7c8ba1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4155480 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7c8ba1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c41571c0 con 0x7fd7c415cd10 2023-11-20T07:01:00.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7c8ba1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c40c5ae0 con 0x7fd7c4069e90 2023-11-20T07:01:00.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7bbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c40ca5f0 0x7fd7c4152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7bbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c40ca5f0 0x7fd7c4152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56952/0 (socket says 172.21.15.88:56952) 2023-11-20T07:01:00.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7bbfff640 1 -- 172.21.15.88:0/2366733391 learned_addr learned my addr 172.21.15.88:0/2366733391 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:00.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7c259c640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c4069e90 0x7fd7c40c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7c2d9d640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7c415cd10 0x7fd7c41545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7bbfff640 1 -- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c4069e90 msgr2=0x7fd7c40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7bbfff640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c4069e90 0x7fd7c40c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7bbfff640 1 -- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7c415cd10 msgr2=0x7fd7c41545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:00.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7bbfff640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7c415cd10 0x7fd7c41545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:00.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7bbfff640 1 -- 172.21.15.88:0/2366733391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc009b30 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7bbfff640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c40ca5f0 0x7fd7c4152c30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c7c0 tx=0x7fd7ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:00.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7baffd640 1 -- 172.21.15.88:0/2366733391 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac007a30 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7baffd640 1 -- 172.21.15.88:0/2366733391 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac007b90 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7baffd640 1 -- 172.21.15.88:0/2366733391 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac00ce70 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/2366733391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c40c8530 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/2366733391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c40c8af0 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.870+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/2366733391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c4157350 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.874+0000 7fd7baffd640 1 -- 172.21.15.88:0/2366733391 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd7ac0113f0 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.874+0000 7fd7baffd640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd7a40664d0 0x7fd7a4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:00.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.874+0000 7fd7baffd640 1 -- 172.21.15.88:0/2366733391 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7ac0845a0 con 0x7fd7c40ca5f0 2023-11-20T07:01:00.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.874+0000 7fd7c259c640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd7a40664d0 0x7fd7a4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:00.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.874+0000 7fd7c259c640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd7a40664d0 0x7fd7a4068990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40098e0 tx=0x7fd7b4009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:00.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:00.878+0000 7fd7baffd640 1 -- 172.21.15.88:0/2366733391 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd7ac051750 con 0x7fd7c40ca5f0 2023-11-20T07:01:01.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.026+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/2366733391 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7c4074010 con 0x7fd7c40ca5f0 2023-11-20T07:01:01.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7baffd640 1 -- 172.21.15.88:0/2366733391 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fd7ac054d70 con 0x7fd7c40ca5f0 2023-11-20T07:01:01.029 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:01.029 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:01.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd7a40664d0 msgr2=0x7fd7a4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7c8ba1640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd7a40664d0 0x7fd7a4068990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40098e0 tx=0x7fd7b4009060 comp rx=0 tx=0).stop 2023-11-20T07:01:01.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/2366733391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c40ca5f0 msgr2=0x7fd7c4152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7c8ba1640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c40ca5f0 0x7fd7c4152c30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c7c0 tx=0x7fd7ac00cc80 comp rx=0 tx=0).stop 2023-11-20T07:01:01.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/2366733391 shutdown_connections 2023-11-20T07:01:01.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7c8ba1640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd7a40664d0 0x7fd7a4068990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7c8ba1640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7c415cd10 0x7fd7c41545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7c8ba1640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7c40ca5f0 0x7fd7c4152c30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7c8ba1640 1 --2- 172.21.15.88:0/2366733391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c4069e90 0x7fd7c40c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/2366733391 >> 172.21.15.88:0/2366733391 conn(0x7fd7c406d310 msgr2=0x7fd7c40b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:01.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/2366733391 shutdown_connections 2023-11-20T07:01:01.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.030+0000 7fd7c8ba1640 1 -- 172.21.15.88:0/2366733391 wait complete. 2023-11-20T07:01:01.453 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-20T07:00:54.012155+0000', 'modified': '2023-11-20T07:00:58.690662+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6837/3413113678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 3413113678}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 3413113678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-11-20T07:01:01.453 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-20T07:01:01.453 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-20T07:01:01.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.590+0000 7f1ed771d640 1 Processor -- start 2023-11-20T07:01:01.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed771d640 1 -- start start 2023-11-20T07:01:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed771d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ed015ca70 0x7f1ed00d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed771d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ed00d3550 0x7f1ed00cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed771d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed00c65f0 con 0x7f1ed00cf5d0 2023-11-20T07:01:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed771d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed00ce820 con 0x7f1ed00d3550 2023-11-20T07:01:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed771d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00cfa40 con 0x7f1ed015ca70 2023-11-20T07:01:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed4cb8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ed00d3550 0x7f1ed00cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed5cba640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1ed00cf5d0 0x7f1ed00d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40878/0 (socket says 172.21.15.88:40878) 2023-11-20T07:01:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed4cb8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ed00d3550 0x7f1ed00cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56956/0 (socket says 172.21.15.88:56956) 2023-11-20T07:01:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed5cba640 1 -- 172.21.15.88:0/1649896200 learned_addr learned my addr 172.21.15.88:0/1649896200 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:01.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed54b9640 1 --2- 172.21.15.88:0/1649896200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ed015ca70 0x7f1ed00d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/1649896200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ed015ca70 msgr2=0x7f1ed00d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:01.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/1649896200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ed015ca70 0x7f1ed00d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/1649896200 >> v1:172.21.15.88:6789/0 conn(0x7f1ed00cf5d0 legacy=0x7f1ed00d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ec7fff640 1 -- 172.21.15.88:0/1649896200 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356504456 0 0) 0x7f1ed00c65f0 con 0x7f1ed00cf5d0 2023-11-20T07:01:01.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.594+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/1649896200 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed00cdf80 con 0x7f1ed00d3550 2023-11-20T07:01:01.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/1649896200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ed00d3550 0x7f1ed00cf090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00097f0 tx=0x7f1ec001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66315fd0ce82e1e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:01.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ec7fff640 1 -- 172.21.15.88:0/1649896200 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00ab650 con 0x7f1ed00d3550 2023-11-20T07:01:01.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ec7fff640 1 -- 172.21.15.88:0/1649896200 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec00ab7b0 con 0x7f1ed00d3550 2023-11-20T07:01:01.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ec7fff640 1 -- 172.21.15.88:0/1649896200 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00abb40 con 0x7f1ed00d3550 2023-11-20T07:01:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ed771d640 1 -- 172.21.15.88:0/1649896200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ed00d3550 msgr2=0x7f1ed00cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ed771d640 1 --2- 172.21.15.88:0/1649896200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ed00d3550 0x7f1ed00cf090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00097f0 tx=0x7f1ec001c450 comp rx=0 tx=0).stop 2023-11-20T07:01:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ed771d640 1 -- 172.21.15.88:0/1649896200 shutdown_connections 2023-11-20T07:01:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ed771d640 1 --2- 172.21.15.88:0/1649896200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ed00d3550 0x7f1ed00cf090 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ed771d640 1 --2- 172.21.15.88:0/1649896200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ed015ca70 0x7f1ed00d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ed771d640 1 -- 172.21.15.88:0/1649896200 >> 172.21.15.88:0/1649896200 conn(0x7f1ed009bc50 msgr2=0x7f1ed00d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ed771d640 1 -- 172.21.15.88:0/1649896200 shutdown_connections 2023-11-20T07:01:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ed771d640 1 -- 172.21.15.88:0/1649896200 wait complete. 2023-11-20T07:01:01.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ed771d640 1 Processor -- start 2023-11-20T07:01:01.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.598+0000 7f1ed771d640 1 -- start start 2023-11-20T07:01:01.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed771d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ed00cf5d0 0x7f1ed015e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed771d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ed00d3550 0x7f1ed015e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed771d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ed015ca70 0x7f1ed015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed771d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00c99d0 con 0x7f1ed00d3550 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed771d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed015bc40 con 0x7f1ed00cf5d0 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed771d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed015bf20 con 0x7f1ed015ca70 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed4cb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ed00d3550 0x7f1ed015e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed4cb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ed00d3550 0x7f1ed015e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56958/0 (socket says 172.21.15.88:56958) 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/549173960 learned_addr learned my addr 172.21.15.88:0/549173960 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed5cba640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ed015ca70 0x7f1ed015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed54b9640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ed00cf5d0 0x7f1ed015e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ed015ca70 msgr2=0x7f1ed015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ed015ca70 0x7f1ed015aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ed00cf5d0 msgr2=0x7f1ed015e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ed00cf5d0 0x7f1ed015e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/549173960 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec0009420 con 0x7f1ed00d3550 2023-11-20T07:01:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ed00d3550 0x7f1ed015e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00ad040 tx=0x7f1ec001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ec5ffb640 1 -- 172.21.15.88:0/549173960 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00bf610 con 0x7f1ed00d3550 2023-11-20T07:01:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ec5ffb640 1 -- 172.21.15.88:0/549173960 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec00bf790 con 0x7f1ed00d3550 2023-11-20T07:01:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ec5ffb640 1 -- 172.21.15.88:0/549173960 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00bfb40 con 0x7f1ed00d3550 2023-11-20T07:01:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed771d640 1 -- 172.21.15.88:0/549173960 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed015c200 con 0x7f1ed00d3550 2023-11-20T07:01:01.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.602+0000 7f1ed771d640 1 -- 172.21.15.88:0/549173960 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed0153e30 con 0x7f1ed00d3550 2023-11-20T07:01:01.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ec5ffb640 1 -- 172.21.15.88:0/549173960 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1ec00b5400 con 0x7f1ed00d3550 2023-11-20T07:01:01.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ec5ffb640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1eb40664d0 0x7f1eb4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ec5ffb640 1 -- 172.21.15.88:0/549173960 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ec011efa0 con 0x7f1ed00d3550 2023-11-20T07:01:01.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1edaa90000 1 Processor -- start 2023-11-20T07:01:01.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed54b9640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1eb40664d0 0x7f1eb4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1edaa90000 1 -- start start 2023-11-20T07:01:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed54b9640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1eb40664d0 0x7f1eb4068990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1ed01603c0 tx=0x7f1ecc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1edaa90000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26487840 0x562f26487c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1edaa90000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26488160 0x562f2643d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1edaa90000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 0x562f2643dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1edaa90000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f26232cc0 con 0x562f26488160 2023-11-20T07:01:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1edaa90000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f262958e0 con 0x562f26487840 2023-11-20T07:01:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1edaa90000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f26292e10 con 0x562f2643dbf0 2023-11-20T07:01:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed4cb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26488160 0x562f2643d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed4cb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26488160 0x562f2643d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56964/0 (socket says 172.21.15.88:56964) 2023-11-20T07:01:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/2729341386 learned_addr learned my addr 172.21.15.88:0/2729341386 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed54b9640 1 --2- 172.21.15.88:0/2729341386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26487840 0x562f26487c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed5cba640 1 --2- 172.21.15.88:0/2729341386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 0x562f2643dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/2729341386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 msgr2=0x562f2643dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/2729341386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 0x562f2643dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/2729341386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26487840 msgr2=0x562f26487c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/2729341386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26487840 0x562f26487c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/2729341386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f25f87890 con 0x562f26488160 2023-11-20T07:01:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/2729341386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26488160 0x562f2643d6b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00f7cd0 tx=0x7f1ec00ef990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed507c08c8bff984 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1eb2ffd640 1 -- 172.21.15.88:0/2729341386 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00f8200 con 0x562f26488160 2023-11-20T07:01:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1eb2ffd640 1 -- 172.21.15.88:0/2729341386 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec00f60c0 con 0x562f26488160 2023-11-20T07:01:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.606+0000 7f1eb2ffd640 1 -- 172.21.15.88:0/2729341386 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00ec610 con 0x562f26488160 2023-11-20T07:01:01.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 -- 172.21.15.88:0/2729341386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26488160 msgr2=0x562f2643d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 --2- 172.21.15.88:0/2729341386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26488160 0x562f2643d6b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00f7cd0 tx=0x7f1ec00ef990 comp rx=0 tx=0).stop 2023-11-20T07:01:01.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 -- 172.21.15.88:0/2729341386 shutdown_connections 2023-11-20T07:01:01.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 --2- 172.21.15.88:0/2729341386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 0x562f2643dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 --2- 172.21.15.88:0/2729341386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26488160 0x562f2643d6b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 --2- 172.21.15.88:0/2729341386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26487840 0x562f26487c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 -- 172.21.15.88:0/2729341386 >> 172.21.15.88:0/2729341386 conn(0x562f26434f60 msgr2=0x562f2643bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:01.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 -- 172.21.15.88:0/2729341386 shutdown_connections 2023-11-20T07:01:01.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 -- 172.21.15.88:0/2729341386 wait complete. 2023-11-20T07:01:01.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 -- start start 2023-11-20T07:01:01.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 Processor -- start 2023-11-20T07:01:01.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 0x562f26448800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f26448d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26488160 0x562f26449280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2628e700 con 0x562f26487840 2023-11-20T07:01:01.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2624dd10 con 0x562f26488160 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f2624d9b0 con 0x562f2643dbf0 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 10 client.0 _ll_register_callbacks cb 0x562f26429330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1ed4cb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f26448d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1ed4cb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f26448d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56978/0 (socket says 172.21.15.88:56978) 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/1535836648 learned_addr learned my addr 172.21.15.88:0/1535836648 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1ed54b9640 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 0x562f26448800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1ed5cba640 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26488160 0x562f26449280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/1535836648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 msgr2=0x562f26448800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 0x562f26448800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/1535836648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26488160 msgr2=0x562f26449280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26488160 0x562f26449280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/1535836648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed0153e30 con 0x562f26487840 2023-11-20T07:01:01.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f26448d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00efc00 tx=0x7f1ec0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cf277885146954 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:01.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1eabfff640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-11-20T07:01:01.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1eabfff640 1 -- 172.21.15.88:0/1535836648 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00fd070 con 0x562f26487840 2023-11-20T07:01:01.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1eabfff640 1 -- 172.21.15.88:0/1535836648 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ec0119030 con 0x562f26487840 2023-11-20T07:01:01.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 -- 172.21.15.88:0/1535836648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f26242370 con 0x562f26487840 2023-11-20T07:01:01.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1eabfff640 1 -- 172.21.15.88:0/1535836648 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ec00f8200 con 0x562f26487840 2023-11-20T07:01:01.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 10 client.4422 fetch_fsmap learned FSMap version 7 2023-11-20T07:01:01.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1edaa90000 1 -- 172.21.15.88:0/1535836648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562f26250460 con 0x562f26487840 2023-11-20T07:01:01.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1eabfff640 1 -- 172.21.15.88:0/1535836648 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562f26242370 con 0x562f26487840 2023-11-20T07:01:01.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.610+0000 7f1eabfff640 1 -- 172.21.15.88:0/1535836648 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f1ec00c8020 con 0x562f26487840 2023-11-20T07:01:01.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2023-11-20T07:01:01.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 10 client.4422 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-20T07:01:01.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 20 client.4422 populate_metadata read hostname 'smithi088' 2023-11-20T07:01:01.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x562f26496ae0 0x562f26498ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 4 client.4422 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-20T07:01:01.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 -- 172.21.15.88:0/1535836648 --> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f262282d0 con 0x562f26496ae0 2023-11-20T07:01:01.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1ed54b9640 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x562f26496ae0 0x562f26498ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1ed54b9640 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x562f26496ae0 0x562f26498ed0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cf8dd1f5918c1a1 server_cookie=1317622c7bff7b99 in_seq=0 out_seq=0 2023-11-20T07:01:01.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1eabfff640 10 client.4422 ms_handle_connect on v2:172.21.15.175:6835/3413113678 2023-11-20T07:01:01.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1eabfff640 1 -- 172.21.15.88:0/1535836648 <== mds.0 v2:172.21.15.175:6835/3413113678 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562f262282d0 con 0x562f26496ae0 2023-11-20T07:01:01.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1eabfff640 10 client.4422 handle_command_reply: tid=0 2023-11-20T07:01:01.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 client.4422 shutdown 2023-11-20T07:01:01.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 -- 172.21.15.88:0/1535836648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 msgr2=0x562f26448d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f26448d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00efc00 tx=0x7f1ec0000bd0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 -- 172.21.15.88:0/1535836648 shutdown_connections 2023-11-20T07:01:01.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x562f26496ae0 0x562f26498ed0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26488160 0x562f26449280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f26448d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 --2- 172.21.15.88:0/1535836648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 0x562f26448800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1eabfff640 0 client.4422 ms_handle_reset on v2:172.21.15.175:6835/3413113678 2023-11-20T07:01:01.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 -- 172.21.15.88:0/1535836648 >> 172.21.15.88:0/1535836648 conn(0x562f26434f60 msgr2=0x562f2643c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:01.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 -- 172.21.15.88:0/1535836648 shutdown_connections 2023-11-20T07:01:01.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 1 -- 172.21.15.88:0/1535836648 wait complete. 2023-11-20T07:01:01.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.614+0000 7f1edaa90000 20 client.4422 trim_cache size 0 max 16384 2023-11-20T07:01:01.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 Processor -- start 2023-11-20T07:01:01.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 -- start start 2023-11-20T07:01:01.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 0x562f264e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f264e2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26488160 0x562f264e2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f25f48940 con 0x562f26487840 2023-11-20T07:01:01.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f2628bb00 con 0x562f26488160 2023-11-20T07:01:01.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f2623c6c0 con 0x562f2643dbf0 2023-11-20T07:01:01.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1ed4cb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f264e2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1ed4cb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f264e2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56980/0 (socket says 172.21.15.88:56980) 2023-11-20T07:01:01.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/1588642244 learned_addr learned my addr 172.21.15.88:0/1588642244 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:01.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/1588642244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 msgr2=0x562f264e1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:01.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/1588642244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 0x562f264e1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/1588642244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26488160 msgr2=0x562f264e2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:01.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/1588642244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26488160 0x562f264e2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/1588642244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f26236760 con 0x562f26487840 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/1588642244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f264e2400 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00efe90 tx=0x7f1ec00c1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d84e6ccaaad8c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1eb37fe640 1 -- 172.21.15.88:0/1588642244 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00fd030 con 0x562f26487840 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1eb37fe640 1 -- 172.21.15.88:0/1588642244 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec00eff00 con 0x562f26487840 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1eb37fe640 1 -- 172.21.15.88:0/1588642244 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00ebf50 con 0x562f26487840 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 -- 172.21.15.88:0/1588642244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 msgr2=0x562f264e2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 --2- 172.21.15.88:0/1588642244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f264e2400 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00efe90 tx=0x7f1ec00c1000 comp rx=0 tx=0).stop 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 -- 172.21.15.88:0/1588642244 shutdown_connections 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 --2- 172.21.15.88:0/1588642244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f26488160 0x562f264e2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 --2- 172.21.15.88:0/1588642244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f264e2400 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 --2- 172.21.15.88:0/1588642244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f2643dbf0 0x562f264e1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 -- 172.21.15.88:0/1588642244 >> 172.21.15.88:0/1588642244 conn(0x562f26434f60 msgr2=0x562f26499760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 -- 172.21.15.88:0/1588642244 shutdown_connections 2023-11-20T07:01:01.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.630+0000 7f1edaa90000 1 -- 172.21.15.88:0/1588642244 wait complete. 2023-11-20T07:01:01.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 1 -- start start 2023-11-20T07:01:01.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 1 Processor -- start 2023-11-20T07:01:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f2643dbf0 0x562f26485980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f26485ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f26488160 0x562f264a2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f262cfb40 con 0x562f26487840 2023-11-20T07:01:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f26257720 con 0x562f2643dbf0 2023-11-20T07:01:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f26293870 con 0x562f26488160 2023-11-20T07:01:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 10 client.0 _ll_register_callbacks cb 0x7f1ec00ec240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-20T07:01:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1ed4cb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f26485ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1ed4cb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f26485ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:56996/0 (socket says 172.21.15.88:56996) 2023-11-20T07:01:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/2879825695 learned_addr learned my addr 172.21.15.88:0/2879825695 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1ed54b9640 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f2643dbf0 0x562f26485980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1ed5cba640 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f26488160 0x562f264a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/2879825695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f26488160 msgr2=0x562f264a2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f26488160 0x562f264a2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/2879825695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f2643dbf0 msgr2=0x562f26485980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f2643dbf0 0x562f26485980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1ed4cb8640 1 -- 172.21.15.88:0/2879825695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f26250460 con 0x562f26487840 2023-11-20T07:01:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1ed4cb8640 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f26485ec0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00091d0 tx=0x7f1ec00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17379fe22d1a4c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1eabfff640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-11-20T07:01:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1eabfff640 1 -- 172.21.15.88:0/2879825695 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00fd040 con 0x562f26487840 2023-11-20T07:01:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1eabfff640 1 -- 172.21.15.88:0/2879825695 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ec0119070 con 0x562f26487840 2023-11-20T07:01:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 1 -- 172.21.15.88:0/2879825695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f262266f0 con 0x562f26487840 2023-11-20T07:01:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1eabfff640 1 -- 172.21.15.88:0/2879825695 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ec00eff00 con 0x562f26487840 2023-11-20T07:01:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 10 client.4428 fetch_fsmap learned FSMap version 7 2023-11-20T07:01:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 1 -- 172.21.15.88:0/2879825695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562f25f87cc0 con 0x562f26487840 2023-11-20T07:01:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1eabfff640 1 -- 172.21.15.88:0/2879825695 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562f262266f0 con 0x562f26487840 2023-11-20T07:01:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1eabfff640 1 -- 172.21.15.88:0/2879825695 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f1ec00c8070 con 0x562f26487840 2023-11-20T07:01:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2023-11-20T07:01:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 10 client.4428 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-20T07:01:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 20 client.4428 populate_metadata read hostname 'smithi088' 2023-11-20T07:01:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x562f264a2c20 0x562f264ee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 4 client.4428 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-20T07:01:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1edaa90000 1 -- 172.21.15.88:0/2879825695 --> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562f262876e0 con 0x562f264a2c20 2023-11-20T07:01:01.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.634+0000 7f1ed54b9640 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x562f264a2c20 0x562f264ee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1eabfff640 10 client.4428 ms_handle_connect on v2:172.21.15.175:6835/3413113678 2023-11-20T07:01:01.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed54b9640 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x562f264a2c20 0x562f264ee150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d63fcd9894bb95a server_cookie=c16062f6b8841599 in_seq=0 out_seq=0 2023-11-20T07:01:01.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1eabfff640 1 -- 172.21.15.88:0/2879825695 <== mds.0 v2:172.21.15.175:6835/3413113678 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x562f262876e0 con 0x562f264a2c20 2023-11-20T07:01:01.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1eabfff640 10 client.4428 handle_command_reply: tid=0 2023-11-20T07:01:01.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1edaa90000 1 client.4428 shutdown 2023-11-20T07:01:01.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1edaa90000 1 -- 172.21.15.88:0/2879825695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 msgr2=0x562f26485ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1edaa90000 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f26485ec0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00091d0 tx=0x7f1ec00191f0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1edaa90000 1 -- 172.21.15.88:0/2879825695 shutdown_connections 2023-11-20T07:01:01.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1edaa90000 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x562f264a2c20 0x562f264ee150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1edaa90000 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x562f26488160 0x562f264a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1edaa90000 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x562f26487840 0x562f26485ec0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1eabfff640 0 client.4428 ms_handle_reset on v2:172.21.15.175:6835/3413113678 2023-11-20T07:01:01.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1edaa90000 1 --2- 172.21.15.88:0/2879825695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f2643dbf0 0x562f26485980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1edaa90000 1 -- 172.21.15.88:0/2879825695 >> 172.21.15.88:0/2879825695 conn(0x562f26434f60 msgr2=0x562f26499e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:01.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1edaa90000 1 -- 172.21.15.88:0/2879825695 shutdown_connections 2023-11-20T07:01:01.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1edaa90000 1 -- 172.21.15.88:0/2879825695 wait complete. 2023-11-20T07:01:01.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1edaa90000 20 client.4428 trim_cache size 0 max 16384 2023-11-20T07:01:01.642 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:01:01.642 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "81254148-3aea-4f86-927e-f8c4e1bfa591", 2023-11-20T07:01:01.642 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-11-20T07:01:01.642 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4272, 2023-11-20T07:01:01.643 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-11-20T07:01:01.643 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-11-20T07:01:01.643 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-11-20T07:01:01.643 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 6.9838054749999996, 2023-11-20T07:01:01.643 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 7, 2023-11-20T07:01:01.643 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 24, 2023-11-20T07:01:01.643 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 24, 2023-11-20T07:01:01.643 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 14.302490322000001 2023-11-20T07:01:01.643 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:01:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed771d640 1 -- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1eb40664d0 msgr2=0x7f1eb4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed771d640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1eb40664d0 0x7f1eb4068990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1ed01603c0 tx=0x7f1ecc008040 comp rx=0 tx=0).stop 2023-11-20T07:01:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed771d640 1 -- 172.21.15.88:0/549173960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ed00d3550 msgr2=0x7f1ed015e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed771d640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ed00d3550 0x7f1ed015e760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00ad040 tx=0x7f1ec001ac90 comp rx=0 tx=0).stop 2023-11-20T07:01:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed771d640 1 -- 172.21.15.88:0/549173960 shutdown_connections 2023-11-20T07:01:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed771d640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1eb40664d0 0x7f1eb4068990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed771d640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ed015ca70 0x7f1ed015aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed771d640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ed00d3550 0x7f1ed015e760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed771d640 1 --2- 172.21.15.88:0/549173960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ed00cf5d0 0x7f1ed015e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed771d640 1 -- 172.21.15.88:0/549173960 >> 172.21.15.88:0/549173960 conn(0x7f1ed009bc50 msgr2=0x7f1ed006b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:01.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed771d640 1 -- 172.21.15.88:0/549173960 shutdown_connections 2023-11-20T07:01:01.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.638+0000 7f1ed771d640 1 -- 172.21.15.88:0/549173960 wait complete. 2023-11-20T07:01:01.658 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-20T07:01:01.658 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-20T07:01:01.659 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-20T07:01:01.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.794+0000 7f4fa6817640 1 Processor -- start 2023-11-20T07:01:01.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.794+0000 7f4fa6817640 1 -- start start 2023-11-20T07:01:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.794+0000 7f4fa6817640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fa00b2ad0 0x7f4fa006b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.794+0000 7f4fa6817640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4fa00ce310 0x7f4fa00ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4fa6817640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa006d000 con 0x7f4fa015cf90 2023-11-20T07:01:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4fa6817640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa00ced00 con 0x7f4fa00b2ad0 2023-11-20T07:01:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4fa6817640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa0160580 con 0x7f4fa00ce310 2023-11-20T07:01:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4f9ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fa00b2ad0 0x7f4fa006b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4f9ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fa00b2ad0 0x7f4fa006b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57000/0 (socket says 172.21.15.88:57000) 2023-11-20T07:01:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4f9ffff640 1 -- 172.21.15.88:0/1986107458 learned_addr learned my addr 172.21.15.88:0/1986107458 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4fa4db4640 1 --2- 172.21.15.88:0/1986107458 >> v2:172.21.15.175:3300/0 conn(0x7f4fa00ce310 0x7f4fa00ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4f9ffff640 1 -- 172.21.15.88:0/1986107458 >> v2:172.21.15.175:3300/0 conn(0x7f4fa00ce310 msgr2=0x7f4fa00ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4f9ffff640 1 --2- 172.21.15.88:0/1986107458 >> v2:172.21.15.175:3300/0 conn(0x7f4fa00ce310 0x7f4fa00ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4f9ffff640 1 -- 172.21.15.88:0/1986107458 >> v1:172.21.15.175:6789/0 conn(0x7f4fa015cf90 legacy=0x7f4fa006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:01.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4f9ffff640 1 -- 172.21.15.88:0/1986107458 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa015d4e0 con 0x7f4fa00b2ad0 2023-11-20T07:01:01.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4fa4db4640 1 --2- 172.21.15.88:0/1986107458 >> v2:172.21.15.175:3300/0 conn(0x7f4fa00ce310 0x7f4fa00ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:01.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4f9ffff640 1 --2- 172.21.15.88:0/1986107458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fa00b2ad0 0x7f4fa006b4b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009870 tx=0x7f4f9001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984b210877a14db7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4f9effd640 1 -- 172.21.15.88:0/1986107458 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f900aa5f0 con 0x7f4fa00b2ad0 2023-11-20T07:01:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4f9effd640 1 -- 172.21.15.88:0/1986107458 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f900aa750 con 0x7f4fa00b2ad0 2023-11-20T07:01:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.798+0000 7f4f9effd640 1 -- 172.21.15.88:0/1986107458 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f900aaae0 con 0x7f4fa00b2ad0 2023-11-20T07:01:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 -- 172.21.15.88:0/1986107458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fa00b2ad0 msgr2=0x7f4fa006b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 --2- 172.21.15.88:0/1986107458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fa00b2ad0 0x7f4fa006b4b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009870 tx=0x7f4f9001c490 comp rx=0 tx=0).stop 2023-11-20T07:01:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 -- 172.21.15.88:0/1986107458 shutdown_connections 2023-11-20T07:01:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 --2- 172.21.15.88:0/1986107458 >> v2:172.21.15.175:3300/0 conn(0x7f4fa00ce310 0x7f4fa00ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 --2- 172.21.15.88:0/1986107458 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fa00b2ad0 0x7f4fa006b4b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 -- 172.21.15.88:0/1986107458 >> 172.21.15.88:0/1986107458 conn(0x7f4fa00cd1c0 msgr2=0x7f4fa00cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 -- 172.21.15.88:0/1986107458 shutdown_connections 2023-11-20T07:01:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 -- 172.21.15.88:0/1986107458 wait complete. 2023-11-20T07:01:01.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 Processor -- start 2023-11-20T07:01:01.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 -- start start 2023-11-20T07:01:01.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa00b2ad0 0x7f4fa00b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa00ce310 0x7f4fa0158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fa015cf90 0x7f4fa0159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa00b3df0 con 0x7f4fa015cf90 2023-11-20T07:01:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa01f5f20 con 0x7f4fa00ce310 2023-11-20T07:01:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa6817640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa00b34c0 con 0x7f4fa00b2ad0 2023-11-20T07:01:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa4db4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fa015cf90 0x7f4fa0159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa4db4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fa015cf90 0x7f4fa0159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57014/0 (socket says 172.21.15.88:57014) 2023-11-20T07:01:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4fa4db4640 1 -- 172.21.15.88:0/4022226675 learned_addr learned my addr 172.21.15.88:0/4022226675 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4f9ffff640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa00b2ad0 0x7f4fa00b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.802+0000 7f4f9f7fe640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa00ce310 0x7f4fa0158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4fa4db4640 1 -- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa00b2ad0 msgr2=0x7f4fa00b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4fa4db4640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa00b2ad0 0x7f4fa00b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4fa4db4640 1 -- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa00ce310 msgr2=0x7f4fa0158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4fa4db4640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa00ce310 0x7f4fa0158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4fa4db4640 1 -- 172.21.15.88:0/4022226675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f900094d0 con 0x7f4fa015cf90 2023-11-20T07:01:01.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4fa4db4640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fa015cf90 0x7f4fa0159050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800cd50 tx=0x7f4f9800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:01.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4f9cff9640 1 -- 172.21.15.88:0/4022226675 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9800f680 con 0x7f4fa015cf90 2023-11-20T07:01:01.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4f9cff9640 1 -- 172.21.15.88:0/4022226675 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9800f800 con 0x7f4fa015cf90 2023-11-20T07:01:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4fa6817640 1 -- 172.21.15.88:0/4022226675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa00b37a0 con 0x7f4fa015cf90 2023-11-20T07:01:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4f9cff9640 1 -- 172.21.15.88:0/4022226675 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9800fbb0 con 0x7f4fa015cf90 2023-11-20T07:01:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4fa6817640 1 -- 172.21.15.88:0/4022226675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa00b4280 con 0x7f4fa015cf90 2023-11-20T07:01:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4fa6817640 1 -- 172.21.15.88:0/4022226675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa00b3f60 con 0x7f4fa015cf90 2023-11-20T07:01:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4f9cff9640 1 -- 172.21.15.88:0/4022226675 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4f9800b040 con 0x7f4fa015cf90 2023-11-20T07:01:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4f9cff9640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4f8c0664a0 0x7f4f8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4f9cff9640 1 -- 172.21.15.88:0/4022226675 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f98084a40 con 0x7f4fa015cf90 2023-11-20T07:01:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.806+0000 7f4f9ffff640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4f8c0664a0 0x7f4f8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:01.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.810+0000 7f4f9ffff640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4f8c0664a0 0x7f4f8c068960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4f900ae000 tx=0x7f4f900b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:01.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.810+0000 7f4f9cff9640 1 -- 172.21.15.88:0/4022226675 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4f98086e60 con 0x7f4fa015cf90 2023-11-20T07:01:01.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 -- 172.21.15.88:0/4022226675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4fa0074010 con 0x7f4fa015cf90 2023-11-20T07:01:01.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4f9cff9640 1 -- 172.21.15.88:0/4022226675 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4f98051c80 con 0x7f4fa015cf90 2023-11-20T07:01:01.994 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-20T07:01:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 -- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4f8c0664a0 msgr2=0x7f4f8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4f8c0664a0 0x7f4f8c068960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4f900ae000 tx=0x7f4f900b5040 comp rx=0 tx=0).stop 2023-11-20T07:01:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 -- 172.21.15.88:0/4022226675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fa015cf90 msgr2=0x7f4fa0159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fa015cf90 0x7f4fa0159050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800cd50 tx=0x7f4f9800a650 comp rx=0 tx=0).stop 2023-11-20T07:01:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 -- 172.21.15.88:0/4022226675 shutdown_connections 2023-11-20T07:01:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4f8c0664a0 0x7f4f8c068960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fa015cf90 0x7f4fa0159050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa00ce310 0x7f4fa0158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 --2- 172.21.15.88:0/4022226675 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa00b2ad0 0x7f4fa00b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 -- 172.21.15.88:0/4022226675 >> 172.21.15.88:0/4022226675 conn(0x7f4fa00cd1c0 msgr2=0x7f4fa00d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:01.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 -- 172.21.15.88:0/4022226675 shutdown_connections 2023-11-20T07:01:01.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:01.994+0000 7f4fa6817640 1 -- 172.21.15.88:0/4022226675 wait complete. 2023-11-20T07:01:02.014 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-20T07:01:02.014 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-20T07:01:02.014 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-11-20T07:01:02.014 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-11-20T07:01:02.015 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-11-20T07:01:02.015 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-20T07:01:02.015 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-20T07:01:02.015 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-20T07:01:02.015 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-11-20T07:01:02.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:02.015 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-11-20T07:01:02.024 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T07:01:02.024 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T07:01:02.025 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T07:01:02.025 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:02.025 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-11-20T07:01:02.025 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:02.025 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:02.025 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:02.025 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-11-20T07:01:02.025 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:02.025 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:02.025 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-11-20T07:01:02.025 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:02.026 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:02.026 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-20T07:01:02.026 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:02.026 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-20T07:01:02.026 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42411sec preferred_lft 42411sec 2023-11-20T07:01:02.026 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-11-20T07:01:02.026 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:02.026 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-20T07:01:02.026 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:1c:fd:c7:b2 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:02.026 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-20T07:01:02.026 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:02.027 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-20T07:01:02.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:02.028 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:02.028 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:02.028 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2023-11-20T07:01:02.028 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2023-11-20T07:01:02.028 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2023-11-20T07:01:02.028 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-20T07:01:02.028 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:02.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:02.142 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-20T07:01:02.161 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-11-20T07:01:02.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:02.164 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-11-20T07:01:02.234 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-11-20T07:01:02.234 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-20T07:01:02.234 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-20T07:01:02.234 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-20T07:01:02.234 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-20T07:01:02.234 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-20T07:01:02.234 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:02.234 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:02.235 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:02.235 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-20T07:01:02.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:02.235 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:02.235 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:02.236 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-20T07:01:02.236 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-20T07:01:02.236 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-20T07:01:02.236 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:02.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:02.335 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-11-20T07:01:02.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:02.345 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-11-20T07:01:02.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:02.393 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:02.394 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:02.394 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T07:01:02.394 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-11-20T07:01:02.394 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:02.477 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-11-20T07:01:02.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:02.477 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:02.477 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:02.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-11-20T07:01:02.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-20T07:01:02.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-11-20T07:01:02.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-11-20T07:01:02.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-11-20T07:01:02.478 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:02.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:02.652 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:02.652 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:02.652 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-11-20T07:01:02.652 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2023-11-20T07:01:02.652 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:02.693 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-11-20T07:01:02.693 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T07:01:02.693 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-11-20T07:01:02.745 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-11-20T07:01:02.745 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T07:01:02.745 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-11-20T07:01:02.797 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-20T07:01:02.861 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:01:02.914 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-20T07:01:02.915 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-20T07:01:02.915 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-20T07:01:02.915 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-20T07:01:02.915 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-20T07:01:02.915 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-20T07:01:02.915 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-20T07:01:02.915 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-20T07:01:02.916 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2023-11-20T07:01:02.916 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-20T07:01:02.916 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-20T07:01:02.916 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-20T07:01:02.916 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:01:02.916 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-20T07:01:02.917 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-20T07:01:02.917 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-20T07:01:02.917 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-20T07:01:02.917 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2023-11-20T07:01:02.917 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-20T07:01:02.917 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-20T07:01:02.918 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:01:02.918 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2023-11-20T07:01:02.918 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-20T07:01:02.918 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-20T07:01:02.918 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T07:01:02.918 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T07:01:02.918 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T07:01:02.919 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T07:01:02.919 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-20T07:01:02.919 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T07:01:02.919 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T07:01:02.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:02.920 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-20T07:01:02.973 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-20T07:01:02.973 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-11-20T07:01:03.023 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-20T07:01:03.044 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:01:03.103 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-20T07:01:03.103 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-20T07:01:03.103 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-20T07:01:03.103 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-20T07:01:03.103 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-20T07:01:03.103 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-20T07:01:03.104 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-20T07:01:03.104 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-20T07:01:03.104 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2023-11-20T07:01:03.104 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-20T07:01:03.104 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-20T07:01:03.104 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-20T07:01:03.104 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:01:03.105 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-20T07:01:03.105 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-20T07:01:03.105 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-20T07:01:03.105 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-20T07:01:03.105 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2023-11-20T07:01:03.105 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-20T07:01:03.106 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-20T07:01:03.106 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:01:03.106 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2023-11-20T07:01:03.106 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-20T07:01:03.106 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-20T07:01:03.106 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T07:01:03.106 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T07:01:03.106 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T07:01:03.106 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T07:01:03.106 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-20T07:01:03.107 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T07:01:03.107 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T07:01:03.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:03.108 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-20T07:01:03.135 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:2023-11-20T07:01:03.134+0000 7f2a82375580 -1 init, newargv = 0x55971011e330 newargc=15 2023-11-20T07:01:03.135 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:ceph-fuse[44384]: starting ceph client 2023-11-20T07:01:03.145 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:ceph-fuse[44384]: starting fuse 2023-11-20T07:01:04.245 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-20T07:01:04.269 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:01:04.327 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-20T07:01:04.327 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-20T07:01:04.327 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-20T07:01:04.327 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-20T07:01:04.327 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-20T07:01:04.327 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-20T07:01:04.327 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-20T07:01:04.327 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-20T07:01:04.328 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2023-11-20T07:01:04.328 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-20T07:01:04.328 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-20T07:01:04.328 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-20T07:01:04.328 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:01:04.328 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-20T07:01:04.328 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-20T07:01:04.328 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-20T07:01:04.328 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-20T07:01:04.328 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2023-11-20T07:01:04.328 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-20T07:01:04.328 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-20T07:01:04.329 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:01:04.329 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2023-11-20T07:01:04.329 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-20T07:01:04.329 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-20T07:01:04.329 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T07:01:04.329 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T07:01:04.329 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T07:01:04.329 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T07:01:04.329 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-20T07:01:04.329 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T07:01:04.329 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T07:01:04.329 INFO:teuthology.orchestra.run.smithi088.stdout:/home/ubuntu/cephtest/mnt.admin 2023-11-20T07:01:04.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:04.330 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-20T07:01:04.385 INFO:teuthology.orchestra.run.smithi088.stdout:43 2023-11-20T07:01:04.385 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-20T07:01:04.385 DEBUG:teuthology.orchestra.run.smithi088:> sudo stdin-killer -- python3 -c ' 2023-11-20T07:01:04.385 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2023-11-20T07:01:04.385 DEBUG:teuthology.orchestra.run.smithi088:> import re 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> import os 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2023-11-20T07:01:04.386 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:01:04.387 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2023-11-20T07:01:04.387 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-20T07:01:04.387 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-20T07:01:04.387 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-20T07:01:04.387 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2023-11-20T07:01:04.387 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2023-11-20T07:01:04.387 DEBUG:teuthology.orchestra.run.smithi088:> return f 2023-11-20T07:01:04.387 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-20T07:01:04.387 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:01:04.387 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.admin")) 2023-11-20T07:01:04.387 DEBUG:teuthology.orchestra.run.smithi088:> ' 2023-11-20T07:01:04.518 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.admin.44384.asok 2023-11-20T07:01:04.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-20T07:01:04.530 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44384.asok 2023-11-20T07:01:04.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:04.530 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44384.asok status 2023-11-20T07:01:04.701 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:01:04.701 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2023-11-20T07:01:04.702 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-20T07:01:04.702 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-20T07:01:04.702 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "admin", 2023-11-20T07:01:04.702 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2023-11-20T07:01:04.702 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-11-20T07:01:04.702 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "44384", 2023-11-20T07:01:04.702 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2023-11-20T07:01:04.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:01:04.702 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2023-11-20T07:01:04.702 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2023-11-20T07:01:04.702 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4440, 2023-11-20T07:01:04.703 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2023-11-20T07:01:04.703 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2023-11-20T07:01:04.703 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2023-11-20T07:01:04.703 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4440 2023-11-20T07:01:04.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:01:04.703 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-11-20T07:01:04.703 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-11-20T07:01:04.703 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-11-20T07:01:04.703 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 1734907791 2023-11-20T07:01:04.703 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:01:04.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:01:04.704 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-11-20T07:01:04.704 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-11-20T07:01:04.704 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-11-20T07:01:04.704 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 1734907791 2023-11-20T07:01:04.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:01:04.704 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.4440 192.168.0.1:0/1734907791", 2023-11-20T07:01:04.704 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "192.168.0.1:0/1734907791", 2023-11-20T07:01:04.704 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2023-11-20T07:01:04.704 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 7, 2023-11-20T07:01:04.704 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 24, 2023-11-20T07:01:04.704 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2023-11-20T07:01:04.705 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2023-11-20T07:01:04.705 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2023-11-20T07:01:04.705 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:01:04.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:04.716 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2023-11-20T07:01:04.716 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-11-20T07:01:04.725 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2023-11-20T07:01:04.726 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-11-20T07:01:04.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:04.726 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-11-20T07:01:04.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:04.795 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-11-20T07:01:04.890 INFO:teuthology.orchestra.run.smithi088.stdout:# file: . 2023-11-20T07:01:04.890 INFO:teuthology.orchestra.run.smithi088.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-11-20T07:01:04.890 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:04.891 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:01:04.892 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:04.900 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:05.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.074+0000 7ff218817640 1 Processor -- start 2023-11-20T07:01:05.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.074+0000 7ff218817640 1 -- start start 2023-11-20T07:01:05.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff218817640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff21415ca50 0x7ff21406c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff218817640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff21415ce30 0x7ff2140cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff218817640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2141607e0 con 0x7ff2140b21c0 2023-11-20T07:01:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff218817640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2140cf060 con 0x7ff21415ce30 2023-11-20T07:01:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff218817640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff214070210 con 0x7ff21415ca50 2023-11-20T07:01:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff20bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff21415ce30 0x7ff2140cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff20bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff21415ce30 0x7ff2140cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57022/0 (socket says 172.21.15.88:57022) 2023-11-20T07:01:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff20bfff640 1 -- 172.21.15.88:0/1592087232 learned_addr learned my addr 172.21.15.88:0/1592087232 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff20bfff640 1 -- 172.21.15.88:0/1592087232 >> v2:172.21.15.175:3300/0 conn(0x7ff21415ca50 msgr2=0x7ff21406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff20bfff640 1 --2- 172.21.15.88:0/1592087232 >> v2:172.21.15.175:3300/0 conn(0x7ff21415ca50 0x7ff21406c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff20bfff640 1 -- 172.21.15.88:0/1592087232 >> v1:172.21.15.175:6789/0 conn(0x7ff2140b21c0 legacy=0x7ff2140b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff20bfff640 1 -- 172.21.15.88:0/1592087232 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140704f0 con 0x7ff21415ce30 2023-11-20T07:01:05.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.078+0000 7ff20bfff640 1 --2- 172.21.15.88:0/1592087232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff21415ce30 0x7ff2140cad90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff2140726c0 tx=0x7ff20401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41226c7c71781940 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:05.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff211d9b640 1 -- 172.21.15.88:0/1592087232 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040aa5f0 con 0x7ff21415ce30 2023-11-20T07:01:05.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff211d9b640 1 -- 172.21.15.88:0/1592087232 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2040aa750 con 0x7ff21415ce30 2023-11-20T07:01:05.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff211d9b640 1 -- 172.21.15.88:0/1592087232 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040aaae0 con 0x7ff21415ce30 2023-11-20T07:01:05.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 -- 172.21.15.88:0/1592087232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff21415ce30 msgr2=0x7ff2140cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 --2- 172.21.15.88:0/1592087232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff21415ce30 0x7ff2140cad90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff2140726c0 tx=0x7ff20401c490 comp rx=0 tx=0).stop 2023-11-20T07:01:05.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 -- 172.21.15.88:0/1592087232 shutdown_connections 2023-11-20T07:01:05.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 --2- 172.21.15.88:0/1592087232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff21415ce30 0x7ff2140cad90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 --2- 172.21.15.88:0/1592087232 >> v2:172.21.15.175:3300/0 conn(0x7ff21415ca50 0x7ff21406c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 -- 172.21.15.88:0/1592087232 >> 172.21.15.88:0/1592087232 conn(0x7ff2140cd1c0 msgr2=0x7ff2140cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:05.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 -- 172.21.15.88:0/1592087232 shutdown_connections 2023-11-20T07:01:05.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 -- 172.21.15.88:0/1592087232 wait complete. 2023-11-20T07:01:05.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 Processor -- start 2023-11-20T07:01:05.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 -- start start 2023-11-20T07:01:05.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2140b21c0 0x7ff2140b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff21415ca50 0x7ff2140b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff21415ce30 0x7ff21415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140b4020 con 0x7ff21415ca50 2023-11-20T07:01:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff214154790 con 0x7ff2140b21c0 2023-11-20T07:01:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff218817640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140b3780 con 0x7ff21415ce30 2023-11-20T07:01:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff20bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff21415ca50 0x7ff2140b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff20bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff21415ca50 0x7ff2140b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57024/0 (socket says 172.21.15.88:57024) 2023-11-20T07:01:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.082+0000 7ff20bfff640 1 -- 172.21.15.88:0/209402668 learned_addr learned my addr 172.21.15.88:0/209402668 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff21259c640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2140b21c0 0x7ff2140b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff212d9d640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff21415ce30 0x7ff21415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff20bfff640 1 -- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff21415ce30 msgr2=0x7ff21415f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff20bfff640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff21415ce30 0x7ff21415f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff20bfff640 1 -- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2140b21c0 msgr2=0x7ff2140b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff20bfff640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2140b21c0 0x7ff2140b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff20bfff640 1 -- 172.21.15.88:0/209402668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2040094d0 con 0x7ff21415ca50 2023-11-20T07:01:05.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff21259c640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2140b21c0 0x7ff2140b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:05.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff212d9d640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff21415ce30 0x7ff21415f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:05.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff20bfff640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff21415ca50 0x7ff2140b51d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff20401a0c0 tx=0x7ff20401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:05.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff20affd640 1 -- 172.21.15.88:0/209402668 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040b3800 con 0x7ff21415ca50 2023-11-20T07:01:05.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff20affd640 1 -- 172.21.15.88:0/209402668 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2040b3980 con 0x7ff21415ca50 2023-11-20T07:01:05.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff20affd640 1 -- 172.21.15.88:0/209402668 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040b3d30 con 0x7ff21415ca50 2023-11-20T07:01:05.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff218817640 1 -- 172.21.15.88:0/209402668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2140b3a60 con 0x7ff21415ca50 2023-11-20T07:01:05.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff218817640 1 -- 172.21.15.88:0/209402668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2140b5710 con 0x7ff21415ca50 2023-11-20T07:01:05.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff218817640 1 -- 172.21.15.88:0/209402668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff214074010 con 0x7ff21415ca50 2023-11-20T07:01:05.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff20affd640 1 -- 172.21.15.88:0/209402668 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff2040b2380 con 0x7ff21415ca50 2023-11-20T07:01:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.086+0000 7ff20affd640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff1f40664a0 0x7ff1f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.090+0000 7ff20affd640 1 -- 172.21.15.88:0/209402668 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff2040a7070 con 0x7ff21415ca50 2023-11-20T07:01:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.090+0000 7ff21259c640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff1f40664a0 0x7ff1f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.090+0000 7ff21259c640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff1f40664a0 0x7ff1f4068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00a8b0 tx=0x7ff1fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:05.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.094+0000 7ff20affd640 1 -- 172.21.15.88:0/209402668 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff2040eb9d0 con 0x7ff21415ca50 2023-11-20T07:01:05.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.242+0000 7ff218817640 1 -- 172.21.15.88:0/209402668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2140cddb0 con 0x7ff21415ca50 2023-11-20T07:01:05.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.242+0000 7ff20affd640 1 -- 172.21.15.88:0/209402668 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7ff2040eeff0 con 0x7ff21415ca50 2023-11-20T07:01:05.244 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:05.244 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:05.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.246+0000 7ff218817640 1 -- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff1f40664a0 msgr2=0x7ff1f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.246+0000 7ff218817640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff1f40664a0 0x7ff1f4068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00a8b0 tx=0x7ff1fc008040 comp rx=0 tx=0).stop 2023-11-20T07:01:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.246+0000 7ff218817640 1 -- 172.21.15.88:0/209402668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff21415ca50 msgr2=0x7ff2140b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.246+0000 7ff218817640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff21415ca50 0x7ff2140b51d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff20401a0c0 tx=0x7ff20401acd0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.246+0000 7ff218817640 1 -- 172.21.15.88:0/209402668 shutdown_connections 2023-11-20T07:01:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.246+0000 7ff218817640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff1f40664a0 0x7ff1f4068960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.246+0000 7ff218817640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff21415ce30 0x7ff21415f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.246+0000 7ff218817640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff21415ca50 0x7ff2140b51d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.246+0000 7ff218817640 1 --2- 172.21.15.88:0/209402668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2140b21c0 0x7ff2140b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.246+0000 7ff218817640 1 -- 172.21.15.88:0/209402668 >> 172.21.15.88:0/209402668 conn(0x7ff2140cd1c0 msgr2=0x7ff2140b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.246+0000 7ff218817640 1 -- 172.21.15.88:0/209402668 shutdown_connections 2023-11-20T07:01:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.246+0000 7ff218817640 1 -- 172.21.15.88:0/209402668 wait complete. 2023-11-20T07:01:05.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:05.265 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:05.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326e66b640 1 Processor -- start 2023-11-20T07:01:05.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326e66b640 1 -- start start 2023-11-20T07:01:05.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326e66b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3268069e90 0x7f326806d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326e66b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f326806a270 0x7f32680c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326e66b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32680702f0 0x7f3268070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326e66b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32680cb090 con 0x7f32680702f0 2023-11-20T07:01:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326e66b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326815ae30 con 0x7f326806a270 2023-11-20T07:01:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326e66b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32680ca510 con 0x7f3268069e90 2023-11-20T07:01:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326cc08640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32680702f0 0x7f3268070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326cc08640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32680702f0 0x7f3268070780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57036/0 (socket says 172.21.15.88:57036) 2023-11-20T07:01:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326cc08640 1 -- 172.21.15.88:0/2040286447 learned_addr learned my addr 172.21.15.88:0/2040286447 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f3267fff640 1 --2- 172.21.15.88:0/2040286447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3268069e90 0x7f326806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f32677fe640 1 --2- 172.21.15.88:0/2040286447 >> v2:172.21.15.175:3300/0 conn(0x7f326806a270 0x7f32680c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326cc08640 1 -- 172.21.15.88:0/2040286447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3268069e90 msgr2=0x7f326806d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326cc08640 1 --2- 172.21.15.88:0/2040286447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3268069e90 0x7f326806d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326cc08640 1 -- 172.21.15.88:0/2040286447 >> v2:172.21.15.175:3300/0 conn(0x7f326806a270 msgr2=0x7f32680c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:05.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326cc08640 1 --2- 172.21.15.88:0/2040286447 >> v2:172.21.15.175:3300/0 conn(0x7f326806a270 0x7f32680c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f326cc08640 1 -- 172.21.15.88:0/2040286447 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32680ca7f0 con 0x7f32680702f0 2023-11-20T07:01:05.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.406+0000 7f32677fe640 1 --2- 172.21.15.88:0/2040286447 >> v2:172.21.15.175:3300/0 conn(0x7f326806a270 0x7f32680c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:05.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f326cc08640 1 --2- 172.21.15.88:0/2040286447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32680702f0 0x7f3268070780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f32680713b0 tx=0x7f326001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0fd012740d6459 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:05.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f3266ffd640 1 -- 172.21.15.88:0/2040286447 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32600a5820 con 0x7f32680702f0 2023-11-20T07:01:05.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f3266ffd640 1 -- 172.21.15.88:0/2040286447 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32600a5980 con 0x7f32680702f0 2023-11-20T07:01:05.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f3266ffd640 1 -- 172.21.15.88:0/2040286447 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32600a5d10 con 0x7f32680702f0 2023-11-20T07:01:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f326e66b640 1 -- 172.21.15.88:0/2040286447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32680702f0 msgr2=0x7f3268070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f326e66b640 1 --2- 172.21.15.88:0/2040286447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32680702f0 0x7f3268070780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f32680713b0 tx=0x7f326001c9a0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f326e66b640 1 -- 172.21.15.88:0/2040286447 shutdown_connections 2023-11-20T07:01:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f326e66b640 1 --2- 172.21.15.88:0/2040286447 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32680702f0 0x7f3268070780 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f326e66b640 1 --2- 172.21.15.88:0/2040286447 >> v2:172.21.15.175:3300/0 conn(0x7f326806a270 0x7f32680c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f326e66b640 1 --2- 172.21.15.88:0/2040286447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3268069e90 0x7f326806d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f326e66b640 1 -- 172.21.15.88:0/2040286447 >> 172.21.15.88:0/2040286447 conn(0x7f32680b0da0 msgr2=0x7f32680ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f326e66b640 1 -- 172.21.15.88:0/2040286447 shutdown_connections 2023-11-20T07:01:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.410+0000 7f326e66b640 1 -- 172.21.15.88:0/2040286447 wait complete. 2023-11-20T07:01:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f326e66b640 1 Processor -- start 2023-11-20T07:01:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f326e66b640 1 -- start start 2023-11-20T07:01:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f326e66b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3268069e90 0x7f32680c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f326e66b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806a270 0x7f326814c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f326e66b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32680702f0 0x7f3268154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f326e66b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32680c7820 con 0x7f326806a270 2023-11-20T07:01:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f326e66b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32680c7b00 con 0x7f3268069e90 2023-11-20T07:01:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f326e66b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32680c7de0 con 0x7f32680702f0 2023-11-20T07:01:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f32677fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806a270 0x7f326814c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f32677fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806a270 0x7f326814c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57048/0 (socket says 172.21.15.88:57048) 2023-11-20T07:01:05.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f32677fe640 1 -- 172.21.15.88:0/3911673148 learned_addr learned my addr 172.21.15.88:0/3911673148 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:05.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f3267fff640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3268069e90 0x7f32680c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f326cc08640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32680702f0 0x7f3268154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f32677fe640 1 -- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32680702f0 msgr2=0x7f3268154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f32677fe640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32680702f0 0x7f3268154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f32677fe640 1 -- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3268069e90 msgr2=0x7f32680c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f32677fe640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3268069e90 0x7f32680c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f32677fe640 1 -- 172.21.15.88:0/3911673148 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3260009b30 con 0x7f326806a270 2023-11-20T07:01:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f3267fff640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3268069e90 0x7f32680c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f32677fe640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806a270 0x7f326814c570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f325c00c7c0 tx=0x7f325c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f3264ff9640 1 -- 172.21.15.88:0/3911673148 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c007a30 con 0x7f326806a270 2023-11-20T07:01:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f3264ff9640 1 -- 172.21.15.88:0/3911673148 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c007b90 con 0x7f326806a270 2023-11-20T07:01:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f3264ff9640 1 -- 172.21.15.88:0/3911673148 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c00ce70 con 0x7f326806a270 2023-11-20T07:01:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f326e66b640 1 -- 172.21.15.88:0/3911673148 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32680c80c0 con 0x7f326806a270 2023-11-20T07:01:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.414+0000 7f326e66b640 1 -- 172.21.15.88:0/3911673148 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32680c74f0 con 0x7f326806a270 2023-11-20T07:01:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.418+0000 7f326e66b640 1 -- 172.21.15.88:0/3911673148 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32680c2ec0 con 0x7f326806a270 2023-11-20T07:01:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.418+0000 7f3264ff9640 1 -- 172.21.15.88:0/3911673148 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f325c0113f0 con 0x7f326806a270 2023-11-20T07:01:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.418+0000 7f3264ff9640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f32540664a0 0x7f3254068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.418+0000 7f3264ff9640 1 -- 172.21.15.88:0/3911673148 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f325c0845d0 con 0x7f326806a270 2023-11-20T07:01:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.418+0000 7f3267fff640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f32540664a0 0x7f3254068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.418+0000 7f3267fff640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f32540664a0 0x7f3254068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3258004660 tx=0x7f3258008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:05.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.422+0000 7f3264ff9640 1 -- 172.21.15.88:0/3911673148 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f32680c2ec0 con 0x7f326806a270 2023-11-20T07:01:05.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.570+0000 7f326e66b640 1 -- 172.21.15.88:0/3911673148 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32680c2ec0 con 0x7f326806a270 2023-11-20T07:01:05.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f3264ff9640 1 -- 172.21.15.88:0/3911673148 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32680c2ec0 con 0x7f326806a270 2023-11-20T07:01:05.574 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f326e66b640 1 -- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f32540664a0 msgr2=0x7f3254068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f326e66b640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f32540664a0 0x7f3254068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3258004660 tx=0x7f3258008040 comp rx=0 tx=0).stop 2023-11-20T07:01:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f326e66b640 1 -- 172.21.15.88:0/3911673148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806a270 msgr2=0x7f326814c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f326e66b640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806a270 0x7f326814c570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f325c00c7c0 tx=0x7f325c00cc80 comp rx=0 tx=0).stop 2023-11-20T07:01:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f326e66b640 1 -- 172.21.15.88:0/3911673148 shutdown_connections 2023-11-20T07:01:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f326e66b640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f32540664a0 0x7f3254068960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f326e66b640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32680702f0 0x7f3268154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f326e66b640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f326806a270 0x7f326814c570 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f326e66b640 1 --2- 172.21.15.88:0/3911673148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3268069e90 0x7f32680c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f326e66b640 1 -- 172.21.15.88:0/3911673148 >> 172.21.15.88:0/3911673148 conn(0x7f32680b0da0 msgr2=0x7f32680ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:05.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f326e66b640 1 -- 172.21.15.88:0/3911673148 shutdown_connections 2023-11-20T07:01:05.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.574+0000 7f326e66b640 1 -- 172.21.15.88:0/3911673148 wait complete. 2023-11-20T07:01:05.594 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:05.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f21902d6640 1 Processor -- start 2023-11-20T07:01:05.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f21902d6640 1 -- start start 2023-11-20T07:01:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f21902d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880d0210 0x7f21880d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f21902d6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f21880b84e0 0x7f21880b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f21902d6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21880d1670 con 0x7f218815cba0 2023-11-20T07:01:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f21902d6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21880d1460 con 0x7f21880b84e0 2023-11-20T07:01:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f21902d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21880d1950 con 0x7f21880d0210 2023-11-20T07:01:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218e072640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f218815cba0 0x7f21880cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40892/0 (socket says 172.21.15.88:40892) 2023-11-20T07:01:05.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218e072640 1 -- 172.21.15.88:0/2910556199 learned_addr learned my addr 172.21.15.88:0/2910556199 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:05.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d871640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880d0210 0x7f21880d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218e873640 1 --2- 172.21.15.88:0/2910556199 >> v2:172.21.15.175:3300/0 conn(0x7f21880b84e0 0x7f21880b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445707140 0 0) 0x7f21880d1670 con 0x7f218815cba0 2023-11-20T07:01:05.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2174003530 con 0x7f218815cba0 2023-11-20T07:01:05.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2364787612 0 0) 0x7f2174003530 con 0x7f218815cba0 2023-11-20T07:01:05.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880d0210 msgr2=0x7f21880d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:05.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880d0210 0x7f21880d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 >> v2:172.21.15.175:3300/0 conn(0x7f21880b84e0 msgr2=0x7f21880b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:05.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 --2- 172.21.15.88:0/2910556199 >> v2:172.21.15.175:3300/0 conn(0x7f21880b84e0 0x7f21880b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21880d1c30 con 0x7f218815cba0 2023-11-20T07:01:05.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f2184001680 con 0x7f218815cba0 2023-11-20T07:01:05.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 >> v1:172.21.15.88:6789/0 conn(0x7f218815cba0 legacy=0x7f21880cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2174003980 0x7f2174003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880d0210 0x7f21740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2174004d10 0x7f2174005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21880d1460 con 0x7f2174004d10 2023-11-20T07:01:05.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21880d1950 con 0x7f2174003980 2023-11-20T07:01:05.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217400b990 con 0x7f21880d0210 2023-11-20T07:01:05.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218e072640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2174003980 0x7f2174003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218e873640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2174004d10 0x7f2174005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218d871640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880d0210 0x7f21740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218e072640 1 -- 172.21.15.88:0/2910556199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880d0210 msgr2=0x7f21740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:05.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218e072640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880d0210 0x7f21740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218e072640 1 -- 172.21.15.88:0/2910556199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2174004d10 msgr2=0x7f2174005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:05.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218e072640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2174004d10 0x7f2174005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218e072640 1 -- 172.21.15.88:0/2910556199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174003530 con 0x7f2174003980 2023-11-20T07:01:05.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.734+0000 7f218e873640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2174004d10 0x7f2174005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.738+0000 7f218e072640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2174003980 0x7f2174003da0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f218400c270 tx=0x7f218401cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=655f28857f3fb751 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.738+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21840a5960 con 0x7f2174003980 2023-11-20T07:01:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.738+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21840a5ac0 con 0x7f2174003980 2023-11-20T07:01:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.738+0000 7f218d070640 1 -- 172.21.15.88:0/2910556199 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21840a5e90 con 0x7f2174003980 2023-11-20T07:01:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.738+0000 7f21902d6640 1 -- 172.21.15.88:0/2910556199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2174003980 msgr2=0x7f2174003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.738+0000 7f21902d6640 1 --2- 172.21.15.88:0/2910556199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2174003980 0x7f2174003da0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f218400c270 tx=0x7f218401cc60 comp rx=0 tx=0).stop 2023-11-20T07:01:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.738+0000 7f218e873640 1 -- 172.21.15.88:0/2910556199 reap_dead start 2023-11-20T07:01:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.738+0000 7f21902d6640 1 -- 172.21.15.88:0/2910556199 shutdown_connections 2023-11-20T07:01:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.738+0000 7f21902d6640 1 -- 172.21.15.88:0/2910556199 >> 172.21.15.88:0/2910556199 conn(0x7f21880719c0 msgr2=0x7f2188071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f21902d6640 1 -- 172.21.15.88:0/2910556199 shutdown_connections 2023-11-20T07:01:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f21902d6640 1 -- 172.21.15.88:0/2910556199 wait complete. 2023-11-20T07:01:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f21902d6640 1 Processor -- start 2023-11-20T07:01:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f21902d6640 1 -- start start 2023-11-20T07:01:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f21902d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2174003980 0x7f218815cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f21902d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2188154410 0x7f218815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f21902d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880cb270 0x7f21880cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f21902d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218815ab00 con 0x7f2188154410 2023-11-20T07:01:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f21902d6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218815d610 con 0x7f2174003980 2023-11-20T07:01:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f21902d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218815d8f0 con 0x7f21880cb270 2023-11-20T07:01:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218d871640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2188154410 0x7f218815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218d871640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2188154410 0x7f218815a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57074/0 (socket says 172.21.15.88:57074) 2023-11-20T07:01:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218d871640 1 -- 172.21.15.88:0/32969293 learned_addr learned my addr 172.21.15.88:0/32969293 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218e072640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2174003980 0x7f218815cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218e873640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880cb270 0x7f21880cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218d871640 1 -- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880cb270 msgr2=0x7f21880cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218d871640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880cb270 0x7f21880cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218d871640 1 -- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2174003980 msgr2=0x7f218815cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218d871640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2174003980 0x7f218815cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218d871640 1 -- 172.21.15.88:0/32969293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218815dbd0 con 0x7f2188154410 2023-11-20T07:01:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218e072640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2174003980 0x7f218815cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218e873640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880cb270 0x7f21880cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f218d871640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2188154410 0x7f218815a5c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f21780119d0 tx=0x7f2178011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.742+0000 7f217effd640 1 -- 172.21.15.88:0/32969293 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217800fb50 con 0x7f2188154410 2023-11-20T07:01:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.746+0000 7f217effd640 1 -- 172.21.15.88:0/32969293 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217800fcb0 con 0x7f2188154410 2023-11-20T07:01:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.746+0000 7f217effd640 1 -- 172.21.15.88:0/32969293 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2178014440 con 0x7f2188154410 2023-11-20T07:01:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.746+0000 7f21902d6640 1 -- 172.21.15.88:0/32969293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218815deb0 con 0x7f2188154410 2023-11-20T07:01:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.746+0000 7f21902d6640 1 -- 172.21.15.88:0/32969293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2188154890 con 0x7f2188154410 2023-11-20T07:01:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.746+0000 7f21902d6640 1 -- 172.21.15.88:0/32969293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218815ac40 con 0x7f2188154410 2023-11-20T07:01:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.746+0000 7f217effd640 1 -- 172.21.15.88:0/32969293 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f21780145a0 con 0x7f2188154410 2023-11-20T07:01:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.746+0000 7f217effd640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f216c0664a0 0x7f216c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.746+0000 7f217effd640 1 -- 172.21.15.88:0/32969293 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2178084ad0 con 0x7f2188154410 2023-11-20T07:01:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.746+0000 7f218e072640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f216c0664a0 0x7f216c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.750+0000 7f218e072640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f216c0664a0 0x7f216c068960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f21840aa000 tx=0x7f2184001a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.750+0000 7f217effd640 1 -- 172.21.15.88:0/32969293 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2178051c80 con 0x7f2188154410 2023-11-20T07:01:05.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 -- 172.21.15.88:0/32969293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f218804e170 con 0x7f2188154410 2023-11-20T07:01:05.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f217effd640 1 -- 172.21.15.88:0/32969293 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21780552a0 con 0x7f2188154410 2023-11-20T07:01:05.899 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:05.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 -- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f216c0664a0 msgr2=0x7f216c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f216c0664a0 0x7f216c068960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f21840aa000 tx=0x7f2184001a80 comp rx=0 tx=0).stop 2023-11-20T07:01:05.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 -- 172.21.15.88:0/32969293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2188154410 msgr2=0x7f218815a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:05.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2188154410 0x7f218815a5c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f21780119d0 tx=0x7f2178011e90 comp rx=0 tx=0).stop 2023-11-20T07:01:05.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 -- 172.21.15.88:0/32969293 shutdown_connections 2023-11-20T07:01:05.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f216c0664a0 0x7f216c068960 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21880cb270 0x7f21880cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2188154410 0x7f218815a5c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 --2- 172.21.15.88:0/32969293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2174003980 0x7f218815cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:05.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 -- 172.21.15.88:0/32969293 >> 172.21.15.88:0/32969293 conn(0x7f21880719c0 msgr2=0x7f21880d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:05.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 -- 172.21.15.88:0/32969293 shutdown_connections 2023-11-20T07:01:05.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:05.898+0000 7f21902d6640 1 -- 172.21.15.88:0/32969293 wait complete. 2023-11-20T07:01:05.919 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:06.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.058+0000 7fc7e538d640 1 Processor -- start 2023-11-20T07:01:06.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.058+0000 7fc7e538d640 1 -- start start 2023-11-20T07:01:06.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.058+0000 7fc7e538d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7e015cba0 0x7fc7e00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.058+0000 7fc7e538d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7e00b84e0 0x7fc7e00cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.058+0000 7fc7e538d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e00d1670 con 0x7fc7e00d0040 2023-11-20T07:01:06.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.058+0000 7fc7e538d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e00d1460 con 0x7fc7e015cba0 2023-11-20T07:01:06.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.058+0000 7fc7e538d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00d04b0 con 0x7fc7e00b84e0 2023-11-20T07:01:06.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.058+0000 7fc7df7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc7e00d0040 0x7fc7e00d2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35672/0 (socket says 172.21.15.88:35672) 2023-11-20T07:01:06.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.062+0000 7fc7df7fe640 1 -- 172.21.15.88:0/1713815493 learned_addr learned my addr 172.21.15.88:0/1713815493 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:06.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.062+0000 7fc7deffd640 1 --2- 172.21.15.88:0/1713815493 >> v2:172.21.15.175:3300/0 conn(0x7fc7e015cba0 0x7fc7e00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.062+0000 7fc7d67fc640 1 --2- 172.21.15.88:0/1713815493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7e00b84e0 0x7fc7e00cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.062+0000 7fc7deffd640 1 -- 172.21.15.88:0/1713815493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7e00b84e0 msgr2=0x7fc7e00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.062+0000 7fc7deffd640 1 --2- 172.21.15.88:0/1713815493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7e00b84e0 0x7fc7e00cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.062+0000 7fc7deffd640 1 -- 172.21.15.88:0/1713815493 >> v1:172.21.15.88:6789/0 conn(0x7fc7e00d0040 legacy=0x7fc7e00d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.062+0000 7fc7deffd640 1 -- 172.21.15.88:0/1713815493 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e00d1950 con 0x7fc7e015cba0 2023-11-20T07:01:06.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.062+0000 7fc7de7fc640 1 -- 172.21.15.88:0/1713815493 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996298089 0 0) 0x7fc7e00d1670 con 0x7fc7e00d0040 2023-11-20T07:01:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.062+0000 7fc7deffd640 1 --2- 172.21.15.88:0/1713815493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7e015cba0 0x7fc7e00d0f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00097c0 tx=0x7fc7d001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af3647f76c8734f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.062+0000 7fc7de7fc640 1 -- 172.21.15.88:0/1713815493 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00ac600 con 0x7fc7e015cba0 2023-11-20T07:01:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.062+0000 7fc7de7fc640 1 -- 172.21.15.88:0/1713815493 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d00a8050 con 0x7fc7e015cba0 2023-11-20T07:01:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.062+0000 7fc7de7fc640 1 -- 172.21.15.88:0/1713815493 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00ac980 con 0x7fc7e015cba0 2023-11-20T07:01:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 -- 172.21.15.88:0/1713815493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7e015cba0 msgr2=0x7fc7e00d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 --2- 172.21.15.88:0/1713815493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7e015cba0 0x7fc7e00d0f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00097c0 tx=0x7fc7d001c480 comp rx=0 tx=0).stop 2023-11-20T07:01:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 -- 172.21.15.88:0/1713815493 shutdown_connections 2023-11-20T07:01:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 --2- 172.21.15.88:0/1713815493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7e00b84e0 0x7fc7e00cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 --2- 172.21.15.88:0/1713815493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7e015cba0 0x7fc7e00d0f20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 -- 172.21.15.88:0/1713815493 >> 172.21.15.88:0/1713815493 conn(0x7fc7e00719c0 msgr2=0x7fc7e0071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 -- 172.21.15.88:0/1713815493 shutdown_connections 2023-11-20T07:01:06.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 -- 172.21.15.88:0/1713815493 wait complete. 2023-11-20T07:01:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 Processor -- start 2023-11-20T07:01:06.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 -- start start 2023-11-20T07:01:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7e00b84e0 0x7fc7e0152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e00d0040 0x7fc7e014e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7e015cba0 0x7fc7e015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00c7160 con 0x7fc7e00d0040 2023-11-20T07:01:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0152a80 con 0x7fc7e00b84e0 2023-11-20T07:01:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7e538d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0151380 con 0x7fc7e015cba0 2023-11-20T07:01:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7d67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e00d0040 0x7fc7e014e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7d67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e00d0040 0x7fc7e014e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39486/0 (socket says 172.21.15.88:39486) 2023-11-20T07:01:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7d67fc640 1 -- 172.21.15.88:0/670256417 learned_addr learned my addr 172.21.15.88:0/670256417 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7df7fe640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7e015cba0 0x7fc7e015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7deffd640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7e00b84e0 0x7fc7e0152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7d67fc640 1 -- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7e015cba0 msgr2=0x7fc7e015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7d67fc640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7e015cba0 0x7fc7e015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7d67fc640 1 -- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7e00b84e0 msgr2=0x7fc7e0152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7d67fc640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7e00b84e0 0x7fc7e0152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7d67fc640 1 -- 172.21.15.88:0/670256417 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d0009420 con 0x7fc7e00d0040 2023-11-20T07:01:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.066+0000 7fc7d67fc640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e00d0040 0x7fc7e014e530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800e960 tx=0x7fc7c800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:06.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.070+0000 7fc7d7fff640 1 -- 172.21.15.88:0/670256417 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8009690 con 0x7fc7e00d0040 2023-11-20T07:01:06.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.070+0000 7fc7d7fff640 1 -- 172.21.15.88:0/670256417 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c800ca00 con 0x7fc7e00d0040 2023-11-20T07:01:06.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.070+0000 7fc7d7fff640 1 -- 172.21.15.88:0/670256417 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c800cd70 con 0x7fc7e00d0040 2023-11-20T07:01:06.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.070+0000 7fc7e538d640 1 -- 172.21.15.88:0/670256417 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e0151620 con 0x7fc7e00d0040 2023-11-20T07:01:06.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.070+0000 7fc7e538d640 1 -- 172.21.15.88:0/670256417 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e00c6df0 con 0x7fc7e00d0040 2023-11-20T07:01:06.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.070+0000 7fc7e538d640 1 -- 172.21.15.88:0/670256417 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e00c7310 con 0x7fc7e00d0040 2023-11-20T07:01:06.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.070+0000 7fc7d7fff640 1 -- 172.21.15.88:0/670256417 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc7c8013470 con 0x7fc7e00d0040 2023-11-20T07:01:06.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.070+0000 7fc7d7fff640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc7c40664a0 0x7fc7c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.070+0000 7fc7d7fff640 1 -- 172.21.15.88:0/670256417 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc7c80843d0 con 0x7fc7e00d0040 2023-11-20T07:01:06.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.070+0000 7fc7deffd640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc7c40664a0 0x7fc7c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.074+0000 7fc7deffd640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc7c40664a0 0x7fc7c4068960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00ae000 tx=0x7fc7d00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:06.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.074+0000 7fc7d7fff640 1 -- 172.21.15.88:0/670256417 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc7e00c7310 con 0x7fc7e00d0040 2023-11-20T07:01:06.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 -- 172.21.15.88:0/670256417 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7e00c7310 con 0x7fc7e00d0040 2023-11-20T07:01:06.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7d7fff640 1 -- 172.21.15.88:0/670256417 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc7e00c7310 con 0x7fc7e00d0040 2023-11-20T07:01:06.226 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:06.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 -- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc7c40664a0 msgr2=0x7fc7c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc7c40664a0 0x7fc7c4068960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00ae000 tx=0x7fc7d00a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:06.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 -- 172.21.15.88:0/670256417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e00d0040 msgr2=0x7fc7e014e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e00d0040 0x7fc7e014e530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800e960 tx=0x7fc7c800ee20 comp rx=0 tx=0).stop 2023-11-20T07:01:06.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 -- 172.21.15.88:0/670256417 shutdown_connections 2023-11-20T07:01:06.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc7c40664a0 0x7fc7c4068960 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7e015cba0 0x7fc7e015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e00d0040 0x7fc7e014e530 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 --2- 172.21.15.88:0/670256417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7e00b84e0 0x7fc7e0152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 -- 172.21.15.88:0/670256417 >> 172.21.15.88:0/670256417 conn(0x7fc7e00719c0 msgr2=0x7fc7e00b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:06.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 -- 172.21.15.88:0/670256417 shutdown_connections 2023-11-20T07:01:06.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.226+0000 7fc7e538d640 1 -- 172.21.15.88:0/670256417 wait complete. 2023-11-20T07:01:06.246 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:06.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.390+0000 7fdefe29c640 1 Processor -- start 2023-11-20T07:01:06.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.390+0000 7fdefe29c640 1 -- start start 2023-11-20T07:01:06.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.390+0000 7fdefe29c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdef8069e90 0x7fdef806d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.390+0000 7fdefe29c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdef806a270 0x7fdef80c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.390+0000 7fdefe29c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef815ae30 con 0x7fdef80702f0 2023-11-20T07:01:06.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.394+0000 7fdefe29c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef80cb090 con 0x7fdef8069e90 2023-11-20T07:01:06.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.394+0000 7fdefe29c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80ca510 con 0x7fdef806a270 2023-11-20T07:01:06.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.394+0000 7fdef7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdef8069e90 0x7fdef806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.394+0000 7fdefc839640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdef80702f0 0x7fdef8070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35686/0 (socket says 172.21.15.88:35686) 2023-11-20T07:01:06.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.394+0000 7fdef7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdef8069e90 0x7fdef806d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39492/0 (socket says 172.21.15.88:39492) 2023-11-20T07:01:06.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.394+0000 7fdefc839640 1 -- 172.21.15.88:0/1371602648 learned_addr learned my addr 172.21.15.88:0/1371602648 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:06.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.394+0000 7fdef77fe640 1 --2- 172.21.15.88:0/1371602648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdef806a270 0x7fdef80c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.394+0000 7fdef7fff640 1 -- 172.21.15.88:0/1371602648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdef806a270 msgr2=0x7fdef80c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:06.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.394+0000 7fdef7fff640 1 --2- 172.21.15.88:0/1371602648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdef806a270 0x7fdef80c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.394+0000 7fdef7fff640 1 -- 172.21.15.88:0/1371602648 >> v1:172.21.15.88:6789/0 conn(0x7fdef80702f0 legacy=0x7fdef8070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.394+0000 7fdef7fff640 1 -- 172.21.15.88:0/1371602648 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef80ca7f0 con 0x7fdef8069e90 2023-11-20T07:01:06.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.394+0000 7fdef7fff640 1 --2- 172.21.15.88:0/1371602648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdef8069e90 0x7fdef806d010 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdee80097c0 tx=0x7fdee801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996d098f256b9ae7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:06.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdef6ffd640 1 -- 172.21.15.88:0/1371602648 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee80ab650 con 0x7fdef8069e90 2023-11-20T07:01:06.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdef6ffd640 1 -- 172.21.15.88:0/1371602648 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee80ab7b0 con 0x7fdef8069e90 2023-11-20T07:01:06.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdef6ffd640 1 -- 172.21.15.88:0/1371602648 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee80abb40 con 0x7fdef8069e90 2023-11-20T07:01:06.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 -- 172.21.15.88:0/1371602648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdef8069e90 msgr2=0x7fdef806d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 --2- 172.21.15.88:0/1371602648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdef8069e90 0x7fdef806d010 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdee80097c0 tx=0x7fdee801c450 comp rx=0 tx=0).stop 2023-11-20T07:01:06.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 -- 172.21.15.88:0/1371602648 shutdown_connections 2023-11-20T07:01:06.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 --2- 172.21.15.88:0/1371602648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdef806a270 0x7fdef80c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 --2- 172.21.15.88:0/1371602648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdef8069e90 0x7fdef806d010 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 -- 172.21.15.88:0/1371602648 >> 172.21.15.88:0/1371602648 conn(0x7fdef80b0da0 msgr2=0x7fdef80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:06.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 -- 172.21.15.88:0/1371602648 shutdown_connections 2023-11-20T07:01:06.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 -- 172.21.15.88:0/1371602648 wait complete. 2023-11-20T07:01:06.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 Processor -- start 2023-11-20T07:01:06.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 -- start start 2023-11-20T07:01:06.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdef8069e90 0x7fdef80ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdef806a270 0x7fdef80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdef80702f0 0x7fdef815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef80ac060 con 0x7fdef80702f0 2023-11-20T07:01:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef815d3b0 con 0x7fdef8069e90 2023-11-20T07:01:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.398+0000 7fdefe29c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef815d0d0 con 0x7fdef806a270 2023-11-20T07:01:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdefc839640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdef80702f0 0x7fdef815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdefc839640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdef80702f0 0x7fdef815c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39500/0 (socket says 172.21.15.88:39500) 2023-11-20T07:01:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdefc839640 1 -- 172.21.15.88:0/401850537 learned_addr learned my addr 172.21.15.88:0/401850537 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdef77fe640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdef806a270 0x7fdef80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdef7fff640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdef8069e90 0x7fdef80ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdefc839640 1 -- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdef806a270 msgr2=0x7fdef80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdefc839640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdef806a270 0x7fdef80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdefc839640 1 -- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdef8069e90 msgr2=0x7fdef80ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdefc839640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdef8069e90 0x7fdef80ac480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdefc839640 1 -- 172.21.15.88:0/401850537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee8009420 con 0x7fdef80702f0 2023-11-20T07:01:06.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdefc839640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdef80702f0 0x7fdef815c580 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdef000ca80 tx=0x7fdef000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:06.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdef4ff9640 1 -- 172.21.15.88:0/401850537 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef000ac30 con 0x7fdef80702f0 2023-11-20T07:01:06.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdef4ff9640 1 -- 172.21.15.88:0/401850537 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef000ad90 con 0x7fdef80702f0 2023-11-20T07:01:06.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdef4ff9640 1 -- 172.21.15.88:0/401850537 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0012600 con 0x7fdef80702f0 2023-11-20T07:01:06.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdefe29c640 1 -- 172.21.15.88:0/401850537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef80ab9a0 con 0x7fdef80702f0 2023-11-20T07:01:06.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdefe29c640 1 -- 172.21.15.88:0/401850537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef80cbc30 con 0x7fdef80702f0 2023-11-20T07:01:06.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdefe29c640 1 -- 172.21.15.88:0/401850537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef80ac1a0 con 0x7fdef80702f0 2023-11-20T07:01:06.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.402+0000 7fdef4ff9640 1 -- 172.21.15.88:0/401850537 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdef0007070 con 0x7fdef80702f0 2023-11-20T07:01:06.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.406+0000 7fdef4ff9640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdee40664d0 0x7fdee4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.406+0000 7fdef4ff9640 1 -- 172.21.15.88:0/401850537 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdef0083e40 con 0x7fdef80702f0 2023-11-20T07:01:06.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.406+0000 7fdef7fff640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdee40664d0 0x7fdee4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.406+0000 7fdef7fff640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdee40664d0 0x7fdee4068990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdee80af000 tx=0x7fdee80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.410+0000 7fdef4ff9640 1 -- 172.21.15.88:0/401850537 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdef80ac1a0 con 0x7fdef80702f0 2023-11-20T07:01:06.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.558+0000 7fdefe29c640 1 -- 172.21.15.88:0/401850537 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdef80ac1a0 con 0x7fdef80702f0 2023-11-20T07:01:06.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.558+0000 7fdef4ff9640 1 -- 172.21.15.88:0/401850537 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdef80ac1a0 con 0x7fdef80702f0 2023-11-20T07:01:06.561 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.562+0000 7fdefe29c640 1 -- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdee40664d0 msgr2=0x7fdee4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.562+0000 7fdefe29c640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdee40664d0 0x7fdee4068990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdee80af000 tx=0x7fdee80a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.562+0000 7fdefe29c640 1 -- 172.21.15.88:0/401850537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdef80702f0 msgr2=0x7fdef815c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.562+0000 7fdefe29c640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdef80702f0 0x7fdef815c580 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdef000ca80 tx=0x7fdef000cf40 comp rx=0 tx=0).stop 2023-11-20T07:01:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.562+0000 7fdefe29c640 1 -- 172.21.15.88:0/401850537 shutdown_connections 2023-11-20T07:01:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.562+0000 7fdefe29c640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdee40664d0 0x7fdee4068990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.562+0000 7fdefe29c640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdef806a270 0x7fdef80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.562+0000 7fdefe29c640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdef80702f0 0x7fdef815c580 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.562+0000 7fdefe29c640 1 --2- 172.21.15.88:0/401850537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdef8069e90 0x7fdef80ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.562+0000 7fdefe29c640 1 -- 172.21.15.88:0/401850537 >> 172.21.15.88:0/401850537 conn(0x7fdef80b0da0 msgr2=0x7fdef80af120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.562+0000 7fdefe29c640 1 -- 172.21.15.88:0/401850537 shutdown_connections 2023-11-20T07:01:06.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.562+0000 7fdefe29c640 1 -- 172.21.15.88:0/401850537 wait complete. 2023-11-20T07:01:06.582 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T07:01:06.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.718+0000 7f524bb3e640 1 Processor -- start 2023-11-20T07:01:06.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.718+0000 7f524bb3e640 1 -- start start 2023-11-20T07:01:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.718+0000 7f524bb3e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52440ad960 0x7f52440ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f524bb3e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52440c96f0 con 0x7f52440b07f0 2023-11-20T07:01:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f524bb3e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52440cb950 con 0x7f5244164520 2023-11-20T07:01:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f524bb3e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5244164900 con 0x7f52440ad960 2023-11-20T07:01:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f52490d9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f52440ad960 0x7f52440ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f524a0db640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f52440b07f0 0x7f52440cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35688/0 (socket says 172.21.15.88:35688) 2023-11-20T07:01:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f524a0db640 1 -- 172.21.15.88:0/2924662661 learned_addr learned my addr 172.21.15.88:0/2924662661 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f52490d9640 1 -- 172.21.15.88:0/2924662661 >> v1:172.21.15.175:6789/0 conn(0x7f5244164520 legacy=0x7f52440b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f52490d9640 1 -- 172.21.15.88:0/2924662661 >> v1:172.21.15.88:6789/0 conn(0x7f52440b07f0 legacy=0x7f52440cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f52490d9640 1 -- 172.21.15.88:0/2924662661 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52440cbed0 con 0x7f52440ad960 2023-11-20T07:01:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f52488d8640 1 -- 172.21.15.88:0/2924662661 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847739825 0 0) 0x7f52440c96f0 con 0x7f52440b07f0 2023-11-20T07:01:06.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f52490d9640 1 --2- 172.21.15.88:0/2924662661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440ad960 0x7f52440ce010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f52340097c0 tx=0x7f523401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db06b3e5be0223a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:06.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f52488d8640 1 -- 172.21.15.88:0/2924662661 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340a7070 con 0x7f52440ad960 2023-11-20T07:01:06.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f52488d8640 1 -- 172.21.15.88:0/2924662661 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52340ab430 con 0x7f52440ad960 2023-11-20T07:01:06.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.722+0000 7f52488d8640 1 -- 172.21.15.88:0/2924662661 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340ab7c0 con 0x7f52440ad960 2023-11-20T07:01:06.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 -- 172.21.15.88:0/2924662661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440ad960 msgr2=0x7f52440ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 --2- 172.21.15.88:0/2924662661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440ad960 0x7f52440ce010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f52340097c0 tx=0x7f523401c410 comp rx=0 tx=0).stop 2023-11-20T07:01:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 -- 172.21.15.88:0/2924662661 shutdown_connections 2023-11-20T07:01:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 --2- 172.21.15.88:0/2924662661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440ad960 0x7f52440ce010 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 -- 172.21.15.88:0/2924662661 >> 172.21.15.88:0/2924662661 conn(0x7f524406c190 msgr2=0x7f524406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 -- 172.21.15.88:0/2924662661 shutdown_connections 2023-11-20T07:01:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 -- 172.21.15.88:0/2924662661 wait complete. 2023-11-20T07:01:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 Processor -- start 2023-11-20T07:01:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 -- start start 2023-11-20T07:01:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52440ad960 0x7f52440b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440b07f0 0x7f52440c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5244164520 0x7f524415a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440c3760 con 0x7f52440b07f0 2023-11-20T07:01:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440c3a40 con 0x7f5244164520 2023-11-20T07:01:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524bb3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52440c3d20 con 0x7f52440ad960 2023-11-20T07:01:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f52490d9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440b07f0 0x7f52440c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f52490d9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440b07f0 0x7f52440c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39522/0 (socket says 172.21.15.88:39522) 2023-11-20T07:01:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f52490d9640 1 -- 172.21.15.88:0/1595701279 learned_addr learned my addr 172.21.15.88:0/1595701279 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f52498da640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52440ad960 0x7f52440b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.726+0000 7f524a0db640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5244164520 0x7f524415a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f52490d9640 1 -- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52440ad960 msgr2=0x7f52440b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f52490d9640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52440ad960 0x7f52440b26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f52490d9640 1 -- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5244164520 msgr2=0x7f524415a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f52490d9640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5244164520 0x7f524415a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f52490d9640 1 -- 172.21.15.88:0/1595701279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5234009420 con 0x7f52440b07f0 2023-11-20T07:01:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f52498da640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52440ad960 0x7f52440b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f524a0db640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5244164520 0x7f524415a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f52490d9640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440b07f0 0x7f52440c4800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f52340ad040 tx=0x7f52340191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f523a7fc640 1 -- 172.21.15.88:0/1595701279 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340b4800 con 0x7f52440b07f0 2023-11-20T07:01:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f523a7fc640 1 -- 172.21.15.88:0/1595701279 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52340b4980 con 0x7f52440b07f0 2023-11-20T07:01:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f523a7fc640 1 -- 172.21.15.88:0/1595701279 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340b4d30 con 0x7f52440b07f0 2023-11-20T07:01:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f524bb3e640 1 -- 172.21.15.88:0/1595701279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52440c4000 con 0x7f52440b07f0 2023-11-20T07:01:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f524bb3e640 1 -- 172.21.15.88:0/1595701279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52440b2be0 con 0x7f52440b07f0 2023-11-20T07:01:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f524bb3e640 1 -- 172.21.15.88:0/1595701279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5244074010 con 0x7f52440b07f0 2023-11-20T07:01:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f523a7fc640 1 -- 172.21.15.88:0/1595701279 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f52340c2460 con 0x7f52440b07f0 2023-11-20T07:01:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f523a7fc640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f52280664a0 0x7f5228068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.730+0000 7f523a7fc640 1 -- 172.21.15.88:0/1595701279 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f523411e5b0 con 0x7f52440b07f0 2023-11-20T07:01:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.734+0000 7f52498da640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f52280664a0 0x7f5228068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:06.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.734+0000 7f52498da640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f52280664a0 0x7f5228068960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52400098b0 tx=0x7f5240008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.734+0000 7f523a7fc640 1 -- 172.21.15.88:0/1595701279 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f52340eb7d0 con 0x7f52440b07f0 2023-11-20T07:01:06.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.894+0000 7f524bb3e640 1 -- 172.21.15.88:0/1595701279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5244074010 con 0x7f52440b07f0 2023-11-20T07:01:06.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.894+0000 7f523a7fc640 1 -- 172.21.15.88:0/1595701279 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f52340eedf0 con 0x7f52440b07f0 2023-11-20T07:01:06.896 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-20T07:01:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.898+0000 7f524bb3e640 1 -- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f52280664a0 msgr2=0x7f5228068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.898+0000 7f524bb3e640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f52280664a0 0x7f5228068960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52400098b0 tx=0x7f5240008040 comp rx=0 tx=0).stop 2023-11-20T07:01:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.898+0000 7f524bb3e640 1 -- 172.21.15.88:0/1595701279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440b07f0 msgr2=0x7f52440c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.898+0000 7f524bb3e640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440b07f0 0x7f52440c4800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f52340ad040 tx=0x7f52340191b0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.898+0000 7f524bb3e640 1 -- 172.21.15.88:0/1595701279 shutdown_connections 2023-11-20T07:01:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.898+0000 7f524bb3e640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f52280664a0 0x7f5228068960 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.898+0000 7f524bb3e640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5244164520 0x7f524415a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.898+0000 7f524bb3e640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f52440b07f0 0x7f52440c4800 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.898+0000 7f524bb3e640 1 --2- 172.21.15.88:0/1595701279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52440ad960 0x7f52440b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.898+0000 7f524bb3e640 1 -- 172.21.15.88:0/1595701279 >> 172.21.15.88:0/1595701279 conn(0x7f524406c190 msgr2=0x7f5244160c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.898+0000 7f524bb3e640 1 -- 172.21.15.88:0/1595701279 shutdown_connections 2023-11-20T07:01:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:06.898+0000 7f524bb3e640 1 -- 172.21.15.88:0/1595701279 wait complete. 2023-11-20T07:01:06.916 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:01:06.917 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:06.927 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:07.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.102+0000 7efd4e7d3640 1 Processor -- start 2023-11-20T07:01:07.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.102+0000 7efd4e7d3640 1 -- start start 2023-11-20T07:01:07.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd4e7d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4815ca70 0x7efd480d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd4e7d3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd480cf7a0 0x7efd480c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd4e7d3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd480c65f0 con 0x7efd480d3550 2023-11-20T07:01:07.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd4e7d3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd480ce820 con 0x7efd480cf7a0 2023-11-20T07:01:07.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd4e7d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd480cdf80 con 0x7efd4815ca70 2023-11-20T07:01:07.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd47fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4815ca70 0x7efd480d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd4cd70640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd480cf7a0 0x7efd480c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd47fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4815ca70 0x7efd480d3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:59060/0 (socket says 172.21.15.88:59060) 2023-11-20T07:01:07.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd47fff640 1 -- 172.21.15.88:0/1062993097 learned_addr learned my addr 172.21.15.88:0/1062993097 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:07.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd4cd70640 1 -- 172.21.15.88:0/1062993097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4815ca70 msgr2=0x7efd480d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd4cd70640 1 --2- 172.21.15.88:0/1062993097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4815ca70 0x7efd480d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd4cd70640 1 -- 172.21.15.88:0/1062993097 >> v1:172.21.15.175:6789/0 conn(0x7efd480d3550 legacy=0x7efd480cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd4cd70640 1 -- 172.21.15.88:0/1062993097 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd480ce260 con 0x7efd480cf7a0 2023-11-20T07:01:07.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.106+0000 7efd47fff640 1 --2- 172.21.15.88:0/1062993097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4815ca70 0x7efd480d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:07.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd4cd70640 1 --2- 172.21.15.88:0/1062993097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd480cf7a0 0x7efd480c6ad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efd40009d90 tx=0x7efd4001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b98851ca63450f89 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:07.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd46ffd640 1 -- 172.21.15.88:0/1062993097 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400a5940 con 0x7efd480cf7a0 2023-11-20T07:01:07.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd46ffd640 1 -- 172.21.15.88:0/1062993097 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd400a5aa0 con 0x7efd480cf7a0 2023-11-20T07:01:07.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd46ffd640 1 -- 172.21.15.88:0/1062993097 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400a5e30 con 0x7efd480cf7a0 2023-11-20T07:01:07.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd4e7d3640 1 -- 172.21.15.88:0/1062993097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd480cf7a0 msgr2=0x7efd480c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd4e7d3640 1 --2- 172.21.15.88:0/1062993097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd480cf7a0 0x7efd480c6ad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efd40009d90 tx=0x7efd4001c920 comp rx=0 tx=0).stop 2023-11-20T07:01:07.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd4e7d3640 1 -- 172.21.15.88:0/1062993097 shutdown_connections 2023-11-20T07:01:07.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd4e7d3640 1 --2- 172.21.15.88:0/1062993097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd480cf7a0 0x7efd480c6ad0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd4e7d3640 1 --2- 172.21.15.88:0/1062993097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4815ca70 0x7efd480d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd4e7d3640 1 -- 172.21.15.88:0/1062993097 >> 172.21.15.88:0/1062993097 conn(0x7efd4809bc50 msgr2=0x7efd480d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:07.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd4e7d3640 1 -- 172.21.15.88:0/1062993097 shutdown_connections 2023-11-20T07:01:07.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd4e7d3640 1 -- 172.21.15.88:0/1062993097 wait complete. 2023-11-20T07:01:07.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd4e7d3640 1 Processor -- start 2023-11-20T07:01:07.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.110+0000 7efd4e7d3640 1 -- start start 2023-11-20T07:01:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4e7d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd480cf7a0 0x7efd481552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4e7d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd480d3550 0x7efd481559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4e7d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd4815ca70 0x7efd4814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4e7d3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd48154ea0 con 0x7efd4815ca70 2023-11-20T07:01:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4e7d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481504c0 con 0x7efd480d3550 2023-11-20T07:01:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4e7d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd48150eb0 con 0x7efd480cf7a0 2023-11-20T07:01:07.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4cd70640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd4815ca70 0x7efd4814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4cd70640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd4815ca70 0x7efd4814ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39534/0 (socket says 172.21.15.88:39534) 2023-11-20T07:01:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4cd70640 1 -- 172.21.15.88:0/4233348907 learned_addr learned my addr 172.21.15.88:0/4233348907 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd47fff640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd480cf7a0 0x7efd481552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd477fe640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd480d3550 0x7efd481559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4cd70640 1 -- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd480cf7a0 msgr2=0x7efd481552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4cd70640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd480cf7a0 0x7efd481552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4cd70640 1 -- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd480d3550 msgr2=0x7efd481559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4cd70640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd480d3550 0x7efd481559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4cd70640 1 -- 172.21.15.88:0/4233348907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd38009480 con 0x7efd4815ca70 2023-11-20T07:01:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd477fe640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd480d3550 0x7efd481559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:07.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4cd70640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd4815ca70 0x7efd4814ff80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efd4001afd0 tx=0x7efd400196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:07.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd44ff9640 1 -- 172.21.15.88:0/4233348907 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400add90 con 0x7efd4815ca70 2023-11-20T07:01:07.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd44ff9640 1 -- 172.21.15.88:0/4233348907 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd40009450 con 0x7efd4815ca70 2023-11-20T07:01:07.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4e7d3640 1 -- 172.21.15.88:0/4233348907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd40009a70 con 0x7efd4815ca70 2023-11-20T07:01:07.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd44ff9640 1 -- 172.21.15.88:0/4233348907 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400b9670 con 0x7efd4815ca70 2023-11-20T07:01:07.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4e7d3640 1 -- 172.21.15.88:0/4233348907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd48151470 con 0x7efd4815ca70 2023-11-20T07:01:07.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.114+0000 7efd4e7d3640 1 -- 172.21.15.88:0/4233348907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd48154fe0 con 0x7efd4815ca70 2023-11-20T07:01:07.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.118+0000 7efd44ff9640 1 -- 172.21.15.88:0/4233348907 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efd400b97d0 con 0x7efd4815ca70 2023-11-20T07:01:07.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.118+0000 7efd44ff9640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efd340664a0 0x7efd34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.118+0000 7efd44ff9640 1 -- 172.21.15.88:0/4233348907 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd4011f9f0 con 0x7efd4815ca70 2023-11-20T07:01:07.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.118+0000 7efd47fff640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efd340664a0 0x7efd34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.118+0000 7efd47fff640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efd340664a0 0x7efd34068960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efd38006fd0 tx=0x7efd38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:07.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.122+0000 7efd44ff9640 1 -- 172.21.15.88:0/4233348907 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efd48154fe0 con 0x7efd4815ca70 2023-11-20T07:01:07.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.270+0000 7efd4e7d3640 1 -- 172.21.15.88:0/4233348907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd48154fe0 con 0x7efd4815ca70 2023-11-20T07:01:07.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd44ff9640 1 -- 172.21.15.88:0/4233348907 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7efd48154fe0 con 0x7efd4815ca70 2023-11-20T07:01:07.273 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:07.273 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:07.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd4e7d3640 1 -- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efd340664a0 msgr2=0x7efd34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd4e7d3640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efd340664a0 0x7efd34068960 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efd38006fd0 tx=0x7efd38008040 comp rx=0 tx=0).stop 2023-11-20T07:01:07.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd4e7d3640 1 -- 172.21.15.88:0/4233348907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd4815ca70 msgr2=0x7efd4814ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd4e7d3640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd4815ca70 0x7efd4814ff80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efd4001afd0 tx=0x7efd400196c0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd4e7d3640 1 -- 172.21.15.88:0/4233348907 shutdown_connections 2023-11-20T07:01:07.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd4e7d3640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efd340664a0 0x7efd34068960 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd4e7d3640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd4815ca70 0x7efd4814ff80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd4e7d3640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd480d3550 0x7efd481559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd4e7d3640 1 --2- 172.21.15.88:0/4233348907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd480cf7a0 0x7efd481552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd4e7d3640 1 -- 172.21.15.88:0/4233348907 >> 172.21.15.88:0/4233348907 conn(0x7efd4809bc50 msgr2=0x7efd4806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:07.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd4e7d3640 1 -- 172.21.15.88:0/4233348907 shutdown_connections 2023-11-20T07:01:07.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.274+0000 7efd4e7d3640 1 -- 172.21.15.88:0/4233348907 wait complete. 2023-11-20T07:01:07.294 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:07.295 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:07.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.434+0000 7f9d28da1640 1 Processor -- start 2023-11-20T07:01:07.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.434+0000 7f9d28da1640 1 -- start start 2023-11-20T07:01:07.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d28da1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d240ceda0 0x7f9d24167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d28da1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d240cc330 con 0x7f9d2415cc60 2023-11-20T07:01:07.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d28da1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d240cb4d0 con 0x7f9d240cb040 2023-11-20T07:01:07.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d28da1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d240cb720 con 0x7f9d240ceda0 2023-11-20T07:01:07.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d2259c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9d2415cc60 0x7f9d24161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35700/0 (socket says 172.21.15.88:35700) 2023-11-20T07:01:07.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d2259c640 1 -- 172.21.15.88:0/2791491630 learned_addr learned my addr 172.21.15.88:0/2791491630 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:07.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d22d9d640 1 --2- 172.21.15.88:0/2791491630 >> v2:172.21.15.175:3300/0 conn(0x7f9d240ceda0 0x7f9d24167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d21d9b640 1 -- 172.21.15.88:0/2791491630 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017169575 0 0) 0x7f9d240cc330 con 0x7f9d2415cc60 2023-11-20T07:01:07.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d21d9b640 1 -- 172.21.15.88:0/2791491630 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d10003530 con 0x7f9d2415cc60 2023-11-20T07:01:07.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d22d9d640 1 -- 172.21.15.88:0/2791491630 >> v1:172.21.15.175:6789/0 conn(0x7f9d240cb040 legacy=0x7f9d240ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d21d9b640 1 -- 172.21.15.88:0/2791491630 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 515005114 0 0) 0x7f9d10003530 con 0x7f9d2415cc60 2023-11-20T07:01:07.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d22d9d640 1 -- 172.21.15.88:0/2791491630 >> v1:172.21.15.88:6789/0 conn(0x7f9d2415cc60 legacy=0x7f9d24161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.438+0000 7f9d22d9d640 1 -- 172.21.15.88:0/2791491630 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d240cba00 con 0x7f9d240ceda0 2023-11-20T07:01:07.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d22d9d640 1 --2- 172.21.15.88:0/2791491630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d240ceda0 0x7f9d24167be0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009d90 tx=0x7f9d1c01c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20bc266cbe0d45bd server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d21d9b640 1 -- 172.21.15.88:0/2791491630 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c001680 con 0x7f9d240ceda0 2023-11-20T07:01:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d21d9b640 1 -- 172.21.15.88:0/2791491630 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c0a5680 con 0x7f9d240ceda0 2023-11-20T07:01:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d21d9b640 1 -- 172.21.15.88:0/2791491630 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0a5a10 con 0x7f9d240ceda0 2023-11-20T07:01:07.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d28da1640 1 -- 172.21.15.88:0/2791491630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d240ceda0 msgr2=0x7f9d24167be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d28da1640 1 --2- 172.21.15.88:0/2791491630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d240ceda0 0x7f9d24167be0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009d90 tx=0x7f9d1c01c840 comp rx=0 tx=0).stop 2023-11-20T07:01:07.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d28da1640 1 -- 172.21.15.88:0/2791491630 shutdown_connections 2023-11-20T07:01:07.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d28da1640 1 --2- 172.21.15.88:0/2791491630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d240ceda0 0x7f9d24167be0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d28da1640 1 -- 172.21.15.88:0/2791491630 >> 172.21.15.88:0/2791491630 conn(0x7f9d2406e570 msgr2=0x7f9d2406e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:07.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d28da1640 1 -- 172.21.15.88:0/2791491630 shutdown_connections 2023-11-20T07:01:07.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d28da1640 1 -- 172.21.15.88:0/2791491630 wait complete. 2023-11-20T07:01:07.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d28da1640 1 Processor -- start 2023-11-20T07:01:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.442+0000 7f9d28da1640 1 -- start start 2023-11-20T07:01:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d28da1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d240cb040 0x7f9d24156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d28da1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d240ceda0 0x7f9d240afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d28da1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d2415cc60 0x7f9d240b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d28da1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240c89d0 con 0x7f9d240ceda0 2023-11-20T07:01:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d28da1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240c5fe0 con 0x7f9d240cb040 2023-11-20T07:01:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d28da1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240c62c0 con 0x7f9d2415cc60 2023-11-20T07:01:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d19d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d240ceda0 0x7f9d240afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d19d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d240ceda0 0x7f9d240afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39538/0 (socket says 172.21.15.88:39538) 2023-11-20T07:01:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d19d9b640 1 -- 172.21.15.88:0/957876294 learned_addr learned my addr 172.21.15.88:0/957876294 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d22d9d640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d2415cc60 0x7f9d240b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d2259c640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d240cb040 0x7f9d24156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d19d9b640 1 -- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d2415cc60 msgr2=0x7f9d240b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d19d9b640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d2415cc60 0x7f9d240b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d19d9b640 1 -- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d240cb040 msgr2=0x7f9d24156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d19d9b640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d240cb040 0x7f9d24156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d19d9b640 1 -- 172.21.15.88:0/957876294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c009a70 con 0x7f9d240ceda0 2023-11-20T07:01:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d2259c640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d240cb040 0x7f9d24156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:07.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d19d9b640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d240ceda0 0x7f9d240afae0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400c500 tx=0x7f9d1400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:07.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d1b7fe640 1 -- 172.21.15.88:0/957876294 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14005220 con 0x7f9d240ceda0 2023-11-20T07:01:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d1b7fe640 1 -- 172.21.15.88:0/957876294 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d14005380 con 0x7f9d240ceda0 2023-11-20T07:01:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d28da1640 1 -- 172.21.15.88:0/957876294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d240c65a0 con 0x7f9d240ceda0 2023-11-20T07:01:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d1b7fe640 1 -- 172.21.15.88:0/957876294 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14007270 con 0x7f9d240ceda0 2023-11-20T07:01:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d28da1640 1 -- 172.21.15.88:0/957876294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d240b30a0 con 0x7f9d240ceda0 2023-11-20T07:01:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d28da1640 1 -- 172.21.15.88:0/957876294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2404e170 con 0x7f9d240ceda0 2023-11-20T07:01:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.446+0000 7f9d1b7fe640 1 -- 172.21.15.88:0/957876294 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9d140073d0 con 0x7f9d240ceda0 2023-11-20T07:01:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.450+0000 7f9d1b7fe640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9d040664a0 0x7f9d04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.450+0000 7f9d1b7fe640 1 -- 172.21.15.88:0/957876294 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d14083af0 con 0x7f9d240ceda0 2023-11-20T07:01:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.450+0000 7f9d2259c640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9d040664a0 0x7f9d04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.450+0000 7f9d2259c640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9d040664a0 0x7f9d04068960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0017b0 tx=0x7f9d0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:07.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.454+0000 7f9d1b7fe640 1 -- 172.21.15.88:0/957876294 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9d14050bf0 con 0x7f9d240ceda0 2023-11-20T07:01:07.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 -- 172.21.15.88:0/957876294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d240b6830 con 0x7f9d240ceda0 2023-11-20T07:01:07.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d1b7fe640 1 -- 172.21.15.88:0/957876294 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d14054210 con 0x7f9d240ceda0 2023-11-20T07:01:07.606 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:07.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 -- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9d040664a0 msgr2=0x7f9d04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9d040664a0 0x7f9d04068960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c0017b0 tx=0x7f9d0c009040 comp rx=0 tx=0).stop 2023-11-20T07:01:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 -- 172.21.15.88:0/957876294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d240ceda0 msgr2=0x7f9d240afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d240ceda0 0x7f9d240afae0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400c500 tx=0x7f9d1400c9c0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 -- 172.21.15.88:0/957876294 shutdown_connections 2023-11-20T07:01:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9d040664a0 0x7f9d04068960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d2415cc60 0x7f9d240b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d240ceda0 0x7f9d240afae0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 --2- 172.21.15.88:0/957876294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d240cb040 0x7f9d24156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 -- 172.21.15.88:0/957876294 >> 172.21.15.88:0/957876294 conn(0x7f9d2406e570 msgr2=0x7f9d2415d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 -- 172.21.15.88:0/957876294 shutdown_connections 2023-11-20T07:01:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.606+0000 7f9d28da1640 1 -- 172.21.15.88:0/957876294 wait complete. 2023-11-20T07:01:07.627 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:07.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5498aea640 1 Processor -- start 2023-11-20T07:01:07.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5498aea640 1 -- start start 2023-11-20T07:01:07.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5498aea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54940d0210 0x7f54940d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5498aea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54940b84e0 0x7f54940b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5498aea640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54940d1670 con 0x7f549415cba0 2023-11-20T07:01:07.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5498aea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54940d1460 con 0x7f54940b84e0 2023-11-20T07:01:07.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5498aea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54940d1950 con 0x7f54940d0210 2023-11-20T07:01:07.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5492d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54940b84e0 0x7f54940b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5492d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54940b84e0 0x7f54940b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39546/0 (socket says 172.21.15.88:39546) 2023-11-20T07:01:07.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5492d9d640 1 -- 172.21.15.88:0/2002921970 learned_addr learned my addr 172.21.15.88:0/2002921970 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:07.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5489d9b640 1 --2- 172.21.15.88:0/2002921970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54940d0210 0x7f54940d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5492d9d640 1 -- 172.21.15.88:0/2002921970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54940d0210 msgr2=0x7f54940d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:07.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5492d9d640 1 --2- 172.21.15.88:0/2002921970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54940d0210 0x7f54940d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5492d9d640 1 -- 172.21.15.88:0/2002921970 >> v1:172.21.15.175:6789/0 conn(0x7f549415cba0 legacy=0x7f54940cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.766+0000 7f5492d9d640 1 -- 172.21.15.88:0/2002921970 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54940d1c30 con 0x7f54940b84e0 2023-11-20T07:01:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.770+0000 7f5492d9d640 1 --2- 172.21.15.88:0/2002921970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54940b84e0 0x7f54940b5cf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f548c009870 tx=0x7f548c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4494f1520ac67c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.770+0000 7f5491d9b640 1 -- 172.21.15.88:0/2002921970 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0a9400 con 0x7f54940b84e0 2023-11-20T07:01:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.770+0000 7f5491d9b640 1 -- 172.21.15.88:0/2002921970 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c0a9560 con 0x7f54940b84e0 2023-11-20T07:01:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.770+0000 7f5491d9b640 1 -- 172.21.15.88:0/2002921970 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0a98f0 con 0x7f54940b84e0 2023-11-20T07:01:07.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.770+0000 7f5498aea640 1 -- 172.21.15.88:0/2002921970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54940b84e0 msgr2=0x7f54940b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.770+0000 7f5498aea640 1 --2- 172.21.15.88:0/2002921970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54940b84e0 0x7f54940b5cf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f548c009870 tx=0x7f548c01c540 comp rx=0 tx=0).stop 2023-11-20T07:01:07.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.770+0000 7f5498aea640 1 -- 172.21.15.88:0/2002921970 shutdown_connections 2023-11-20T07:01:07.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.770+0000 7f5498aea640 1 --2- 172.21.15.88:0/2002921970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54940b84e0 0x7f54940b5cf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.770+0000 7f5498aea640 1 --2- 172.21.15.88:0/2002921970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54940d0210 0x7f54940d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.770+0000 7f5498aea640 1 -- 172.21.15.88:0/2002921970 >> 172.21.15.88:0/2002921970 conn(0x7f54940719c0 msgr2=0x7f5494071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:07.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.770+0000 7f5498aea640 1 -- 172.21.15.88:0/2002921970 shutdown_connections 2023-11-20T07:01:07.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.770+0000 7f5498aea640 1 -- 172.21.15.88:0/2002921970 wait complete. 2023-11-20T07:01:07.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5498aea640 1 Processor -- start 2023-11-20T07:01:07.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5498aea640 1 -- start start 2023-11-20T07:01:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5498aea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54940b84e0 0x7f5494150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5498aea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54940d0210 0x7f549414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5498aea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f549415cba0 0x7f549415b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5498aea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54940ccab0 con 0x7f54940d0210 2023-11-20T07:01:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5498aea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5494151330 con 0x7f549415cba0 2023-11-20T07:01:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5498aea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549414de90 con 0x7f54940b84e0 2023-11-20T07:01:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5489d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54940d0210 0x7f549414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5489d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54940d0210 0x7f549414d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39554/0 (socket says 172.21.15.88:39554) 2023-11-20T07:01:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5489d9b640 1 -- 172.21.15.88:0/2542885683 learned_addr learned my addr 172.21.15.88:0/2542885683 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5492d9d640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f549415cba0 0x7f549415b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f549259c640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54940b84e0 0x7f5494150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5489d9b640 1 -- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54940b84e0 msgr2=0x7f5494150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5489d9b640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54940b84e0 0x7f5494150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5489d9b640 1 -- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f549415cba0 msgr2=0x7f549415b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5489d9b640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f549415cba0 0x7f549415b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5489d9b640 1 -- 172.21.15.88:0/2542885683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c0094d0 con 0x7f54940d0210 2023-11-20T07:01:07.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5489d9b640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54940d0210 0x7f549414d950 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f547c00d830 tx=0x7f547c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:07.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f548b7fe640 1 -- 172.21.15.88:0/2542885683 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c00b6c0 con 0x7f54940d0210 2023-11-20T07:01:07.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f548b7fe640 1 -- 172.21.15.88:0/2542885683 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c00b860 con 0x7f54940d0210 2023-11-20T07:01:07.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5498aea640 1 -- 172.21.15.88:0/2542885683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5494155410 con 0x7f54940d0210 2023-11-20T07:01:07.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f548b7fe640 1 -- 172.21.15.88:0/2542885683 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c00bc10 con 0x7f54940d0210 2023-11-20T07:01:07.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.774+0000 7f5498aea640 1 -- 172.21.15.88:0/2542885683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54940cc7d0 con 0x7f54940d0210 2023-11-20T07:01:07.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.778+0000 7f5498aea640 1 -- 172.21.15.88:0/2542885683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54940cc560 con 0x7f54940d0210 2023-11-20T07:01:07.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.778+0000 7f548b7fe640 1 -- 172.21.15.88:0/2542885683 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f547c01e460 con 0x7f54940d0210 2023-11-20T07:01:07.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.778+0000 7f548b7fe640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f54740664d0 0x7f5474068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.778+0000 7f548b7fe640 1 -- 172.21.15.88:0/2542885683 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f547c084880 con 0x7f54940d0210 2023-11-20T07:01:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.778+0000 7f549259c640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f54740664d0 0x7f5474068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:07.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.782+0000 7f549259c640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f54740664d0 0x7f5474068990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f54840012f0 tx=0x7f5484009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.782+0000 7f548b7fe640 1 -- 172.21.15.88:0/2542885683 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f547c051a10 con 0x7f54940d0210 2023-11-20T07:01:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 -- 172.21.15.88:0/2542885683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f549404e170 con 0x7f54940d0210 2023-11-20T07:01:07.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f548b7fe640 1 -- 172.21.15.88:0/2542885683 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f547c055030 con 0x7f54940d0210 2023-11-20T07:01:07.931 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 -- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f54740664d0 msgr2=0x7f5474068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f54740664d0 0x7f5474068990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f54840012f0 tx=0x7f5484009040 comp rx=0 tx=0).stop 2023-11-20T07:01:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 -- 172.21.15.88:0/2542885683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54940d0210 msgr2=0x7f549414d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54940d0210 0x7f549414d950 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f547c00d830 tx=0x7f547c00dcf0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 -- 172.21.15.88:0/2542885683 shutdown_connections 2023-11-20T07:01:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f54740664d0 0x7f5474068990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f549415cba0 0x7f549415b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54940d0210 0x7f549414d950 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 --2- 172.21.15.88:0/2542885683 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54940b84e0 0x7f5494150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 -- 172.21.15.88:0/2542885683 >> 172.21.15.88:0/2542885683 conn(0x7f54940719c0 msgr2=0x7f54940cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 -- 172.21.15.88:0/2542885683 shutdown_connections 2023-11-20T07:01:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:07.930+0000 7f5498aea640 1 -- 172.21.15.88:0/2542885683 wait complete. 2023-11-20T07:01:07.952 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:08.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.090+0000 7f3cb2b9d640 1 Processor -- start 2023-11-20T07:01:08.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.090+0000 7f3cb2b9d640 1 -- start start 2023-11-20T07:01:08.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.090+0000 7f3cb2b9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cac069e90 0x7f3cac06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.090+0000 7f3cb2b9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3cac06a270 0x7f3cac0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.090+0000 7f3cb2b9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3cac0702f0 0x7f3cac070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.090+0000 7f3cb2b9d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac0cb090 con 0x7f3cac0702f0 2023-11-20T07:01:08.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.090+0000 7f3cb2b9d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac15ae30 con 0x7f3cac06a270 2023-11-20T07:01:08.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.090+0000 7f3cb2b9d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0ca510 con 0x7f3cac069e90 2023-11-20T07:01:08.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.090+0000 7f3cb113a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3cac0702f0 0x7f3cac070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.090+0000 7f3cb113a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3cac0702f0 0x7f3cac070780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39570/0 (socket says 172.21.15.88:39570) 2023-11-20T07:01:08.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.090+0000 7f3cb113a640 1 -- 172.21.15.88:0/1746966430 learned_addr learned my addr 172.21.15.88:0/1746966430 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:08.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3ca3fff640 1 --2- 172.21.15.88:0/1746966430 >> v2:172.21.15.175:3300/0 conn(0x7f3cac06a270 0x7f3cac0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb0939640 1 --2- 172.21.15.88:0/1746966430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cac069e90 0x7f3cac06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb113a640 1 -- 172.21.15.88:0/1746966430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cac069e90 msgr2=0x7f3cac06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:08.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb113a640 1 --2- 172.21.15.88:0/1746966430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cac069e90 0x7f3cac06d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb113a640 1 -- 172.21.15.88:0/1746966430 >> v2:172.21.15.175:3300/0 conn(0x7f3cac06a270 msgr2=0x7f3cac0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:08.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb113a640 1 --2- 172.21.15.88:0/1746966430 >> v2:172.21.15.175:3300/0 conn(0x7f3cac06a270 0x7f3cac0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb113a640 1 -- 172.21.15.88:0/1746966430 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac0ca7f0 con 0x7f3cac0702f0 2023-11-20T07:01:08.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb113a640 1 --2- 172.21.15.88:0/1746966430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cac0702f0 0x7f3cac070780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0713b0 tx=0x7f3ca401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651d5a58bfb9170b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:08.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3ca37fe640 1 -- 172.21.15.88:0/1746966430 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40a5820 con 0x7f3cac0702f0 2023-11-20T07:01:08.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3ca37fe640 1 -- 172.21.15.88:0/1746966430 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca40a5980 con 0x7f3cac0702f0 2023-11-20T07:01:08.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3ca37fe640 1 -- 172.21.15.88:0/1746966430 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40a5d10 con 0x7f3cac0702f0 2023-11-20T07:01:08.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/1746966430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cac0702f0 msgr2=0x7f3cac070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb2b9d640 1 --2- 172.21.15.88:0/1746966430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cac0702f0 0x7f3cac070780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0713b0 tx=0x7f3ca401c9a0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/1746966430 shutdown_connections 2023-11-20T07:01:08.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb2b9d640 1 --2- 172.21.15.88:0/1746966430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cac0702f0 0x7f3cac070780 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb2b9d640 1 --2- 172.21.15.88:0/1746966430 >> v2:172.21.15.175:3300/0 conn(0x7f3cac06a270 0x7f3cac0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb2b9d640 1 --2- 172.21.15.88:0/1746966430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cac069e90 0x7f3cac06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.094+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/1746966430 >> 172.21.15.88:0/1746966430 conn(0x7f3cac0b0da0 msgr2=0x7f3cac0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:08.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/1746966430 shutdown_connections 2023-11-20T07:01:08.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/1746966430 wait complete. 2023-11-20T07:01:08.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb2b9d640 1 Processor -- start 2023-11-20T07:01:08.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb2b9d640 1 -- start start 2023-11-20T07:01:08.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb2b9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cac069e90 0x7f3cac158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb2b9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cac06a270 0x7f3cac0c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb2b9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cac0702f0 0x7f3cac0c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb2b9d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0c3560 con 0x7f3cac069e90 2023-11-20T07:01:08.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb2b9d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac14c850 con 0x7f3cac0702f0 2023-11-20T07:01:08.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb2b9d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac0c2ec0 con 0x7f3cac06a270 2023-11-20T07:01:08.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb0939640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cac069e90 0x7f3cac158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb0939640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cac069e90 0x7f3cac158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39574/0 (socket says 172.21.15.88:39574) 2023-11-20T07:01:08.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb0939640 1 -- 172.21.15.88:0/2966078160 learned_addr learned my addr 172.21.15.88:0/2966078160 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:08.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3ca3fff640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cac06a270 0x7f3cac0c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb113a640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cac0702f0 0x7f3cac0c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb0939640 1 -- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cac06a270 msgr2=0x7f3cac0c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb0939640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cac06a270 0x7f3cac0c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb0939640 1 -- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cac0702f0 msgr2=0x7f3cac0c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb0939640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cac0702f0 0x7f3cac0c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb0939640 1 -- 172.21.15.88:0/2966078160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4009b30 con 0x7f3cac069e90 2023-11-20T07:01:08.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb113a640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cac0702f0 0x7f3cac0c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:08.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3cb0939640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cac069e90 0x7f3cac158370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800d800 tx=0x7f3ca800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:08.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3ca17fa640 1 -- 172.21.15.88:0/2966078160 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80096a0 con 0x7f3cac069e90 2023-11-20T07:01:08.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.098+0000 7f3ca17fa640 1 -- 172.21.15.88:0/2966078160 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca8009800 con 0x7f3cac069e90 2023-11-20T07:01:08.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.102+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/2966078160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac158a00 con 0x7f3cac069e90 2023-11-20T07:01:08.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.102+0000 7f3ca17fa640 1 -- 172.21.15.88:0/2966078160 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8009b70 con 0x7f3cac069e90 2023-11-20T07:01:08.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.102+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/2966078160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac0c3180 con 0x7f3cac069e90 2023-11-20T07:01:08.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.102+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/2966078160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac04e170 con 0x7f3cac069e90 2023-11-20T07:01:08.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.102+0000 7f3ca17fa640 1 -- 172.21.15.88:0/2966078160 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3ca8009cd0 con 0x7f3cac069e90 2023-11-20T07:01:08.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.102+0000 7f3ca17fa640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3c980664a0 0x7f3c98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.102+0000 7f3ca17fa640 1 -- 172.21.15.88:0/2966078160 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ca8084880 con 0x7f3cac069e90 2023-11-20T07:01:08.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.102+0000 7f3ca3fff640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3c980664a0 0x7f3c98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.102+0000 7f3ca3fff640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3c980664a0 0x7f3c98068960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0c91e0 tx=0x7f3c9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:08.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.106+0000 7f3ca17fa640 1 -- 172.21.15.88:0/2966078160 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3ca8051980 con 0x7f3cac069e90 2023-11-20T07:01:08.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.254+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/2966078160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3cac0c2090 con 0x7f3cac069e90 2023-11-20T07:01:08.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.254+0000 7f3ca17fa640 1 -- 172.21.15.88:0/2966078160 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ca8054fa0 con 0x7f3cac069e90 2023-11-20T07:01:08.257 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.258+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3c980664a0 msgr2=0x7f3c98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.258+0000 7f3cb2b9d640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3c980664a0 0x7f3c98068960 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0c91e0 tx=0x7f3c9c008040 comp rx=0 tx=0).stop 2023-11-20T07:01:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.258+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/2966078160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cac069e90 msgr2=0x7f3cac158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.258+0000 7f3cb2b9d640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cac069e90 0x7f3cac158370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800d800 tx=0x7f3ca800dcc0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.258+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/2966078160 shutdown_connections 2023-11-20T07:01:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.258+0000 7f3cb2b9d640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3c980664a0 0x7f3c98068960 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.258+0000 7f3cb2b9d640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cac06a270 0x7f3cac0c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.258+0000 7f3cb2b9d640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cac0702f0 0x7f3cac0c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.258+0000 7f3cb2b9d640 1 --2- 172.21.15.88:0/2966078160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3cac069e90 0x7f3cac158370 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.258+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/2966078160 >> 172.21.15.88:0/2966078160 conn(0x7f3cac0b0da0 msgr2=0x7f3cac0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.258+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/2966078160 shutdown_connections 2023-11-20T07:01:08.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.258+0000 7f3cb2b9d640 1 -- 172.21.15.88:0/2966078160 wait complete. 2023-11-20T07:01:08.277 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:08.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafcb73e640 1 Processor -- start 2023-11-20T07:01:08.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafcb73e640 1 -- start start 2023-11-20T07:01:08.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafcb73e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafc406a5a0 0x7fafc406e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafcb73e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc40b4370 con 0x7fafc40b3f00 2023-11-20T07:01:08.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafcb73e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc40b4600 con 0x7fafc4159900 2023-11-20T07:01:08.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafcb73e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc40cd740 con 0x7fafc406a5a0 2023-11-20T07:01:08.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafc8cd9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafc406a5a0 0x7fafc406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafc9cdb640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fafc40b3f00 0x7fafc40c9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35712/0 (socket says 172.21.15.88:35712) 2023-11-20T07:01:08.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafc9cdb640 1 -- 172.21.15.88:0/3554090483 learned_addr learned my addr 172.21.15.88:0/3554090483 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:08.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafc8cd9640 1 -- 172.21.15.88:0/3554090483 >> v1:172.21.15.175:6789/0 conn(0x7fafc4159900 legacy=0x7fafc4069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafc8cd9640 1 -- 172.21.15.88:0/3554090483 >> v1:172.21.15.88:6789/0 conn(0x7fafc40b3f00 legacy=0x7fafc40c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafbbfff640 1 -- 172.21.15.88:0/3554090483 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629409837 0 0) 0x7fafc40b4600 con 0x7fafc4159900 2023-11-20T07:01:08.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.418+0000 7fafc8cd9640 1 -- 172.21.15.88:0/3554090483 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40c8dd0 con 0x7fafc406a5a0 2023-11-20T07:01:08.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.422+0000 7fafc8cd9640 1 --2- 172.21.15.88:0/3554090483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc406a5a0 0x7fafc406e260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fafb40097c0 tx=0x7fafb401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5026cf4d07848ce server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:08.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.422+0000 7fafbbfff640 1 -- 172.21.15.88:0/3554090483 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40ab600 con 0x7fafc406a5a0 2023-11-20T07:01:08.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.422+0000 7fafbbfff640 1 -- 172.21.15.88:0/3554090483 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb40a7050 con 0x7fafc406a5a0 2023-11-20T07:01:08.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.422+0000 7fafbbfff640 1 -- 172.21.15.88:0/3554090483 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40ab980 con 0x7fafc406a5a0 2023-11-20T07:01:08.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.422+0000 7fafcb73e640 1 -- 172.21.15.88:0/3554090483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc406a5a0 msgr2=0x7fafc406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.422+0000 7fafcb73e640 1 --2- 172.21.15.88:0/3554090483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc406a5a0 0x7fafc406e260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fafb40097c0 tx=0x7fafb401c310 comp rx=0 tx=0).stop 2023-11-20T07:01:08.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.422+0000 7fafcb73e640 1 -- 172.21.15.88:0/3554090483 shutdown_connections 2023-11-20T07:01:08.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.422+0000 7fafcb73e640 1 --2- 172.21.15.88:0/3554090483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc406a5a0 0x7fafc406e260 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.422+0000 7fafcb73e640 1 -- 172.21.15.88:0/3554090483 >> 172.21.15.88:0/3554090483 conn(0x7fafc40b0da0 msgr2=0x7fafc40ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:08.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.422+0000 7fafcb73e640 1 -- 172.21.15.88:0/3554090483 shutdown_connections 2023-11-20T07:01:08.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.422+0000 7fafcb73e640 1 -- 172.21.15.88:0/3554090483 wait complete. 2023-11-20T07:01:08.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafcb73e640 1 Processor -- start 2023-11-20T07:01:08.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafcb73e640 1 -- start start 2023-11-20T07:01:08.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafcb73e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc406a5a0 0x7fafc40c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafcb73e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc40b3f00 0x7fafc4156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafcb73e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc4159900 0x7fafc41ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafcb73e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc41554f0 con 0x7fafc40b3f00 2023-11-20T07:01:08.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafcb73e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40b1b30 con 0x7fafc406a5a0 2023-11-20T07:01:08.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafcb73e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40c82f0 con 0x7fafc4159900 2023-11-20T07:01:08.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafc8cd9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc40b3f00 0x7fafc4156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafc8cd9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc40b3f00 0x7fafc4156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39594/0 (socket says 172.21.15.88:39594) 2023-11-20T07:01:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafc8cd9640 1 -- 172.21.15.88:0/2589559734 learned_addr learned my addr 172.21.15.88:0/2589559734 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafc8cd9640 1 -- 172.21.15.88:0/2589559734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc4159900 msgr2=0x7fafc41ef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafc8cd9640 1 --2- 172.21.15.88:0/2589559734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc4159900 0x7fafc41ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafc8cd9640 1 -- 172.21.15.88:0/2589559734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc406a5a0 msgr2=0x7fafc40c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafc8cd9640 1 --2- 172.21.15.88:0/2589559734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc406a5a0 0x7fafc40c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafc8cd9640 1 -- 172.21.15.88:0/2589559734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb4009420 con 0x7fafc40b3f00 2023-11-20T07:01:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafc8cd9640 1 --2- 172.21.15.88:0/2589559734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc40b3f00 0x7fafc4156200 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fafb4018f20 tx=0x7fafb401ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:08.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafb9ffb640 1 -- 172.21.15.88:0/2589559734 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40b4970 con 0x7fafc40b3f00 2023-11-20T07:01:08.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafb9ffb640 1 -- 172.21.15.88:0/2589559734 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb40b8070 con 0x7fafc40b3f00 2023-11-20T07:01:08.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafb9ffb640 1 -- 172.21.15.88:0/2589559734 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40b4cf0 con 0x7fafc40b3f00 2023-11-20T07:01:08.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.426+0000 7fafcb73e640 1 -- 172.21.15.88:0/2589559734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc40c85d0 con 0x7fafc40b3f00 2023-11-20T07:01:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.430+0000 7fafcb73e640 1 -- 172.21.15.88:0/2589559734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc40c8b90 con 0x7fafc40b3f00 2023-11-20T07:01:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.430+0000 7fafcb73e640 1 -- 172.21.15.88:0/2589559734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc404e170 con 0x7fafc40b3f00 2023-11-20T07:01:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.430+0000 7fafb9ffb640 1 -- 172.21.15.88:0/2589559734 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fafb40aa420 con 0x7fafc40b3f00 2023-11-20T07:01:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.430+0000 7fafb9ffb640 1 --2- 172.21.15.88:0/2589559734 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fafa80664a0 0x7fafa8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.430+0000 7fafb9ffb640 1 -- 172.21.15.88:0/2589559734 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fafb40ba070 con 0x7fafc40b3f00 2023-11-20T07:01:08.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.430+0000 7fafc94da640 1 --2- 172.21.15.88:0/2589559734 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fafa80664a0 0x7fafa8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.430+0000 7fafc94da640 1 --2- 172.21.15.88:0/2589559734 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fafa80664a0 0x7fafa8068960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fafc0007fd0 tx=0x7fafc0007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:08.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.434+0000 7fafb9ffb640 1 -- 172.21.15.88:0/2589559734 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fafb40eda90 con 0x7fafc40b3f00 2023-11-20T07:01:08.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.582+0000 7fafcb73e640 1 -- 172.21.15.88:0/2589559734 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fafc40ad530 con 0x7fafc40b3f00 2023-11-20T07:01:08.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafb9ffb640 1 -- 172.21.15.88:0/2589559734 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fafb40b00a0 con 0x7fafc40b3f00 2023-11-20T07:01:08.586 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:08.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafcb73e640 1 -- 172.21.15.88:0/2589559734 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fafa80664a0 msgr2=0x7fafa8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafcb73e640 1 --2- 172.21.15.88:0/2589559734 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fafa80664a0 0x7fafa8068960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fafc0007fd0 tx=0x7fafc0007920 comp rx=0 tx=0).stop 2023-11-20T07:01:08.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafcb73e640 1 -- 172.21.15.88:0/2589559734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc40b3f00 msgr2=0x7fafc4156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafcb73e640 1 --2- 172.21.15.88:0/2589559734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc40b3f00 0x7fafc4156200 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fafb4018f20 tx=0x7fafb401ab50 comp rx=0 tx=0).stop 2023-11-20T07:01:08.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafcb73e640 1 -- 172.21.15.88:0/2589559734 shutdown_connections 2023-11-20T07:01:08.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafcb73e640 1 --2- 172.21.15.88:0/2589559734 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fafa80664a0 0x7fafa8068960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafcb73e640 1 --2- 172.21.15.88:0/2589559734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafc4159900 0x7fafc41ef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafcb73e640 1 --2- 172.21.15.88:0/2589559734 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafc40b3f00 0x7fafc4156200 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafcb73e640 1 --2- 172.21.15.88:0/2589559734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafc406a5a0 0x7fafc40c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafcb73e640 1 -- 172.21.15.88:0/2589559734 >> 172.21.15.88:0/2589559734 conn(0x7fafc40b0da0 msgr2=0x7fafc4069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:08.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafcb73e640 1 -- 172.21.15.88:0/2589559734 shutdown_connections 2023-11-20T07:01:08.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.586+0000 7fafcb73e640 1 -- 172.21.15.88:0/2589559734 wait complete. 2023-11-20T07:01:08.606 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T07:01:08.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.742+0000 7f20def72640 1 Processor -- start 2023-11-20T07:01:08.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.742+0000 7f20def72640 1 -- start start 2023-11-20T07:01:08.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20def72640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f20d81591e0 0x7f20d80c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20def72640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d8071020 con 0x7f20d80b00e0 2023-11-20T07:01:08.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20def72640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d80c8e50 con 0x7f20d80ca430 2023-11-20T07:01:08.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20def72640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d80c9130 con 0x7f20d81591e0 2023-11-20T07:01:08.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20dd50f640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f20d80b00e0 0x7f20d80b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35728/0 (socket says 172.21.15.88:35728) 2023-11-20T07:01:08.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20dd50f640 1 -- 172.21.15.88:0/3020384590 learned_addr learned my addr 172.21.15.88:0/3020384590 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:08.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20dcd0e640 1 --2- 172.21.15.88:0/3020384590 >> v2:172.21.15.175:3300/0 conn(0x7f20d81591e0 0x7f20d80c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024029507 0 0) 0x7f20d8071020 con 0x7f20d80b00e0 2023-11-20T07:01:08.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c0004640 con 0x7f20d80b00e0 2023-11-20T07:01:08.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1108271351 0 0) 0x7f20c0004640 con 0x7f20d80b00e0 2023-11-20T07:01:08.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 >> v2:172.21.15.175:3300/0 conn(0x7f20d81591e0 msgr2=0x7f20d80c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:08.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 --2- 172.21.15.88:0/3020384590 >> v2:172.21.15.175:3300/0 conn(0x7f20d81591e0 0x7f20d80c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 >> v1:172.21.15.175:6789/0 conn(0x7f20d80ca430 legacy=0x7f20d8071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d80c9410 con 0x7f20d80b00e0 2023-11-20T07:01:08.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f20d0001a00 con 0x7f20d80b00e0 2023-11-20T07:01:08.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 >> v1:172.21.15.88:6789/0 conn(0x7f20d80b00e0 legacy=0x7f20d80b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 --2- 172.21.15.88:0/3020384590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20c0004a90 0x7f20c0004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 --2- 172.21.15.88:0/3020384590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c00058e0 0x7f20c0005d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 --2- 172.21.15.88:0/3020384590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 0x7f20c000caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d80c9130 con 0x7f20c00062a0 2023-11-20T07:01:08.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c000d140 con 0x7f20c00058e0 2023-11-20T07:01:08.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c000d300 con 0x7f20c0004a90 2023-11-20T07:01:08.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20dd50f640 1 --2- 172.21.15.88:0/3020384590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 0x7f20c000caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20dcd0e640 1 --2- 172.21.15.88:0/3020384590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20c0004a90 0x7f20c0004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20cffff640 1 --2- 172.21.15.88:0/3020384590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c00058e0 0x7f20c0005d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20dd50f640 1 -- 172.21.15.88:0/3020384590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20c0004a90 msgr2=0x7f20c0004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:08.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20dd50f640 1 --2- 172.21.15.88:0/3020384590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20c0004a90 0x7f20c0004eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20dd50f640 1 -- 172.21.15.88:0/3020384590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c00058e0 msgr2=0x7f20c0005d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:08.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20dd50f640 1 --2- 172.21.15.88:0/3020384590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c00058e0 0x7f20c0005d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.746+0000 7f20dd50f640 1 -- 172.21.15.88:0/3020384590 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c0004640 con 0x7f20c00062a0 2023-11-20T07:01:08.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.750+0000 7f20dd50f640 1 -- 172.21.15.88:0/3020384590 reap_dead start 2023-11-20T07:01:08.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.750+0000 7f20dd50f640 1 --2- 172.21.15.88:0/3020384590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 0x7f20c000caa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f20d000a410 tx=0x7f20d001f550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4033bfb30a4d5a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:08.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.750+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d00072d0 con 0x7f20c00062a0 2023-11-20T07:01:08.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.750+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d0007470 con 0x7f20c00062a0 2023-11-20T07:01:08.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.750+0000 7f20cf7fe640 1 -- 172.21.15.88:0/3020384590 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0007820 con 0x7f20c00062a0 2023-11-20T07:01:08.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.750+0000 7f20def72640 1 -- 172.21.15.88:0/3020384590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 msgr2=0x7f20c000caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.750+0000 7f20def72640 1 --2- 172.21.15.88:0/3020384590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 0x7f20c000caa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f20d000a410 tx=0x7f20d001f550 comp rx=0 tx=0).stop 2023-11-20T07:01:08.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.750+0000 7f20def72640 1 -- 172.21.15.88:0/3020384590 shutdown_connections 2023-11-20T07:01:08.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.750+0000 7f20def72640 1 --2- 172.21.15.88:0/3020384590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 0x7f20c000caa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.750+0000 7f20def72640 1 -- 172.21.15.88:0/3020384590 >> 172.21.15.88:0/3020384590 conn(0x7f20d806c190 msgr2=0x7f20d806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:08.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.750+0000 7f20def72640 1 -- 172.21.15.88:0/3020384590 shutdown_connections 2023-11-20T07:01:08.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.750+0000 7f20def72640 1 -- 172.21.15.88:0/3020384590 wait complete. 2023-11-20T07:01:08.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20def72640 1 Processor -- start 2023-11-20T07:01:08.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20def72640 1 -- start start 2023-11-20T07:01:08.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20def72640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 0x7f20d80b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20def72640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d8154ce0 0x7f20d814ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20def72640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20d80c7270 0x7f20d80c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20def72640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d80c7c60 con 0x7f20c00062a0 2023-11-20T07:01:08.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20def72640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d814bf90 con 0x7f20d80c7270 2023-11-20T07:01:08.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20def72640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d80acf90 con 0x7f20d8154ce0 2023-11-20T07:01:08.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20dcd0e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 0x7f20d80b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20dcd0e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 0x7f20d80b3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39620/0 (socket says 172.21.15.88:39620) 2023-11-20T07:01:08.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20dcd0e640 1 -- 172.21.15.88:0/163526128 learned_addr learned my addr 172.21.15.88:0/163526128 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:08.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20dcd0e640 1 -- 172.21.15.88:0/163526128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d8154ce0 msgr2=0x7f20d814ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20dcd0e640 1 --2- 172.21.15.88:0/163526128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d8154ce0 0x7f20d814ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20dcd0e640 1 -- 172.21.15.88:0/163526128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20d80c7270 msgr2=0x7f20d80c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20dcd0e640 1 --2- 172.21.15.88:0/163526128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20d80c7270 0x7f20d80c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20dcd0e640 1 -- 172.21.15.88:0/163526128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d80accb0 con 0x7f20c00062a0 2023-11-20T07:01:08.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20dcd0e640 1 --2- 172.21.15.88:0/163526128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 0x7f20d80b3cc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20d4011990 tx=0x7f20d4011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:08.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20cd7fa640 1 -- 172.21.15.88:0/163526128 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d400fa70 con 0x7f20c00062a0 2023-11-20T07:01:08.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20cd7fa640 1 -- 172.21.15.88:0/163526128 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d400fbd0 con 0x7f20c00062a0 2023-11-20T07:01:08.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20cd7fa640 1 -- 172.21.15.88:0/163526128 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4014440 con 0x7f20c00062a0 2023-11-20T07:01:08.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20def72640 1 -- 172.21.15.88:0/163526128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d80b31e0 con 0x7f20c00062a0 2023-11-20T07:01:08.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20def72640 1 -- 172.21.15.88:0/163526128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d80b37a0 con 0x7f20c00062a0 2023-11-20T07:01:08.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.754+0000 7f20def72640 1 -- 172.21.15.88:0/163526128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d8074010 con 0x7f20c00062a0 2023-11-20T07:01:08.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.758+0000 7f20cd7fa640 1 -- 172.21.15.88:0/163526128 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f20d40145a0 con 0x7f20c00062a0 2023-11-20T07:01:08.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.758+0000 7f20cd7fa640 1 --2- 172.21.15.88:0/163526128 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f20c40664c0 0x7f20c4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:08.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.758+0000 7f20cd7fa640 1 -- 172.21.15.88:0/163526128 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f20d4084920 con 0x7f20c00062a0 2023-11-20T07:01:08.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.758+0000 7f20cffff640 1 --2- 172.21.15.88:0/163526128 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f20c40664c0 0x7f20c4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:08.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.758+0000 7f20cffff640 1 --2- 172.21.15.88:0/163526128 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f20c40664c0 0x7f20c4068980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f20d8155100 tx=0x7f20c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:08.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.762+0000 7f20cd7fa640 1 -- 172.21.15.88:0/163526128 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f20d4051aa0 con 0x7f20c00062a0 2023-11-20T07:01:08.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.922+0000 7f20def72640 1 -- 172.21.15.88:0/163526128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f20d80cbc10 con 0x7f20c00062a0 2023-11-20T07:01:08.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.922+0000 7f20cd7fa640 1 -- 172.21.15.88:0/163526128 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f20d40550c0 con 0x7f20c00062a0 2023-11-20T07:01:08.923 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-20T07:01:08.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.926+0000 7f20def72640 1 -- 172.21.15.88:0/163526128 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f20c40664c0 msgr2=0x7f20c4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.926+0000 7f20def72640 1 --2- 172.21.15.88:0/163526128 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f20c40664c0 0x7f20c4068980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f20d8155100 tx=0x7f20c8009040 comp rx=0 tx=0).stop 2023-11-20T07:01:08.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.926+0000 7f20def72640 1 -- 172.21.15.88:0/163526128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 msgr2=0x7f20d80b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:08.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.926+0000 7f20def72640 1 --2- 172.21.15.88:0/163526128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 0x7f20d80b3cc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20d4011990 tx=0x7f20d4011e50 comp rx=0 tx=0).stop 2023-11-20T07:01:08.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.926+0000 7f20def72640 1 -- 172.21.15.88:0/163526128 shutdown_connections 2023-11-20T07:01:08.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.926+0000 7f20def72640 1 --2- 172.21.15.88:0/163526128 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f20c40664c0 0x7f20c4068980 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.926+0000 7f20def72640 1 --2- 172.21.15.88:0/163526128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20d8154ce0 0x7f20d814ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.926+0000 7f20def72640 1 --2- 172.21.15.88:0/163526128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20d80c7270 0x7f20d80c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.926+0000 7f20def72640 1 --2- 172.21.15.88:0/163526128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20c00062a0 0x7f20d80b3cc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:08.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.926+0000 7f20def72640 1 -- 172.21.15.88:0/163526128 >> 172.21.15.88:0/163526128 conn(0x7f20d806c190 msgr2=0x7f20d80cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:08.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.926+0000 7f20def72640 1 -- 172.21.15.88:0/163526128 shutdown_connections 2023-11-20T07:01:08.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:08.926+0000 7f20def72640 1 -- 172.21.15.88:0/163526128 wait complete. 2023-11-20T07:01:08.944 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2023-11-20T07:01:08.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:08.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-11-20T07:01:08.979 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:ceph-fuse[44384]: fuse finished with error 0 and tester_r 0 2023-11-20T07:01:08.982 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:01:15.084 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T07:01:15.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:15.084 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-11-20T07:01:15.119 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:15.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.306+0000 7fd65da9c640 1 Processor -- start 2023-11-20T07:01:15.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.306+0000 7fd65da9c640 1 -- start start 2023-11-20T07:01:15.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.306+0000 7fd65da9c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd65815cb90 0x7fd6580cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.306+0000 7fd65da9c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6580ce770 con 0x7fd6580d15d0 2023-11-20T07:01:15.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.306+0000 7fd65da9c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6580d0600 con 0x7fd6580d3010 2023-11-20T07:01:15.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.306+0000 7fd65da9c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6580c6450 con 0x7fd65815cb90 2023-11-20T07:01:15.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.306+0000 7fd657fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd6580d15d0 0x7fd6580c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35744/0 (socket says 172.21.15.88:35744) 2023-11-20T07:01:15.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.306+0000 7fd657fff640 1 -- 172.21.15.88:0/3118123664 learned_addr learned my addr 172.21.15.88:0/3118123664 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:15.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.306+0000 7fd6577fe640 1 --2- 172.21.15.88:0/3118123664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd65815cb90 0x7fd6580cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.306+0000 7fd656ffd640 1 -- 172.21.15.88:0/3118123664 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687089608 0 0) 0x7fd6580ce770 con 0x7fd6580d15d0 2023-11-20T07:01:15.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.306+0000 7fd656ffd640 1 -- 172.21.15.88:0/3118123664 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd644003530 con 0x7fd6580d15d0 2023-11-20T07:01:15.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.310+0000 7fd656ffd640 1 -- 172.21.15.88:0/3118123664 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081746732 0 0) 0x7fd6580d0600 con 0x7fd6580d3010 2023-11-20T07:01:15.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.310+0000 7fd6577fe640 1 -- 172.21.15.88:0/3118123664 >> v1:172.21.15.175:6789/0 conn(0x7fd6580d3010 legacy=0x7fd6580d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.310+0000 7fd6577fe640 1 -- 172.21.15.88:0/3118123664 >> v1:172.21.15.88:6789/0 conn(0x7fd6580d15d0 legacy=0x7fd6580c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.310+0000 7fd6577fe640 1 -- 172.21.15.88:0/3118123664 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6580d08a0 con 0x7fd65815cb90 2023-11-20T07:01:15.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.310+0000 7fd6577fe640 1 --2- 172.21.15.88:0/3118123664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd65815cb90 0x7fd6580cfb10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd6480097d0 tx=0x7fd64801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fa64e69c03557f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:15.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.310+0000 7fd656ffd640 1 -- 172.21.15.88:0/3118123664 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6480ac640 con 0x7fd65815cb90 2023-11-20T07:01:15.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.310+0000 7fd656ffd640 1 -- 172.21.15.88:0/3118123664 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6480ac7a0 con 0x7fd65815cb90 2023-11-20T07:01:15.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.310+0000 7fd656ffd640 1 -- 172.21.15.88:0/3118123664 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6480acb30 con 0x7fd65815cb90 2023-11-20T07:01:15.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.310+0000 7fd65da9c640 1 -- 172.21.15.88:0/3118123664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd65815cb90 msgr2=0x7fd6580cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.310+0000 7fd65da9c640 1 --2- 172.21.15.88:0/3118123664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd65815cb90 0x7fd6580cfb10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd6480097d0 tx=0x7fd64801c3e0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 -- 172.21.15.88:0/3118123664 shutdown_connections 2023-11-20T07:01:15.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 --2- 172.21.15.88:0/3118123664 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd65815cb90 0x7fd6580cfb10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 -- 172.21.15.88:0/3118123664 >> 172.21.15.88:0/3118123664 conn(0x7fd65809bc50 msgr2=0x7fd6580d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:15.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 -- 172.21.15.88:0/3118123664 shutdown_connections 2023-11-20T07:01:15.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 -- 172.21.15.88:0/3118123664 wait complete. 2023-11-20T07:01:15.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 Processor -- start 2023-11-20T07:01:15.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 -- start start 2023-11-20T07:01:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6580d15d0 0x7fd65814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6580d3010 0x7fd658154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65815cb90 0x7fd658154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd658151320 con 0x7fd6580d3010 2023-11-20T07:01:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6580cc2e0 con 0x7fd65815cb90 2023-11-20T07:01:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd65da9c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6580cb6d0 con 0x7fd6580d15d0 2023-11-20T07:01:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd64ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6580d3010 0x7fd658154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd64ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6580d3010 0x7fd658154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39632/0 (socket says 172.21.15.88:39632) 2023-11-20T07:01:15.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd64ffff640 1 -- 172.21.15.88:0/1055359953 learned_addr learned my addr 172.21.15.88:0/1055359953 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:15.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd657fff640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65815cb90 0x7fd658154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd6577fe640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6580d15d0 0x7fd65814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd64ffff640 1 -- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6580d15d0 msgr2=0x7fd65814e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd64ffff640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6580d15d0 0x7fd65814e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd64ffff640 1 -- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65815cb90 msgr2=0x7fd658154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd64ffff640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65815cb90 0x7fd658154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd64ffff640 1 -- 172.21.15.88:0/1055359953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6480093b0 con 0x7fd6580d3010 2023-11-20T07:01:15.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.314+0000 7fd64ffff640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6580d3010 0x7fd658154670 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd640001ec0 tx=0x7fd64000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:15.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.318+0000 7fd654ff9640 1 -- 172.21.15.88:0/1055359953 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400054e0 con 0x7fd6580d3010 2023-11-20T07:01:15.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.318+0000 7fd654ff9640 1 -- 172.21.15.88:0/1055359953 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd640003600 con 0x7fd6580d3010 2023-11-20T07:01:15.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.318+0000 7fd654ff9640 1 -- 172.21.15.88:0/1055359953 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400039b0 con 0x7fd6580d3010 2023-11-20T07:01:15.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.318+0000 7fd65da9c640 1 -- 172.21.15.88:0/1055359953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6580cb9b0 con 0x7fd6580d3010 2023-11-20T07:01:15.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.318+0000 7fd65da9c640 1 -- 172.21.15.88:0/1055359953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6580cbf70 con 0x7fd6580d3010 2023-11-20T07:01:15.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.318+0000 7fd65da9c640 1 -- 172.21.15.88:0/1055359953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd658074010 con 0x7fd6580d3010 2023-11-20T07:01:15.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.318+0000 7fd654ff9640 1 -- 172.21.15.88:0/1055359953 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd640003b10 con 0x7fd6580d3010 2023-11-20T07:01:15.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.318+0000 7fd654ff9640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd6380664a0 0x7fd638068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.318+0000 7fd654ff9640 1 -- 172.21.15.88:0/1055359953 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd640083760 con 0x7fd6580d3010 2023-11-20T07:01:15.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.322+0000 7fd6577fe640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd6380664a0 0x7fd638068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.322+0000 7fd6577fe640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd6380664a0 0x7fd638068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6480ae000 tx=0x7fd6480a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:15.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.326+0000 7fd654ff9640 1 -- 172.21.15.88:0/1055359953 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd640050900 con 0x7fd6580d3010 2023-11-20T07:01:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.474+0000 7fd65da9c640 1 -- 172.21.15.88:0/1055359953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd658072b60 con 0x7fd6580d3010 2023-11-20T07:01:15.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd654ff9640 1 -- 172.21.15.88:0/1055359953 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fd640017090 con 0x7fd6580d3010 2023-11-20T07:01:15.477 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:15.477 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd65da9c640 1 -- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd6380664a0 msgr2=0x7fd638068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd65da9c640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd6380664a0 0x7fd638068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6480ae000 tx=0x7fd6480a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd65da9c640 1 -- 172.21.15.88:0/1055359953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6580d3010 msgr2=0x7fd658154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd65da9c640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6580d3010 0x7fd658154670 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd640001ec0 tx=0x7fd64000c8e0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd65da9c640 1 -- 172.21.15.88:0/1055359953 shutdown_connections 2023-11-20T07:01:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd65da9c640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd6380664a0 0x7fd638068960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd65da9c640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65815cb90 0x7fd658154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd65da9c640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6580d3010 0x7fd658154670 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd65da9c640 1 --2- 172.21.15.88:0/1055359953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6580d15d0 0x7fd65814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd65da9c640 1 -- 172.21.15.88:0/1055359953 >> 172.21.15.88:0/1055359953 conn(0x7fd65809bc50 msgr2=0x7fd6580b4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:15.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd65da9c640 1 -- 172.21.15.88:0/1055359953 shutdown_connections 2023-11-20T07:01:15.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.478+0000 7fd65da9c640 1 -- 172.21.15.88:0/1055359953 wait complete. 2023-11-20T07:01:15.498 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:15.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.634+0000 7f1e4c5d3640 1 Processor -- start 2023-11-20T07:01:15.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.634+0000 7f1e4c5d3640 1 -- start start 2023-11-20T07:01:15.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e4c5d3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1e4415ce30 0x7f1e440cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e4c5d3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1e440b21c0 0x7f1e440b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e4c5d3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e441607e0 con 0x7f1e4415ca50 2023-11-20T07:01:15.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e4c5d3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e440cf060 con 0x7f1e4415ce30 2023-11-20T07:01:15.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e4c5d3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e440b2ae0 con 0x7f1e440b21c0 2023-11-20T07:01:15.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e49b6e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1e4415ce30 0x7f1e440cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e49b6e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1e4415ce30 0x7f1e440cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39648/0 (socket says 172.21.15.88:39648) 2023-11-20T07:01:15.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e49b6e640 1 -- 172.21.15.88:0/3722690344 learned_addr learned my addr 172.21.15.88:0/3722690344 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:15.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e4ab70640 1 --2- 172.21.15.88:0/3722690344 >> v2:172.21.15.175:3300/0 conn(0x7f1e440b21c0 0x7f1e440b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e49b6e640 1 -- 172.21.15.88:0/3722690344 >> v2:172.21.15.175:3300/0 conn(0x7f1e440b21c0 msgr2=0x7f1e440b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:15.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e49b6e640 1 --2- 172.21.15.88:0/3722690344 >> v2:172.21.15.175:3300/0 conn(0x7f1e440b21c0 0x7f1e440b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e49b6e640 1 -- 172.21.15.88:0/3722690344 >> v1:172.21.15.175:6789/0 conn(0x7f1e4415ca50 legacy=0x7f1e4406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:15.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e49b6e640 1 -- 172.21.15.88:0/3722690344 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e44070210 con 0x7f1e4415ce30 2023-11-20T07:01:15.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.638+0000 7f1e49b6e640 1 --2- 172.21.15.88:0/3722690344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e4415ce30 0x7f1e440cad90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e440c4210 tx=0x7f1e3401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2208838b31c6cd63 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:15.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4936d640 1 -- 172.21.15.88:0/3722690344 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e340aa620 con 0x7f1e4415ce30 2023-11-20T07:01:15.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4936d640 1 -- 172.21.15.88:0/3722690344 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e340aa780 con 0x7f1e4415ce30 2023-11-20T07:01:15.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4936d640 1 -- 172.21.15.88:0/3722690344 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e340aab10 con 0x7f1e4415ce30 2023-11-20T07:01:15.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3722690344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e4415ce30 msgr2=0x7f1e440cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 --2- 172.21.15.88:0/3722690344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e4415ce30 0x7f1e440cad90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e440c4210 tx=0x7f1e3401c4c0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3722690344 shutdown_connections 2023-11-20T07:01:15.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 --2- 172.21.15.88:0/3722690344 >> v2:172.21.15.175:3300/0 conn(0x7f1e440b21c0 0x7f1e440b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 --2- 172.21.15.88:0/3722690344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e4415ce30 0x7f1e440cad90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3722690344 >> 172.21.15.88:0/3722690344 conn(0x7f1e440cd1c0 msgr2=0x7f1e440cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:15.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3722690344 shutdown_connections 2023-11-20T07:01:15.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3722690344 wait complete. 2023-11-20T07:01:15.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 Processor -- start 2023-11-20T07:01:15.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 -- start start 2023-11-20T07:01:15.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e440b21c0 0x7f1e44155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e4415ca50 0x7f1e441f8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e4415ce30 0x7f1e441f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440b47e0 con 0x7f1e440b21c0 2023-11-20T07:01:15.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440b3c60 con 0x7f1e4415ce30 2023-11-20T07:01:15.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4c5d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440b3f40 con 0x7f1e4415ca50 2023-11-20T07:01:15.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.642+0000 7f1e4a36f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e440b21c0 0x7f1e44155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4a36f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e440b21c0 0x7f1e44155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39656/0 (socket says 172.21.15.88:39656) 2023-11-20T07:01:15.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4a36f640 1 -- 172.21.15.88:0/3695333875 learned_addr learned my addr 172.21.15.88:0/3695333875 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:15.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e49b6e640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e4415ca50 0x7f1e441f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4ab70640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e4415ce30 0x7f1e441f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4a36f640 1 -- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e4415ca50 msgr2=0x7f1e441f8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4a36f640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e4415ca50 0x7f1e441f8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4a36f640 1 -- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e4415ce30 msgr2=0x7f1e441f8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4a36f640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e4415ce30 0x7f1e441f8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4a36f640 1 -- 172.21.15.88:0/3695333875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e340094d0 con 0x7f1e440b21c0 2023-11-20T07:01:15.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4ab70640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e4415ce30 0x7f1e441f8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:15.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4a36f640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e440b21c0 0x7f1e44155780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000c450 tx=0x7f1e4000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:15.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e3affd640 1 -- 172.21.15.88:0/3695333875 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40012830 con 0x7f1e440b21c0 2023-11-20T07:01:15.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e3affd640 1 -- 172.21.15.88:0/3695333875 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e400129b0 con 0x7f1e440b21c0 2023-11-20T07:01:15.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e3affd640 1 -- 172.21.15.88:0/3695333875 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40012d60 con 0x7f1e440b21c0 2023-11-20T07:01:15.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3695333875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e440b4220 con 0x7f1e440b21c0 2023-11-20T07:01:15.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3695333875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e44155cc0 con 0x7f1e440b21c0 2023-11-20T07:01:15.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3695333875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e441f6190 con 0x7f1e440b21c0 2023-11-20T07:01:15.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e3affd640 1 -- 172.21.15.88:0/3695333875 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1e4001c460 con 0x7f1e440b21c0 2023-11-20T07:01:15.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.646+0000 7f1e3affd640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1e280664a0 0x7f1e28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.650+0000 7f1e3affd640 1 -- 172.21.15.88:0/3695333875 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e40084070 con 0x7f1e440b21c0 2023-11-20T07:01:15.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.650+0000 7f1e49b6e640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1e280664a0 0x7f1e28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.650+0000 7f1e49b6e640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1e280664a0 0x7f1e28068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1e340ae000 tx=0x7f1e340b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:15.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.654+0000 7f1e3affd640 1 -- 172.21.15.88:0/3695333875 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1e400b5090 con 0x7f1e440b21c0 2023-11-20T07:01:15.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.802+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3695333875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e44074010 con 0x7f1e440b21c0 2023-11-20T07:01:15.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.802+0000 7f1e3affd640 1 -- 172.21.15.88:0/3695333875 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f1e441f6190 con 0x7f1e440b21c0 2023-11-20T07:01:15.804 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:15.805 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:15.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.806+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1e280664a0 msgr2=0x7f1e28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.806+0000 7f1e4c5d3640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1e280664a0 0x7f1e28068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1e340ae000 tx=0x7f1e340b5040 comp rx=0 tx=0).stop 2023-11-20T07:01:15.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.806+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3695333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e440b21c0 msgr2=0x7f1e44155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.806+0000 7f1e4c5d3640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e440b21c0 0x7f1e44155780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000c450 tx=0x7f1e4000c910 comp rx=0 tx=0).stop 2023-11-20T07:01:15.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.806+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3695333875 shutdown_connections 2023-11-20T07:01:15.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.806+0000 7f1e4c5d3640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f1e280664a0 0x7f1e28068960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.806+0000 7f1e4c5d3640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e4415ca50 0x7f1e441f8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.806+0000 7f1e4c5d3640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e4415ce30 0x7f1e441f8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.806+0000 7f1e4c5d3640 1 --2- 172.21.15.88:0/3695333875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1e440b21c0 0x7f1e44155780 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.806+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3695333875 >> 172.21.15.88:0/3695333875 conn(0x7f1e440cd1c0 msgr2=0x7f1e4415bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:15.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.806+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3695333875 shutdown_connections 2023-11-20T07:01:15.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.806+0000 7f1e4c5d3640 1 -- 172.21.15.88:0/3695333875 wait complete. 2023-11-20T07:01:15.825 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-20T07:01:15.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.962+0000 7fea63965640 1 Processor -- start 2023-11-20T07:01:15.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.962+0000 7fea63965640 1 -- start start 2023-11-20T07:01:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea63965640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c0cb040 0x7fea5c0ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea63965640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c0cc330 con 0x7fea5c15cc60 2023-11-20T07:01:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea63965640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c0cb4a0 con 0x7fea5c0cebd0 2023-11-20T07:01:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea63965640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0cefe0 con 0x7fea5c0cb040 2023-11-20T07:01:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea61701640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fea5c15cc60 0x7fea5c161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35754/0 (socket says 172.21.15.88:35754) 2023-11-20T07:01:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea61701640 1 -- 172.21.15.88:0/3728307866 learned_addr learned my addr 172.21.15.88:0/3728307866 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea60f00640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c0cb040 0x7fea5c0ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439933804 0 0) 0x7fea5c0cc330 con 0x7fea5c15cc60 2023-11-20T07:01:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea48003530 con 0x7fea5c15cc60 2023-11-20T07:01:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3332536467 0 0) 0x7fea48003530 con 0x7fea5c15cc60 2023-11-20T07:01:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c0cb040 msgr2=0x7fea5c0ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:15.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c0cb040 0x7fea5c0ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 >> v1:172.21.15.175:6789/0 conn(0x7fea5c0cebd0 legacy=0x7fea5c0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0cb720 con 0x7fea5c15cc60 2023-11-20T07:01:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fea58001680 con 0x7fea5c15cc60 2023-11-20T07:01:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 >> v1:172.21.15.88:6789/0 conn(0x7fea5c15cc60 legacy=0x7fea5c161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea480039b0 0x7fea48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea480047d0 0x7fea48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c0cb040 0x7fea48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0cefe0 con 0x7fea480047d0 2023-11-20T07:01:15.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4800ba40 con 0x7fea480039b0 2023-11-20T07:01:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4800bc00 con 0x7fea5c0cb040 2023-11-20T07:01:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea60f00640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea480047d0 0x7fea48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea61701640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea480039b0 0x7fea48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea61f02640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c0cb040 0x7fea48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea60f00640 1 -- 172.21.15.88:0/3728307866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c0cb040 msgr2=0x7fea48005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea60f00640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c0cb040 0x7fea48005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea60f00640 1 -- 172.21.15.88:0/3728307866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea480039b0 msgr2=0x7fea48003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea60f00640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea480039b0 0x7fea48003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea60f00640 1 -- 172.21.15.88:0/3728307866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea48003530 con 0x7fea480047d0 2023-11-20T07:01:15.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.966+0000 7fea61f02640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c0cb040 0x7fea48005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:15.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.970+0000 7fea60f00640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea480047d0 0x7fea48004c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009ab0 tx=0x7fea4c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44c751cbe0a7784 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.970+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0a6510 con 0x7fea480047d0 2023-11-20T07:01:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.970+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c0a6670 con 0x7fea480047d0 2023-11-20T07:01:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.970+0000 7fea53fff640 1 -- 172.21.15.88:0/3728307866 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0a6a20 con 0x7fea480047d0 2023-11-20T07:01:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.970+0000 7fea63965640 1 -- 172.21.15.88:0/3728307866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea480047d0 msgr2=0x7fea48004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.970+0000 7fea63965640 1 --2- 172.21.15.88:0/3728307866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea480047d0 0x7fea48004c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009ab0 tx=0x7fea4c01ca10 comp rx=0 tx=0).stop 2023-11-20T07:01:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.970+0000 7fea61f02640 1 -- 172.21.15.88:0/3728307866 reap_dead start 2023-11-20T07:01:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.970+0000 7fea63965640 1 -- 172.21.15.88:0/3728307866 shutdown_connections 2023-11-20T07:01:15.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.970+0000 7fea63965640 1 -- 172.21.15.88:0/3728307866 >> 172.21.15.88:0/3728307866 conn(0x7fea5c06e570 msgr2=0x7fea5c06e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.970+0000 7fea63965640 1 -- 172.21.15.88:0/3728307866 shutdown_connections 2023-11-20T07:01:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.970+0000 7fea63965640 1 -- 172.21.15.88:0/3728307866 wait complete. 2023-11-20T07:01:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea63965640 1 Processor -- start 2023-11-20T07:01:15.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea63965640 1 -- start start 2023-11-20T07:01:15.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea63965640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea480047d0 0x7fea5c14dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea63965640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea5c1f2640 0x7fea5c1e6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea63965640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c1e67d0 0x7fea5c0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea63965640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c1e6c60 con 0x7fea480047d0 2023-11-20T07:01:15.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea63965640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0c8f00 con 0x7fea5c1f2640 2023-11-20T07:01:15.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea63965640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0c82f0 con 0x7fea5c1e67d0 2023-11-20T07:01:15.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea61701640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea480047d0 0x7fea5c14dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea61701640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea480047d0 0x7fea5c14dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39668/0 (socket says 172.21.15.88:39668) 2023-11-20T07:01:15.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea61701640 1 -- 172.21.15.88:0/90128842 learned_addr learned my addr 172.21.15.88:0/90128842 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:15.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea60f00640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea5c1f2640 0x7fea5c1e6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea61f02640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c1e67d0 0x7fea5c0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea61701640 1 -- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c1e67d0 msgr2=0x7fea5c0b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea61701640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c1e67d0 0x7fea5c0b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea61701640 1 -- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea5c1f2640 msgr2=0x7fea5c1e6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:15.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea61701640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea5c1f2640 0x7fea5c1e6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:15.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea61701640 1 -- 172.21.15.88:0/90128842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0c85d0 con 0x7fea480047d0 2023-11-20T07:01:15.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea60f00640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea5c1f2640 0x7fea5c1e6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:15.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea61701640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea480047d0 0x7fea5c14dbc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fea58004880 tx=0x7fea58012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:15.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea51ffb640 1 -- 172.21.15.88:0/90128842 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58014810 con 0x7fea480047d0 2023-11-20T07:01:15.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea51ffb640 1 -- 172.21.15.88:0/90128842 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea580149b0 con 0x7fea480047d0 2023-11-20T07:01:15.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea51ffb640 1 -- 172.21.15.88:0/90128842 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58014d60 con 0x7fea480047d0 2023-11-20T07:01:15.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea63965640 1 -- 172.21.15.88:0/90128842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c0c88b0 con 0x7fea480047d0 2023-11-20T07:01:15.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea63965640 1 -- 172.21.15.88:0/90128842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c14e100 con 0x7fea480047d0 2023-11-20T07:01:15.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.974+0000 7fea63965640 1 -- 172.21.15.88:0/90128842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c04e170 con 0x7fea480047d0 2023-11-20T07:01:15.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.978+0000 7fea51ffb640 1 -- 172.21.15.88:0/90128842 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fea580153e0 con 0x7fea480047d0 2023-11-20T07:01:15.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.978+0000 7fea51ffb640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fea400664d0 0x7fea40068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:15.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.978+0000 7fea51ffb640 1 -- 172.21.15.88:0/90128842 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea58086b60 con 0x7fea480047d0 2023-11-20T07:01:15.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.978+0000 7fea60f00640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fea400664d0 0x7fea40068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:15.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.978+0000 7fea60f00640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fea400664d0 0x7fea40068990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0af000 tx=0x7fea4c0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:15.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:15.982+0000 7fea51ffb640 1 -- 172.21.15.88:0/90128842 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea58053c50 con 0x7fea480047d0 2023-11-20T07:01:16.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.162+0000 7fea63965640 1 -- 172.21.15.88:0/90128842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fea5c0b6830 con 0x7fea480047d0 2023-11-20T07:01:16.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.534+0000 7fea51ffb640 1 -- 172.21.15.88:0/90128842 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fea5801c020 con 0x7fea480047d0 2023-11-20T07:01:16.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.538+0000 7fea63965640 1 -- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fea400664d0 msgr2=0x7fea40068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:16.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.538+0000 7fea63965640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fea400664d0 0x7fea40068990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0af000 tx=0x7fea4c0046d0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.538+0000 7fea63965640 1 -- 172.21.15.88:0/90128842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea480047d0 msgr2=0x7fea5c14dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:16.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.538+0000 7fea63965640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea480047d0 0x7fea5c14dbc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fea58004880 tx=0x7fea58012920 comp rx=0 tx=0).stop 2023-11-20T07:01:16.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.538+0000 7fea63965640 1 -- 172.21.15.88:0/90128842 shutdown_connections 2023-11-20T07:01:16.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.538+0000 7fea63965640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fea400664d0 0x7fea40068990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.538+0000 7fea63965640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea5c1e67d0 0x7fea5c0b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.538+0000 7fea63965640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea5c1f2640 0x7fea5c1e6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.538+0000 7fea63965640 1 --2- 172.21.15.88:0/90128842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea480047d0 0x7fea5c14dbc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.538+0000 7fea63965640 1 -- 172.21.15.88:0/90128842 >> 172.21.15.88:0/90128842 conn(0x7fea5c06e570 msgr2=0x7fea5c0729b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:16.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.538+0000 7fea63965640 1 -- 172.21.15.88:0/90128842 shutdown_connections 2023-11-20T07:01:16.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.538+0000 7fea63965640 1 -- 172.21.15.88:0/90128842 wait complete. 2023-11-20T07:01:16.560 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-11-20T07:01:16.560 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-20T07:01:16.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc41489e640 1 Processor -- start 2023-11-20T07:01:16.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc41489e640 1 -- start start 2023-11-20T07:01:16.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc41489e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc410069e90 0x7fc41006d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:16.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc41489e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc41006a270 0x7fc4100c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:16.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc41489e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc4100702f0 0x7fc410070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:16.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc41489e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4100cb090 con 0x7fc410069e90 2023-11-20T07:01:16.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc41489e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41015ae30 con 0x7fc4100702f0 2023-11-20T07:01:16.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc41489e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100ca510 con 0x7fc41006a270 2023-11-20T07:01:16.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc40e59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc410069e90 0x7fc41006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:16.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc40e59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc410069e90 0x7fc41006d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53774/0 (socket says 172.21.15.88:53774) 2023-11-20T07:01:16.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc40e59c640 1 -- 172.21.15.88:0/2713775448 learned_addr learned my addr 172.21.15.88:0/2713775448 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:16.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc40e59c640 1 -- 172.21.15.88:0/2713775448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc41006a270 msgr2=0x7fc4100c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:16.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc40e59c640 1 --2- 172.21.15.88:0/2713775448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc41006a270 0x7fc4100c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc40e59c640 1 -- 172.21.15.88:0/2713775448 >> v2:172.21.15.175:3300/0 conn(0x7fc4100702f0 msgr2=0x7fc410070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:16.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc40e59c640 1 --2- 172.21.15.88:0/2713775448 >> v2:172.21.15.175:3300/0 conn(0x7fc4100702f0 0x7fc410070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.702+0000 7fc40e59c640 1 -- 172.21.15.88:0/2713775448 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4100ca7f0 con 0x7fc410069e90 2023-11-20T07:01:16.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc40e59c640 1 --2- 172.21.15.88:0/2713775448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc410069e90 0x7fc41006d010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc4100b16e0 tx=0x7fc40001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9060e5ff51b699ff server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:16.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc40dd9b640 1 -- 172.21.15.88:0/2713775448 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4000aa5f0 con 0x7fc410069e90 2023-11-20T07:01:16.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc40dd9b640 1 -- 172.21.15.88:0/2713775448 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4000aa750 con 0x7fc410069e90 2023-11-20T07:01:16.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc40dd9b640 1 -- 172.21.15.88:0/2713775448 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4000aaae0 con 0x7fc410069e90 2023-11-20T07:01:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc41489e640 1 -- 172.21.15.88:0/2713775448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc410069e90 msgr2=0x7fc41006d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc41489e640 1 --2- 172.21.15.88:0/2713775448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc410069e90 0x7fc41006d010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc4100b16e0 tx=0x7fc40001c4d0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc41489e640 1 -- 172.21.15.88:0/2713775448 shutdown_connections 2023-11-20T07:01:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc41489e640 1 --2- 172.21.15.88:0/2713775448 >> v2:172.21.15.175:3300/0 conn(0x7fc4100702f0 0x7fc410070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc41489e640 1 --2- 172.21.15.88:0/2713775448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc41006a270 0x7fc4100c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc41489e640 1 --2- 172.21.15.88:0/2713775448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc410069e90 0x7fc41006d010 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc41489e640 1 -- 172.21.15.88:0/2713775448 >> 172.21.15.88:0/2713775448 conn(0x7fc4100b0da0 msgr2=0x7fc4100ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc41489e640 1 -- 172.21.15.88:0/2713775448 shutdown_connections 2023-11-20T07:01:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.706+0000 7fc41489e640 1 -- 172.21.15.88:0/2713775448 wait complete. 2023-11-20T07:01:16.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc41489e640 1 Processor -- start 2023-11-20T07:01:16.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc41489e640 1 -- start start 2023-11-20T07:01:16.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc41489e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc410069e90 0x7fc4100c1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:16.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc41489e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc41006a270 0x7fc410156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:16.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc41489e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4100702f0 0x7fc410157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:16.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc41489e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc410158540 con 0x7fc41006a270 2023-11-20T07:01:16.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc41489e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4101578c0 con 0x7fc4100702f0 2023-11-20T07:01:16.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc41489e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc410157ba0 con 0x7fc410069e90 2023-11-20T07:01:16.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc405d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc41006a270 0x7fc410156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:16.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc405d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc41006a270 0x7fc410156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53782/0 (socket says 172.21.15.88:53782) 2023-11-20T07:01:16.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc40e59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc410069e90 0x7fc4100c1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc405d9b640 1 -- 172.21.15.88:0/514966581 learned_addr learned my addr 172.21.15.88:0/514966581 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc40ed9d640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4100702f0 0x7fc410157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc405d9b640 1 -- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc410069e90 msgr2=0x7fc4100c1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc405d9b640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc410069e90 0x7fc4100c1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc405d9b640 1 -- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4100702f0 msgr2=0x7fc410157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc405d9b640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4100702f0 0x7fc410157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc405d9b640 1 -- 172.21.15.88:0/514966581 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4000094d0 con 0x7fc41006a270 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc40ed9d640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4100702f0 0x7fc410157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc405d9b640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc41006a270 0x7fc410156d50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800b550 tx=0x7fc3f800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc4077fe640 1 -- 172.21.15.88:0/514966581 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8010870 con 0x7fc41006a270 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc4077fe640 1 -- 172.21.15.88:0/514966581 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f80109f0 con 0x7fc41006a270 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc41489e640 1 -- 172.21.15.88:0/514966581 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc410157e80 con 0x7fc41006a270 2023-11-20T07:01:16.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc4077fe640 1 -- 172.21.15.88:0/514966581 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8010da0 con 0x7fc41006a270 2023-11-20T07:01:16.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.710+0000 7fc41489e640 1 -- 172.21.15.88:0/514966581 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc410153170 con 0x7fc41006a270 2023-11-20T07:01:16.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.714+0000 7fc41489e640 1 -- 172.21.15.88:0/514966581 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41006a690 con 0x7fc41006a270 2023-11-20T07:01:16.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.714+0000 7fc4077fe640 1 -- 172.21.15.88:0/514966581 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc3f800f3c0 con 0x7fc41006a270 2023-11-20T07:01:16.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.714+0000 7fc4077fe640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc3f00664a0 0x7fc3f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:16.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.714+0000 7fc4077fe640 1 -- 172.21.15.88:0/514966581 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc3f8084110 con 0x7fc41006a270 2023-11-20T07:01:16.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.714+0000 7fc40e59c640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc3f00664a0 0x7fc3f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:16.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.714+0000 7fc40e59c640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc3f00664a0 0x7fc3f0068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc4000ae000 tx=0x7fc4000b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:16.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.718+0000 7fc4077fe640 1 -- 172.21.15.88:0/514966581 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc41006a690 con 0x7fc41006a270 2023-11-20T07:01:16.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:16.898+0000 7fc41489e640 1 -- 172.21.15.88:0/514966581 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc410158680 con 0x7fc41006a270 2023-11-20T07:01:17.083 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:01:17.087 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:01:17.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.542+0000 7fc4077fe640 1 -- 172.21.15.88:0/514966581 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc410158680 con 0x7fc41006a270 2023-11-20T07:01:17.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.546+0000 7fc41489e640 1 -- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc3f00664a0 msgr2=0x7fc3f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:17.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.546+0000 7fc41489e640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc3f00664a0 0x7fc3f0068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc4000ae000 tx=0x7fc4000b5040 comp rx=0 tx=0).stop 2023-11-20T07:01:17.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.546+0000 7fc41489e640 1 -- 172.21.15.88:0/514966581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc41006a270 msgr2=0x7fc410156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:17.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.546+0000 7fc41489e640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc41006a270 0x7fc410156d50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800b550 tx=0x7fc3f800ba10 comp rx=0 tx=0).stop 2023-11-20T07:01:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.546+0000 7fc41489e640 1 -- 172.21.15.88:0/514966581 shutdown_connections 2023-11-20T07:01:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.546+0000 7fc41489e640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc3f00664a0 0x7fc3f0068960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.546+0000 7fc41489e640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4100702f0 0x7fc410157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.546+0000 7fc41489e640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc41006a270 0x7fc410156d50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.546+0000 7fc41489e640 1 --2- 172.21.15.88:0/514966581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc410069e90 0x7fc4100c1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.546+0000 7fc41489e640 1 -- 172.21.15.88:0/514966581 >> 172.21.15.88:0/514966581 conn(0x7fc4100b0da0 msgr2=0x7fc4100aec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.546+0000 7fc41489e640 1 -- 172.21.15.88:0/514966581 shutdown_connections 2023-11-20T07:01:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.546+0000 7fc41489e640 1 -- 172.21.15.88:0/514966581 wait complete. 2023-11-20T07:01:17.566 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-20T07:01:17.566 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:01:17.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d72dc640 1 Processor -- start 2023-11-20T07:01:17.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d72dc640 1 -- start start 2023-11-20T07:01:17.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d72dc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43d015cd60 0x7f43d006af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:17.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d72dc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d00d3510 con 0x7f43d015c980 2023-11-20T07:01:17.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d72dc640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d00d2f50 con 0x7f43d00d1490 2023-11-20T07:01:17.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d72dc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00cd2b0 con 0x7f43d015cd60 2023-11-20T07:01:17.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d62da640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f43d015c980 0x7f43d00d0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52424/0 (socket says 172.21.15.88:52424) 2023-11-20T07:01:17.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d62da640 1 -- 172.21.15.88:0/2058935083 learned_addr learned my addr 172.21.15.88:0/2058935083 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:17.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d6adb640 1 --2- 172.21.15.88:0/2058935083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43d015cd60 0x7f43d006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:17.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d52d8640 1 -- 172.21.15.88:0/2058935083 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405882532 0 0) 0x7f43cc0012a0 con 0x7f43d015c980 2023-11-20T07:01:17.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d52d8640 1 -- 172.21.15.88:0/2058935083 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43bc003530 con 0x7f43d015c980 2023-11-20T07:01:17.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d52d8640 1 -- 172.21.15.88:0/2058935083 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084470939 0 0) 0x7f43d00d2f50 con 0x7f43d00d1490 2023-11-20T07:01:17.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d52d8640 1 -- 172.21.15.88:0/2058935083 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43cc0012a0 con 0x7f43d00d1490 2023-11-20T07:01:17.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d6adb640 1 -- 172.21.15.88:0/2058935083 >> v1:172.21.15.175:6789/0 conn(0x7f43d00d1490 legacy=0x7f43d00cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:17.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d6adb640 1 -- 172.21.15.88:0/2058935083 >> v1:172.21.15.88:6789/0 conn(0x7f43d015c980 legacy=0x7f43d00d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:17.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.706+0000 7f43d6adb640 1 -- 172.21.15.88:0/2058935083 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d00d3230 con 0x7f43d015cd60 2023-11-20T07:01:17.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.710+0000 7f43d6adb640 1 --2- 172.21.15.88:0/2058935083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43d015cd60 0x7f43d006af90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009dc0 tx=0x7f43c801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4512bddb8e938166 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.710+0000 7f43d52d8640 1 -- 172.21.15.88:0/2058935083 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c80a59c0 con 0x7f43d015cd60 2023-11-20T07:01:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.710+0000 7f43d52d8640 1 -- 172.21.15.88:0/2058935083 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c80a5b20 con 0x7f43d015cd60 2023-11-20T07:01:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.710+0000 7f43d52d8640 1 -- 172.21.15.88:0/2058935083 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c80ad440 con 0x7f43d015cd60 2023-11-20T07:01:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.710+0000 7f43d72dc640 1 -- 172.21.15.88:0/2058935083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43d015cd60 msgr2=0x7f43d006af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.710+0000 7f43d72dc640 1 --2- 172.21.15.88:0/2058935083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43d015cd60 0x7f43d006af90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009dc0 tx=0x7f43c801c8e0 comp rx=0 tx=0).stop 2023-11-20T07:01:17.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.710+0000 7f43d72dc640 1 -- 172.21.15.88:0/2058935083 shutdown_connections 2023-11-20T07:01:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.710+0000 7f43d72dc640 1 --2- 172.21.15.88:0/2058935083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43d015cd60 0x7f43d006af90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.710+0000 7f43d72dc640 1 -- 172.21.15.88:0/2058935083 >> 172.21.15.88:0/2058935083 conn(0x7f43d009ba80 msgr2=0x7f43d00d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.710+0000 7f43d72dc640 1 -- 172.21.15.88:0/2058935083 shutdown_connections 2023-11-20T07:01:17.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.710+0000 7f43d72dc640 1 -- 172.21.15.88:0/2058935083 wait complete. 2023-11-20T07:01:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d72dc640 1 Processor -- start 2023-11-20T07:01:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d72dc640 1 -- start start 2023-11-20T07:01:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d72dc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d00d1490 0x7f43d009fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d72dc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43d015c980 0x7f43d006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d72dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43d015cd60 0x7f43d006bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:17.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d72dc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d009c700 con 0x7f43d00d1490 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d72dc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d015a9d0 con 0x7f43d015cd60 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d72dc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d015e730 con 0x7f43d015c980 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d62da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d00d1490 0x7f43d009fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d62da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d00d1490 0x7f43d009fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53790/0 (socket says 172.21.15.88:53790) 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d62da640 1 -- 172.21.15.88:0/969663338 learned_addr learned my addr 172.21.15.88:0/969663338 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d5ad9640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43d015c980 0x7f43d006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d6adb640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43d015cd60 0x7f43d006bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d62da640 1 -- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43d015c980 msgr2=0x7f43d006b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d62da640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43d015c980 0x7f43d006b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d62da640 1 -- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43d015cd60 msgr2=0x7f43d006bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d62da640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43d015cd60 0x7f43d006bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d62da640 1 -- 172.21.15.88:0/969663338 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c8009a70 con 0x7f43d00d1490 2023-11-20T07:01:17.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d62da640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d00d1490 0x7f43d009fe50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f43cc001ec0 tx=0x7f43cc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43c6ffd640 1 -- 172.21.15.88:0/969663338 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc007270 con 0x7f43d00d1490 2023-11-20T07:01:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43c6ffd640 1 -- 172.21.15.88:0/969663338 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc0073d0 con 0x7f43d00d1490 2023-11-20T07:01:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43c6ffd640 1 -- 172.21.15.88:0/969663338 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0057b0 con 0x7f43d00d1490 2023-11-20T07:01:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d72dc640 1 -- 172.21.15.88:0/969663338 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d015ea10 con 0x7f43d00d1490 2023-11-20T07:01:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d72dc640 1 -- 172.21.15.88:0/969663338 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d015efd0 con 0x7f43d00d1490 2023-11-20T07:01:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.714+0000 7f43d72dc640 1 -- 172.21.15.88:0/969663338 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d004e9c0 con 0x7f43d00d1490 2023-11-20T07:01:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.718+0000 7f43c6ffd640 1 -- 172.21.15.88:0/969663338 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f43cc005910 con 0x7f43d00d1490 2023-11-20T07:01:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.718+0000 7f43c6ffd640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f43b40664a0 0x7f43b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:17.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.718+0000 7f43c6ffd640 1 -- 172.21.15.88:0/969663338 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f43cc0836e0 con 0x7f43d00d1490 2023-11-20T07:01:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.718+0000 7f43d5ad9640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f43b40664a0 0x7f43b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:17.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.718+0000 7f43d5ad9640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f43b40664a0 0x7f43b4068960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f43d00c92d0 tx=0x7f43c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:17.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.722+0000 7f43c6ffd640 1 -- 172.21.15.88:0/969663338 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f43cc0507f0 con 0x7f43d00d1490 2023-11-20T07:01:17.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 -- 172.21.15.88:0/969663338 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43d00d0870 con 0x7f43d00d1490 2023-11-20T07:01:17.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43c6ffd640 1 -- 172.21.15.88:0/969663338 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f43cc017020 con 0x7f43d00d1490 2023-11-20T07:01:17.903 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:17.903 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/1097293366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1097293366},{"type":"v1","addr":"172.21.15.175:6836","nonce":1097293366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/438678526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":438678526},{"type":"v1","addr":"172.21.15.88:6834","nonce":438678526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1083863684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":1083863684},{"type":"v1","addr":"172.21.15.88:6835","nonce":1083863684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:00:54.012155+0000","modified":"2023-11-20T07:01:16.901950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3413113678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3413113678},{"type":"v1","addr":"172.21.15.175:6837","nonce":3413113678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T07:01:17.903 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-11-20T07:01:17.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 -- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f43b40664a0 msgr2=0x7f43b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:17.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f43b40664a0 0x7f43b4068960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f43d00c92d0 tx=0x7f43c0009040 comp rx=0 tx=0).stop 2023-11-20T07:01:17.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 -- 172.21.15.88:0/969663338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d00d1490 msgr2=0x7f43d009fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:17.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d00d1490 0x7f43d009fe50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f43cc001ec0 tx=0x7f43cc00cb90 comp rx=0 tx=0).stop 2023-11-20T07:01:17.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 -- 172.21.15.88:0/969663338 shutdown_connections 2023-11-20T07:01:17.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f43b40664a0 0x7f43b4068960 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:17.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43d015c980 0x7f43d006b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:17.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43d015cd60 0x7f43d006bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:17.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 --2- 172.21.15.88:0/969663338 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43d00d1490 0x7f43d009fe50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:17.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 -- 172.21.15.88:0/969663338 >> 172.21.15.88:0/969663338 conn(0x7f43d009ba80 msgr2=0x7f43d00c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:17.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 -- 172.21.15.88:0/969663338 shutdown_connections 2023-11-20T07:01:17.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:17.902+0000 7f43d72dc640 1 -- 172.21.15.88:0/969663338 wait complete. 2023-11-20T07:01:17.923 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.058+0000 7f1980f3e640 1 Processor -- start 2023-11-20T07:01:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f1980f3e640 1 -- start start 2023-11-20T07:01:18.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f1980f3e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f197c15cb90 0x7f197c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f1980f3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f197c0d3010 0x7f197c0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f1980f3e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f197c0d1400 0x7f197c0cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f1980f3e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c0d1890 con 0x7f197c0d1400 2023-11-20T07:01:18.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f1980f3e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c0ce770 con 0x7f197c15cb90 2023-11-20T07:01:18.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f1980f3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0d0600 con 0x7f197c0d3010 2023-11-20T07:01:18.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f197ad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f197c0d1400 0x7f197c0cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f197ad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f197c0d1400 0x7f197c0cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53806/0 (socket says 172.21.15.88:53806) 2023-11-20T07:01:18.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f197ad9d640 1 -- 172.21.15.88:0/421410520 learned_addr learned my addr 172.21.15.88:0/421410520 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:18.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f197a59c640 1 --2- 172.21.15.88:0/421410520 >> v2:172.21.15.175:3300/0 conn(0x7f197c15cb90 0x7f197c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f1979d9b640 1 --2- 172.21.15.88:0/421410520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f197c0d3010 0x7f197c0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f197ad9d640 1 -- 172.21.15.88:0/421410520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f197c0d3010 msgr2=0x7f197c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:18.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f197ad9d640 1 --2- 172.21.15.88:0/421410520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f197c0d3010 0x7f197c0d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f197ad9d640 1 -- 172.21.15.88:0/421410520 >> v2:172.21.15.175:3300/0 conn(0x7f197c15cb90 msgr2=0x7f197c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:18.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f197ad9d640 1 --2- 172.21.15.88:0/421410520 >> v2:172.21.15.175:3300/0 conn(0x7f197c15cb90 0x7f197c0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f197ad9d640 1 -- 172.21.15.88:0/421410520 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c0c6450 con 0x7f197c0d1400 2023-11-20T07:01:18.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.062+0000 7f1979d9b640 1 --2- 172.21.15.88:0/421410520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f197c0d3010 0x7f197c0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:18.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f197ad9d640 1 --2- 172.21.15.88:0/421410520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f197c0d1400 0x7f197c0cd3d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f197c08ba70 tx=0x7f197401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c65cbc62cb594ca server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:18.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f197959a640 1 -- 172.21.15.88:0/421410520 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19740a5790 con 0x7f197c0d1400 2023-11-20T07:01:18.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f197959a640 1 -- 172.21.15.88:0/421410520 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19740a58f0 con 0x7f197c0d1400 2023-11-20T07:01:18.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f197959a640 1 -- 172.21.15.88:0/421410520 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19740a5c80 con 0x7f197c0d1400 2023-11-20T07:01:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f1980f3e640 1 -- 172.21.15.88:0/421410520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f197c0d1400 msgr2=0x7f197c0cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f1980f3e640 1 --2- 172.21.15.88:0/421410520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f197c0d1400 0x7f197c0cd3d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f197c08ba70 tx=0x7f197401c910 comp rx=0 tx=0).stop 2023-11-20T07:01:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f1980f3e640 1 -- 172.21.15.88:0/421410520 shutdown_connections 2023-11-20T07:01:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f1980f3e640 1 --2- 172.21.15.88:0/421410520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f197c0d1400 0x7f197c0cd3d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f1980f3e640 1 --2- 172.21.15.88:0/421410520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f197c0d3010 0x7f197c0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f1980f3e640 1 --2- 172.21.15.88:0/421410520 >> v2:172.21.15.175:3300/0 conn(0x7f197c15cb90 0x7f197c0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f1980f3e640 1 -- 172.21.15.88:0/421410520 >> 172.21.15.88:0/421410520 conn(0x7f197c09bc50 msgr2=0x7f197c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f1980f3e640 1 -- 172.21.15.88:0/421410520 shutdown_connections 2023-11-20T07:01:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f1980f3e640 1 -- 172.21.15.88:0/421410520 wait complete. 2023-11-20T07:01:18.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.066+0000 7f1980f3e640 1 Processor -- start 2023-11-20T07:01:18.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1980f3e640 1 -- start start 2023-11-20T07:01:18.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1980f3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f197c0d1400 0x7f197c14b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1980f3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f197c0d3010 0x7f197c1498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1980f3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f197c15cb90 0x7f197c0b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1980f3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c158680 con 0x7f197c0d3010 2023-11-20T07:01:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1980f3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c15b580 con 0x7f197c0d1400 2023-11-20T07:01:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1980f3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c1583a0 con 0x7f197c15cb90 2023-11-20T07:01:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1979d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f197c0d3010 0x7f197c1498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1979d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f197c0d3010 0x7f197c1498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53818/0 (socket says 172.21.15.88:53818) 2023-11-20T07:01:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1979d9b640 1 -- 172.21.15.88:0/2019769778 learned_addr learned my addr 172.21.15.88:0/2019769778 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:18.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f197a59c640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f197c0d1400 0x7f197c14b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f197ad9d640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f197c15cb90 0x7f197c0b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1979d9b640 1 -- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f197c15cb90 msgr2=0x7f197c0b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1979d9b640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f197c15cb90 0x7f197c0b7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1979d9b640 1 -- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f197c0d1400 msgr2=0x7f197c14b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1979d9b640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f197c0d1400 0x7f197c14b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1979d9b640 1 -- 172.21.15.88:0/2019769778 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974009b30 con 0x7f197c0d3010 2023-11-20T07:01:18.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f197a59c640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f197c0d1400 0x7f197c14b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:18.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1979d9b640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f197c0d3010 0x7f197c1498b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f197000e810 tx=0x7f197000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:18.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f196affd640 1 -- 172.21.15.88:0/2019769778 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000c8d0 con 0x7f197c0d3010 2023-11-20T07:01:18.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f196affd640 1 -- 172.21.15.88:0/2019769778 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197000ca30 con 0x7f197c0d3010 2023-11-20T07:01:18.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1980f3e640 1 -- 172.21.15.88:0/2019769778 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c15af30 con 0x7f197c0d3010 2023-11-20T07:01:18.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f196affd640 1 -- 172.21.15.88:0/2019769778 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000cdc0 con 0x7f197c0d3010 2023-11-20T07:01:18.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1980f3e640 1 -- 172.21.15.88:0/2019769778 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c15ba10 con 0x7f197c0d3010 2023-11-20T07:01:18.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.070+0000 7f1980f3e640 1 -- 172.21.15.88:0/2019769778 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197c15ad90 con 0x7f197c0d3010 2023-11-20T07:01:18.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.074+0000 7f196affd640 1 -- 172.21.15.88:0/2019769778 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1970013410 con 0x7f197c0d3010 2023-11-20T07:01:18.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.074+0000 7f196affd640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f195c0664d0 0x7f195c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.074+0000 7f196affd640 1 -- 172.21.15.88:0/2019769778 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1970083ff0 con 0x7f197c0d3010 2023-11-20T07:01:18.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.074+0000 7f197a59c640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f195c0664d0 0x7f195c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.074+0000 7f197a59c640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f195c0664d0 0x7f195c068990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f196c009a70 tx=0x7f196c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:18.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.078+0000 7f196affd640 1 -- 172.21.15.88:0/2019769778 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f197c15ad90 con 0x7f197c0d3010 2023-11-20T07:01:18.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.226+0000 7f1980f3e640 1 -- 172.21.15.88:0/2019769778 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f197c15ad90 con 0x7f197c0d3010 2023-11-20T07:01:18.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f196affd640 1 -- 172.21.15.88:0/2019769778 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f197c15ad90 con 0x7f197c0d3010 2023-11-20T07:01:18.230 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:18.230 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:18.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f1980f3e640 1 -- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f195c0664d0 msgr2=0x7f195c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f1980f3e640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f195c0664d0 0x7f195c068990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f196c009a70 tx=0x7f196c008040 comp rx=0 tx=0).stop 2023-11-20T07:01:18.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f1980f3e640 1 -- 172.21.15.88:0/2019769778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f197c0d3010 msgr2=0x7f197c1498b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f1980f3e640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f197c0d3010 0x7f197c1498b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f197000e810 tx=0x7f197000ecd0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f1980f3e640 1 -- 172.21.15.88:0/2019769778 shutdown_connections 2023-11-20T07:01:18.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f1980f3e640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f195c0664d0 0x7f195c068990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f1980f3e640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f197c15cb90 0x7f197c0b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f1980f3e640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f197c0d3010 0x7f197c1498b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f1980f3e640 1 --2- 172.21.15.88:0/2019769778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f197c0d1400 0x7f197c14b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f1980f3e640 1 -- 172.21.15.88:0/2019769778 >> 172.21.15.88:0/2019769778 conn(0x7f197c09bc50 msgr2=0x7f197c0b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:18.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f1980f3e640 1 -- 172.21.15.88:0/2019769778 shutdown_connections 2023-11-20T07:01:18.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.230+0000 7f1980f3e640 1 -- 172.21.15.88:0/2019769778 wait complete. 2023-11-20T07:01:18.251 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-20T07:01:18.251 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T07:01:18.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.390+0000 7f3154268640 1 Processor -- start 2023-11-20T07:01:18.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.390+0000 7f3154268640 1 -- start start 2023-11-20T07:01:18.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3154268640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f314c159170 0x7f314c06e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3154268640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f314c0ca650 0x7f314c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3154268640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f314c0702f0 0x7f314c070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3154268640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c070cc0 con 0x7f314c0ca650 2023-11-20T07:01:18.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3154268640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c0ca1c0 con 0x7f314c0702f0 2023-11-20T07:01:18.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3154268640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c159550 con 0x7f314c159170 2023-11-20T07:01:18.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3151803640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f314c0ca650 0x7f314c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3151803640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f314c0ca650 0x7f314c0c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53830/0 (socket says 172.21.15.88:53830) 2023-11-20T07:01:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3151803640 1 -- 172.21.15.88:0/1914742212 learned_addr learned my addr 172.21.15.88:0/1914742212 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3152805640 1 --2- 172.21.15.88:0/1914742212 >> v2:172.21.15.175:3300/0 conn(0x7f314c0702f0 0x7f314c070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3152004640 1 --2- 172.21.15.88:0/1914742212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f314c159170 0x7f314c06e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3151803640 1 -- 172.21.15.88:0/1914742212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f314c159170 msgr2=0x7f314c06e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3151803640 1 --2- 172.21.15.88:0/1914742212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f314c159170 0x7f314c06e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3151803640 1 -- 172.21.15.88:0/1914742212 >> v2:172.21.15.175:3300/0 conn(0x7f314c0702f0 msgr2=0x7f314c070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3151803640 1 --2- 172.21.15.88:0/1914742212 >> v2:172.21.15.175:3300/0 conn(0x7f314c0702f0 0x7f314c070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3151803640 1 -- 172.21.15.88:0/1914742212 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c0c9310 con 0x7f314c0ca650 2023-11-20T07:01:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3152004640 1 --2- 172.21.15.88:0/1914742212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f314c159170 0x7f314c06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:18.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.394+0000 7f3152805640 1 --2- 172.21.15.88:0/1914742212 >> v2:172.21.15.175:3300/0 conn(0x7f314c0702f0 0x7f314c070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:18.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3151803640 1 --2- 172.21.15.88:0/1914742212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c0ca650 0x7f314c0c8dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f314c06e740 tx=0x7f313c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99d073f621d589f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:18.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3151002640 1 -- 172.21.15.88:0/1914742212 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c0ab610 con 0x7f314c0ca650 2023-11-20T07:01:18.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3151002640 1 -- 172.21.15.88:0/1914742212 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c0ab770 con 0x7f314c0ca650 2023-11-20T07:01:18.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3151002640 1 -- 172.21.15.88:0/1914742212 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c0abb00 con 0x7f314c0ca650 2023-11-20T07:01:18.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3154268640 1 -- 172.21.15.88:0/1914742212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c0ca650 msgr2=0x7f314c0c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3154268640 1 --2- 172.21.15.88:0/1914742212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c0ca650 0x7f314c0c8dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f314c06e740 tx=0x7f313c01c4d0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3154268640 1 -- 172.21.15.88:0/1914742212 shutdown_connections 2023-11-20T07:01:18.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3154268640 1 --2- 172.21.15.88:0/1914742212 >> v2:172.21.15.175:3300/0 conn(0x7f314c0702f0 0x7f314c070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3154268640 1 --2- 172.21.15.88:0/1914742212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c0ca650 0x7f314c0c8dd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3154268640 1 --2- 172.21.15.88:0/1914742212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f314c159170 0x7f314c06e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3154268640 1 -- 172.21.15.88:0/1914742212 >> 172.21.15.88:0/1914742212 conn(0x7f314c0b0d30 msgr2=0x7f314c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:18.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3154268640 1 -- 172.21.15.88:0/1914742212 shutdown_connections 2023-11-20T07:01:18.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.398+0000 7f3154268640 1 -- 172.21.15.88:0/1914742212 wait complete. 2023-11-20T07:01:18.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3154268640 1 Processor -- start 2023-11-20T07:01:18.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3154268640 1 -- start start 2023-11-20T07:01:18.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3154268640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f314c0702f0 0x7f314c1596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3154268640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f314c0ca650 0x7f314c1538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3154268640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c159170 0x7f314c0b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3154268640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c15aa10 con 0x7f314c159170 2023-11-20T07:01:18.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3154268640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c153de0 con 0x7f314c0702f0 2023-11-20T07:01:18.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3154268640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c159e00 con 0x7f314c0ca650 2023-11-20T07:01:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3152805640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c159170 0x7f314c0b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3152805640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c159170 0x7f314c0b13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53842/0 (socket says 172.21.15.88:53842) 2023-11-20T07:01:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3152805640 1 -- 172.21.15.88:0/3665823468 learned_addr learned my addr 172.21.15.88:0/3665823468 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3152004640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f314c0702f0 0x7f314c1596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3151803640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f314c0ca650 0x7f314c1538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3152805640 1 -- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f314c0ca650 msgr2=0x7f314c1538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3152805640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f314c0ca650 0x7f314c1538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3152805640 1 -- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f314c0702f0 msgr2=0x7f314c1596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3152805640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f314c0702f0 0x7f314c1596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3152805640 1 -- 172.21.15.88:0/3665823468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c0094d0 con 0x7f314c159170 2023-11-20T07:01:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3152805640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c159170 0x7f314c0b13b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3144007e40 tx=0x7f314400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:18.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3142ffd640 1 -- 172.21.15.88:0/3665823468 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144003ba0 con 0x7f314c159170 2023-11-20T07:01:18.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3142ffd640 1 -- 172.21.15.88:0/3665823468 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314400f040 con 0x7f314c159170 2023-11-20T07:01:18.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3142ffd640 1 -- 172.21.15.88:0/3665823468 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314400de80 con 0x7f314c159170 2023-11-20T07:01:18.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3154268640 1 -- 172.21.15.88:0/3665823468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c15a0e0 con 0x7f314c159170 2023-11-20T07:01:18.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3154268640 1 -- 172.21.15.88:0/3665823468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c15a6a0 con 0x7f314c159170 2023-11-20T07:01:18.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.402+0000 7f3154268640 1 -- 172.21.15.88:0/3665823468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c15abc0 con 0x7f314c159170 2023-11-20T07:01:18.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.406+0000 7f3142ffd640 1 -- 172.21.15.88:0/3665823468 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3144004030 con 0x7f314c159170 2023-11-20T07:01:18.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.406+0000 7f3142ffd640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31300664a0 0x7f3130068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.406+0000 7f3142ffd640 1 -- 172.21.15.88:0/3665823468 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3144084470 con 0x7f314c159170 2023-11-20T07:01:18.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.406+0000 7f3152004640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31300664a0 0x7f3130068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.406+0000 7f3152004640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31300664a0 0x7f3130068960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f314c0cee60 tx=0x7f3148008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:18.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.410+0000 7f3142ffd640 1 -- 172.21.15.88:0/3665823468 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f314c15abc0 con 0x7f314c159170 2023-11-20T07:01:18.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.558+0000 7f3154268640 1 -- 172.21.15.88:0/3665823468 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f314c0c9e50 con 0x7f31300664a0 2023-11-20T07:01:18.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.570+0000 7f3142ffd640 1 -- 172.21.15.88:0/3665823468 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345325 (secure 0 0 0) 0x7f314800b850 con 0x7f31300664a0 2023-11-20T07:01:18.573 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:18.577 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-20T07:01:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.574+0000 7f3154268640 1 -- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31300664a0 msgr2=0x7f3130068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.574+0000 7f3154268640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31300664a0 0x7f3130068960 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f314c0cee60 tx=0x7f3148008040 comp rx=0 tx=0).stop 2023-11-20T07:01:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.574+0000 7f3154268640 1 -- 172.21.15.88:0/3665823468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c159170 msgr2=0x7f314c0b13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.574+0000 7f3154268640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c159170 0x7f314c0b13b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3144007e40 tx=0x7f314400d4a0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.574+0000 7f3154268640 1 -- 172.21.15.88:0/3665823468 shutdown_connections 2023-11-20T07:01:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.574+0000 7f3154268640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31300664a0 0x7f3130068960 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.574+0000 7f3154268640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f314c0ca650 0x7f314c1538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.574+0000 7f3154268640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f314c159170 0x7f314c0b13b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.574+0000 7f3154268640 1 --2- 172.21.15.88:0/3665823468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f314c0702f0 0x7f314c1596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.574+0000 7f3154268640 1 -- 172.21.15.88:0/3665823468 >> 172.21.15.88:0/3665823468 conn(0x7f314c0b0d30 msgr2=0x7f314c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.574+0000 7f3154268640 1 -- 172.21.15.88:0/3665823468 shutdown_connections 2023-11-20T07:01:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.574+0000 7f3154268640 1 -- 172.21.15.88:0/3665823468 wait complete. 2023-11-20T07:01:18.596 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-11-20T07:01:17.536354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3284992,"data_stored":1988254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003362"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326844+0000","last_change":"2023-11-20T07:00:53.659408+0000","last_active":"2023-11-20T07:00:58.326844+0000","last_peered":"2023-11-20T07:00:58.326844+0000","last_clean":"2023-11-20T07:00:58.326844+0000","last_became_active":"2023-11-20T07:00:53.658981+0000","last_became_peered":"2023-11-20T07:00:53.658981+0000","last_unstale":"2023-11-20T07:00:58.326844+0000","last_undegraded":"2023-11-20T07:00:58.326844+0000","last_fullsized":"2023-11-20T07:00:58.326844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:10.249731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.304069+0000","last_change":"2023-11-20T07:00:54.314501+0000","last_active":"2023-11-20T07:00:58.304069+0000","last_peered":"2023-11-20T07:00:58.304069+0000","last_clean":"2023-11-20T07:00:58.304069+0000","last_became_active":"2023-11-20T07:00:54.314212+0000","last_became_peered":"2023-11-20T07:00:54.314212+0000","last_unstale":"2023-11-20T07:00:58.304069+0000","last_undegraded":"2023-11-20T07:00:58.304069+0000","last_fullsized":"2023-11-20T07:00:58.304069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:43.757635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805339+0000","last_change":"2023-11-20T07:00:58.500585+0000","last_active":"2023-11-20T07:00:59.805339+0000","last_peered":"2023-11-20T07:00:59.805339+0000","last_clean":"2023-11-20T07:00:59.805339+0000","last_became_active":"2023-11-20T07:00:58.500209+0000","last_became_peered":"2023-11-20T07:00:58.500209+0000","last_unstale":"2023-11-20T07:00:59.805339+0000","last_undegraded":"2023-11-20T07:00:59.805339+0000","last_fullsized":"2023-11-20T07:00:59.805339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:10:13.701470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.304262+0000","last_change":"2023-11-20T07:00:53.652110+0000","last_active":"2023-11-20T07:00:58.304262+0000","last_peered":"2023-11-20T07:00:58.304262+0000","last_clean":"2023-11-20T07:00:58.304262+0000","last_became_active":"2023-11-20T07:00:53.651824+0000","last_became_peered":"2023-11-20T07:00:53.651824+0000","last_unstale":"2023-11-20T07:00:58.304262+0000","last_undegraded":"2023-11-20T07:00:58.304262+0000","last_fullsized":"2023-11-20T07:00:58.304262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:16.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326690+0000","last_change":"2023-11-20T07:00:54.318618+0000","last_active":"2023-11-20T07:00:58.326690+0000","last_peered":"2023-11-20T07:00:58.326690+0000","last_clean":"2023-11-20T07:00:58.326690+0000","last_became_active":"2023-11-20T07:00:54.318411+0000","last_became_peered":"2023-11-20T07:00:54.318411+0000","last_unstale":"2023-11-20T07:00:58.326690+0000","last_undegraded":"2023-11-20T07:00:58.326690+0000","last_fullsized":"2023-11-20T07:00:58.326690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:16.073686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307275+0000","last_change":"2023-11-20T07:00:58.320861+0000","last_active":"2023-11-20T07:00:59.307275+0000","last_peered":"2023-11-20T07:00:59.307275+0000","last_clean":"2023-11-20T07:00:59.307275+0000","last_became_active":"2023-11-20T07:00:58.320417+0000","last_became_peered":"2023-11-20T07:00:58.320417+0000","last_unstale":"2023-11-20T07:00:59.307275+0000","last_undegraded":"2023-11-20T07:00:59.307275+0000","last_fullsized":"2023-11-20T07:00:59.307275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:22.712728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494050+0000","last_change":"2023-11-20T07:00:53.656292+0000","last_active":"2023-11-20T07:00:58.494050+0000","last_peered":"2023-11-20T07:00:58.494050+0000","last_clean":"2023-11-20T07:00:58.494050+0000","last_became_active":"2023-11-20T07:00:53.656026+0000","last_became_peered":"2023-11-20T07:00:53.656026+0000","last_unstale":"2023-11-20T07:00:58.494050+0000","last_undegraded":"2023-11-20T07:00:58.494050+0000","last_fullsized":"2023-11-20T07:00:58.494050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:38.340586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317862+0000","last_change":"2023-11-20T07:00:54.322765+0000","last_active":"2023-11-20T07:00:58.317862+0000","last_peered":"2023-11-20T07:00:58.317862+0000","last_clean":"2023-11-20T07:00:58.317862+0000","last_became_active":"2023-11-20T07:00:54.322547+0000","last_became_peered":"2023-11-20T07:00:54.322547+0000","last_unstale":"2023-11-20T07:00:58.317862+0000","last_undegraded":"2023-11-20T07:00:58.317862+0000","last_fullsized":"2023-11-20T07:00:58.317862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:41:56.805008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307365+0000","last_change":"2023-11-20T07:00:58.325322+0000","last_active":"2023-11-20T07:00:59.307365+0000","last_peered":"2023-11-20T07:00:59.307365+0000","last_clean":"2023-11-20T07:00:59.307365+0000","last_became_active":"2023-11-20T07:00:58.324869+0000","last_became_peered":"2023-11-20T07:00:58.324869+0000","last_unstale":"2023-11-20T07:00:59.307365+0000","last_undegraded":"2023-11-20T07:00:59.307365+0000","last_fullsized":"2023-11-20T07:00:59.307365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:43.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493286+0000","last_change":"2023-11-20T07:00:53.661990+0000","last_active":"2023-11-20T07:00:58.493286+0000","last_peered":"2023-11-20T07:00:58.493286+0000","last_clean":"2023-11-20T07:00:58.493286+0000","last_became_active":"2023-11-20T07:00:53.661634+0000","last_became_peered":"2023-11-20T07:00:53.661634+0000","last_unstale":"2023-11-20T07:00:58.493286+0000","last_undegraded":"2023-11-20T07:00:58.493286+0000","last_fullsized":"2023-11-20T07:00:58.493286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:44.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318481+0000","last_change":"2023-11-20T07:00:54.322610+0000","last_active":"2023-11-20T07:00:58.318481+0000","last_peered":"2023-11-20T07:00:58.318481+0000","last_clean":"2023-11-20T07:00:58.318481+0000","last_became_active":"2023-11-20T07:00:54.322196+0000","last_became_peered":"2023-11-20T07:00:54.322196+0000","last_unstale":"2023-11-20T07:00:58.318481+0000","last_undegraded":"2023-11-20T07:00:58.318481+0000","last_fullsized":"2023-11-20T07:00:58.318481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:34.029377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307622+0000","last_change":"2023-11-20T07:00:58.326848+0000","last_active":"2023-11-20T07:00:59.307622+0000","last_peered":"2023-11-20T07:00:59.307622+0000","last_clean":"2023-11-20T07:00:59.307622+0000","last_became_active":"2023-11-20T07:00:58.326426+0000","last_became_peered":"2023-11-20T07:00:58.326426+0000","last_unstale":"2023-11-20T07:00:59.307622+0000","last_undegraded":"2023-11-20T07:00:59.307622+0000","last_fullsized":"2023-11-20T07:00:59.307622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:21.571196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310719+0000","last_change":"2023-11-20T07:00:54.313413+0000","last_active":"2023-11-20T07:00:58.310719+0000","last_peered":"2023-11-20T07:00:58.310719+0000","last_clean":"2023-11-20T07:00:58.310719+0000","last_became_active":"2023-11-20T07:00:54.311349+0000","last_became_peered":"2023-11-20T07:00:54.311349+0000","last_unstale":"2023-11-20T07:00:58.310719+0000","last_undegraded":"2023-11-20T07:00:58.310719+0000","last_fullsized":"2023-11-20T07:00:58.310719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493287+0000","last_change":"2023-11-20T07:00:53.653466+0000","last_active":"2023-11-20T07:00:58.493287+0000","last_peered":"2023-11-20T07:00:58.493287+0000","last_clean":"2023-11-20T07:00:58.493287+0000","last_became_active":"2023-11-20T07:00:53.653211+0000","last_became_peered":"2023-11-20T07:00:53.653211+0000","last_unstale":"2023-11-20T07:00:58.493287+0000","last_undegraded":"2023-11-20T07:00:58.493287+0000","last_fullsized":"2023-11-20T07:00:58.493287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308698+0000","last_change":"2023-11-20T07:00:58.326758+0000","last_active":"2023-11-20T07:00:59.308698+0000","last_peered":"2023-11-20T07:00:59.308698+0000","last_clean":"2023-11-20T07:00:59.308698+0000","last_became_active":"2023-11-20T07:00:58.326338+0000","last_became_peered":"2023-11-20T07:00:58.326338+0000","last_unstale":"2023-11-20T07:00:59.308698+0000","last_undegraded":"2023-11-20T07:00:59.308698+0000","last_fullsized":"2023-11-20T07:00:59.308698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:37.701282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303367+0000","last_change":"2023-11-20T07:00:54.316618+0000","last_active":"2023-11-20T07:00:58.303367+0000","last_peered":"2023-11-20T07:00:58.303367+0000","last_clean":"2023-11-20T07:00:58.303367+0000","last_became_active":"2023-11-20T07:00:54.316344+0000","last_became_peered":"2023-11-20T07:00:54.316344+0000","last_unstale":"2023-11-20T07:00:58.303367+0000","last_undegraded":"2023-11-20T07:00:58.303367+0000","last_fullsized":"2023-11-20T07:00:58.303367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.319497+0000","last_change":"2023-11-20T07:00:53.648232+0000","last_active":"2023-11-20T07:00:58.319497+0000","last_peered":"2023-11-20T07:00:58.319497+0000","last_clean":"2023-11-20T07:00:58.319497+0000","last_became_active":"2023-11-20T07:00:53.647945+0000","last_became_peered":"2023-11-20T07:00:53.647945+0000","last_unstale":"2023-11-20T07:00:58.319497+0000","last_undegraded":"2023-11-20T07:00:58.319497+0000","last_fullsized":"2023-11-20T07:00:58.319497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:23:16.836796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308291+0000","last_change":"2023-11-20T07:00:58.328131+0000","last_active":"2023-11-20T07:00:59.308291+0000","last_peered":"2023-11-20T07:00:59.308291+0000","last_clean":"2023-11-20T07:00:59.308291+0000","last_became_active":"2023-11-20T07:00:58.327741+0000","last_became_peered":"2023-11-20T07:00:58.327741+0000","last_unstale":"2023-11-20T07:00:59.308291+0000","last_undegraded":"2023-11-20T07:00:59.308291+0000","last_fullsized":"2023-11-20T07:00:59.308291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:12.994548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303298+0000","last_change":"2023-11-20T07:00:54.310162+0000","last_active":"2023-11-20T07:00:58.303298+0000","last_peered":"2023-11-20T07:00:58.303298+0000","last_clean":"2023-11-20T07:00:58.303298+0000","last_became_active":"2023-11-20T07:00:54.309901+0000","last_became_peered":"2023-11-20T07:00:54.309901+0000","last_unstale":"2023-11-20T07:00:58.303298+0000","last_undegraded":"2023-11-20T07:00:58.303298+0000","last_fullsized":"2023-11-20T07:00:58.303298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316319+0000","last_change":"2023-11-20T07:00:53.647565+0000","last_active":"2023-11-20T07:00:58.316319+0000","last_peered":"2023-11-20T07:00:58.316319+0000","last_clean":"2023-11-20T07:00:58.316319+0000","last_became_active":"2023-11-20T07:00:53.647292+0000","last_became_peered":"2023-11-20T07:00:53.647292+0000","last_unstale":"2023-11-20T07:00:58.316319+0000","last_undegraded":"2023-11-20T07:00:58.316319+0000","last_fullsized":"2023-11-20T07:00:58.316319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:06.154369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.808266+0000","last_change":"2023-11-20T07:00:58.499121+0000","last_active":"2023-11-20T07:00:59.808266+0000","last_peered":"2023-11-20T07:00:59.808266+0000","last_clean":"2023-11-20T07:00:59.808266+0000","last_became_active":"2023-11-20T07:00:58.498681+0000","last_became_peered":"2023-11-20T07:00:58.498681+0000","last_unstale":"2023-11-20T07:00:59.808266+0000","last_undegraded":"2023-11-20T07:00:59.808266+0000","last_fullsized":"2023-11-20T07:00:59.808266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:19:25.697324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310377+0000","last_change":"2023-11-20T07:00:54.307003+0000","last_active":"2023-11-20T07:00:58.310377+0000","last_peered":"2023-11-20T07:00:58.310377+0000","last_clean":"2023-11-20T07:00:58.310377+0000","last_became_active":"2023-11-20T07:00:54.306416+0000","last_became_peered":"2023-11-20T07:00:54.306416+0000","last_unstale":"2023-11-20T07:00:58.310377+0000","last_undegraded":"2023-11-20T07:00:58.310377+0000","last_fullsized":"2023-11-20T07:00:58.310377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:00:19.316968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.492960+0000","last_change":"2023-11-20T07:00:53.658929+0000","last_active":"2023-11-20T07:00:58.492960+0000","last_peered":"2023-11-20T07:00:58.492960+0000","last_clean":"2023-11-20T07:00:58.492960+0000","last_became_active":"2023-11-20T07:00:53.656722+0000","last_became_peered":"2023-11-20T07:00:53.656722+0000","last_unstale":"2023-11-20T07:00:58.492960+0000","last_undegraded":"2023-11-20T07:00:58.492960+0000","last_fullsized":"2023-11-20T07:00:58.492960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:18.352244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308589+0000","last_change":"2023-11-20T07:00:58.328021+0000","last_active":"2023-11-20T07:00:59.308589+0000","last_peered":"2023-11-20T07:00:59.308589+0000","last_clean":"2023-11-20T07:00:59.308589+0000","last_became_active":"2023-11-20T07:00:58.327571+0000","last_became_peered":"2023-11-20T07:00:58.327571+0000","last_unstale":"2023-11-20T07:00:59.308589+0000","last_undegraded":"2023-11-20T07:00:59.308589+0000","last_fullsized":"2023-11-20T07:00:59.308589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:45.316086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326462+0000","last_change":"2023-11-20T07:00:54.307130+0000","last_active":"2023-11-20T07:00:58.326462+0000","last_peered":"2023-11-20T07:00:58.326462+0000","last_clean":"2023-11-20T07:00:58.326462+0000","last_became_active":"2023-11-20T07:00:54.306858+0000","last_became_peered":"2023-11-20T07:00:54.306858+0000","last_unstale":"2023-11-20T07:00:58.326462+0000","last_undegraded":"2023-11-20T07:00:58.326462+0000","last_fullsized":"2023-11-20T07:00:58.326462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:07.160493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311818+0000","last_change":"2023-11-20T07:00:53.658355+0000","last_active":"2023-11-20T07:00:58.311818+0000","last_peered":"2023-11-20T07:00:58.311818+0000","last_clean":"2023-11-20T07:00:58.311818+0000","last_became_active":"2023-11-20T07:00:53.657868+0000","last_became_peered":"2023-11-20T07:00:53.657868+0000","last_unstale":"2023-11-20T07:00:58.311818+0000","last_undegraded":"2023-11-20T07:00:58.311818+0000","last_fullsized":"2023-11-20T07:00:58.311818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308040+0000","last_change":"2023-11-20T07:00:58.500426+0000","last_active":"2023-11-20T07:00:59.308040+0000","last_peered":"2023-11-20T07:00:59.308040+0000","last_clean":"2023-11-20T07:00:59.308040+0000","last_became_active":"2023-11-20T07:00:58.498422+0000","last_became_peered":"2023-11-20T07:00:58.498422+0000","last_unstale":"2023-11-20T07:00:59.308040+0000","last_undegraded":"2023-11-20T07:00:59.308040+0000","last_fullsized":"2023-11-20T07:00:59.308040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:47.429541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.305106+0000","last_change":"2023-11-20T07:00:54.317201+0000","last_active":"2023-11-20T07:00:58.305106+0000","last_peered":"2023-11-20T07:00:58.305106+0000","last_clean":"2023-11-20T07:00:58.305106+0000","last_became_active":"2023-11-20T07:00:54.316914+0000","last_became_peered":"2023-11-20T07:00:54.316914+0000","last_unstale":"2023-11-20T07:00:58.305106+0000","last_undegraded":"2023-11-20T07:00:58.305106+0000","last_fullsized":"2023-11-20T07:00:58.305106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:09.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316138+0000","last_change":"2023-11-20T07:00:53.645493+0000","last_active":"2023-11-20T07:00:58.316138+0000","last_peered":"2023-11-20T07:00:58.316138+0000","last_clean":"2023-11-20T07:00:58.316138+0000","last_became_active":"2023-11-20T07:00:53.644350+0000","last_became_peered":"2023-11-20T07:00:53.644350+0000","last_unstale":"2023-11-20T07:00:58.316138+0000","last_undegraded":"2023-11-20T07:00:58.316138+0000","last_fullsized":"2023-11-20T07:00:58.316138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806145+0000","last_change":"2023-11-20T07:00:58.499371+0000","last_active":"2023-11-20T07:00:59.806145+0000","last_peered":"2023-11-20T07:00:59.806145+0000","last_clean":"2023-11-20T07:00:59.806145+0000","last_became_active":"2023-11-20T07:00:58.498953+0000","last_became_peered":"2023-11-20T07:00:58.498953+0000","last_unstale":"2023-11-20T07:00:59.806145+0000","last_undegraded":"2023-11-20T07:00:59.806145+0000","last_fullsized":"2023-11-20T07:00:59.806145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:03:22.099699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318416+0000","last_change":"2023-11-20T07:00:54.309275+0000","last_active":"2023-11-20T07:00:58.318416+0000","last_peered":"2023-11-20T07:00:58.318416+0000","last_clean":"2023-11-20T07:00:58.318416+0000","last_became_active":"2023-11-20T07:00:54.309012+0000","last_became_peered":"2023-11-20T07:00:54.309012+0000","last_unstale":"2023-11-20T07:00:58.318416+0000","last_undegraded":"2023-11-20T07:00:58.318416+0000","last_fullsized":"2023-11-20T07:00:58.318416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494554+0000","last_change":"2023-11-20T07:00:53.654465+0000","last_active":"2023-11-20T07:00:58.494554+0000","last_peered":"2023-11-20T07:00:58.494554+0000","last_clean":"2023-11-20T07:00:58.494554+0000","last_became_active":"2023-11-20T07:00:53.654148+0000","last_became_peered":"2023-11-20T07:00:53.654148+0000","last_unstale":"2023-11-20T07:00:58.494554+0000","last_undegraded":"2023-11-20T07:00:58.494554+0000","last_fullsized":"2023-11-20T07:00:58.494554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:38.670481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806267+0000","last_change":"2023-11-20T07:00:58.503543+0000","last_active":"2023-11-20T07:00:59.806267+0000","last_peered":"2023-11-20T07:00:59.806267+0000","last_clean":"2023-11-20T07:00:59.806267+0000","last_became_active":"2023-11-20T07:00:58.502762+0000","last_became_peered":"2023-11-20T07:00:58.502762+0000","last_unstale":"2023-11-20T07:00:59.806267+0000","last_undegraded":"2023-11-20T07:00:59.806267+0000","last_fullsized":"2023-11-20T07:00:59.806267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:45.316086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318563+0000","last_change":"2023-11-20T07:00:54.316224+0000","last_active":"2023-11-20T07:00:58.318563+0000","last_peered":"2023-11-20T07:00:58.318563+0000","last_clean":"2023-11-20T07:00:58.318563+0000","last_became_active":"2023-11-20T07:00:54.315909+0000","last_became_peered":"2023-11-20T07:00:54.315909+0000","last_unstale":"2023-11-20T07:00:58.318563+0000","last_undegraded":"2023-11-20T07:00:58.318563+0000","last_fullsized":"2023-11-20T07:00:58.318563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:04.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318503+0000","last_change":"2023-11-20T07:00:53.650522+0000","last_active":"2023-11-20T07:00:58.318503+0000","last_peered":"2023-11-20T07:00:58.318503+0000","last_clean":"2023-11-20T07:00:58.318503+0000","last_became_active":"2023-11-20T07:00:53.649787+0000","last_became_peered":"2023-11-20T07:00:53.649787+0000","last_unstale":"2023-11-20T07:00:58.318503+0000","last_undegraded":"2023-11-20T07:00:58.318503+0000","last_fullsized":"2023-11-20T07:00:58.318503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:18.352244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805309+0000","last_change":"2023-11-20T07:00:58.329318+0000","last_active":"2023-11-20T07:00:59.805309+0000","last_peered":"2023-11-20T07:00:59.805309+0000","last_clean":"2023-11-20T07:00:59.805309+0000","last_became_active":"2023-11-20T07:00:58.327572+0000","last_became_peered":"2023-11-20T07:00:58.327572+0000","last_unstale":"2023-11-20T07:00:59.805309+0000","last_undegraded":"2023-11-20T07:00:59.805309+0000","last_fullsized":"2023-11-20T07:00:59.805309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:34.090825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310713+0000","last_change":"2023-11-20T07:00:54.300938+0000","last_active":"2023-11-20T07:00:58.310713+0000","last_peered":"2023-11-20T07:00:58.310713+0000","last_clean":"2023-11-20T07:00:58.310713+0000","last_became_active":"2023-11-20T07:00:54.300489+0000","last_became_peered":"2023-11-20T07:00:54.300489+0000","last_unstale":"2023-11-20T07:00:58.310713+0000","last_undegraded":"2023-11-20T07:00:58.310713+0000","last_fullsized":"2023-11-20T07:00:58.310713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:19.358368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318471+0000","last_change":"2023-11-20T07:00:53.657372+0000","last_active":"2023-11-20T07:00:58.318471+0000","last_peered":"2023-11-20T07:00:58.318471+0000","last_clean":"2023-11-20T07:00:58.318471+0000","last_became_active":"2023-11-20T07:00:53.656783+0000","last_became_peered":"2023-11-20T07:00:53.656783+0000","last_unstale":"2023-11-20T07:00:58.318471+0000","last_undegraded":"2023-11-20T07:00:58.318471+0000","last_fullsized":"2023-11-20T07:00:58.318471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:06.245657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806936+0000","last_change":"2023-11-20T07:00:58.334074+0000","last_active":"2023-11-20T07:00:59.806936+0000","last_peered":"2023-11-20T07:00:59.806936+0000","last_clean":"2023-11-20T07:00:59.806936+0000","last_became_active":"2023-11-20T07:00:58.333819+0000","last_became_peered":"2023-11-20T07:00:58.333819+0000","last_unstale":"2023-11-20T07:00:59.806936+0000","last_undegraded":"2023-11-20T07:00:59.806936+0000","last_fullsized":"2023-11-20T07:00:59.806936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:08.554606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.315908+0000","last_change":"2023-11-20T07:00:54.308292+0000","last_active":"2023-11-20T07:00:58.315908+0000","last_peered":"2023-11-20T07:00:58.315908+0000","last_clean":"2023-11-20T07:00:58.315908+0000","last_became_active":"2023-11-20T07:00:54.306747+0000","last_became_peered":"2023-11-20T07:00:54.306747+0000","last_unstale":"2023-11-20T07:00:58.315908+0000","last_undegraded":"2023-11-20T07:00:58.315908+0000","last_fullsized":"2023-11-20T07:00:58.315908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.312862+0000","last_change":"2023-11-20T07:00:53.643036+0000","last_active":"2023-11-20T07:00:58.312862+0000","last_peered":"2023-11-20T07:00:58.312862+0000","last_clean":"2023-11-20T07:00:58.312862+0000","last_became_active":"2023-11-20T07:00:53.642571+0000","last_became_peered":"2023-11-20T07:00:53.642571+0000","last_unstale":"2023-11-20T07:00:58.312862+0000","last_undegraded":"2023-11-20T07:00:58.312862+0000","last_fullsized":"2023-11-20T07:00:58.312862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:44.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.808276+0000","last_change":"2023-11-20T07:00:58.333236+0000","last_active":"2023-11-20T07:00:59.808276+0000","last_peered":"2023-11-20T07:00:59.808276+0000","last_clean":"2023-11-20T07:00:59.808276+0000","last_became_active":"2023-11-20T07:00:58.332618+0000","last_became_peered":"2023-11-20T07:00:58.332618+0000","last_unstale":"2023-11-20T07:00:59.808276+0000","last_undegraded":"2023-11-20T07:00:59.808276+0000","last_fullsized":"2023-11-20T07:00:59.808276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:55:34.562598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318629+0000","last_change":"2023-11-20T07:00:54.297521+0000","last_active":"2023-11-20T07:00:58.318629+0000","last_peered":"2023-11-20T07:00:58.318629+0000","last_clean":"2023-11-20T07:00:58.318629+0000","last_became_active":"2023-11-20T07:00:54.297230+0000","last_became_peered":"2023-11-20T07:00:54.297230+0000","last_unstale":"2023-11-20T07:00:58.318629+0000","last_undegraded":"2023-11-20T07:00:58.318629+0000","last_fullsized":"2023-11-20T07:00:58.318629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:59:40.885687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.492983+0000","last_change":"2023-11-20T07:00:53.659113+0000","last_active":"2023-11-20T07:00:58.492983+0000","last_peered":"2023-11-20T07:00:58.492983+0000","last_clean":"2023-11-20T07:00:58.492983+0000","last_became_active":"2023-11-20T07:00:53.658547+0000","last_became_peered":"2023-11-20T07:00:53.658547+0000","last_unstale":"2023-11-20T07:00:58.492983+0000","last_undegraded":"2023-11-20T07:00:58.492983+0000","last_fullsized":"2023-11-20T07:00:58.492983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:38:48.212711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.807596+0000","last_change":"2023-11-20T07:00:58.503986+0000","last_active":"2023-11-20T07:00:59.807596+0000","last_peered":"2023-11-20T07:00:59.807596+0000","last_clean":"2023-11-20T07:00:59.807596+0000","last_became_active":"2023-11-20T07:00:58.503152+0000","last_became_peered":"2023-11-20T07:00:58.503152+0000","last_unstale":"2023-11-20T07:00:59.807596+0000","last_undegraded":"2023-11-20T07:00:59.807596+0000","last_fullsized":"2023-11-20T07:00:59.807596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:08.554606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.302885+0000","last_change":"2023-11-20T07:00:54.322661+0000","last_active":"2023-11-20T07:00:58.302885+0000","last_peered":"2023-11-20T07:00:58.302885+0000","last_clean":"2023-11-20T07:00:58.302885+0000","last_became_active":"2023-11-20T07:00:54.322420+0000","last_became_peered":"2023-11-20T07:00:54.322420+0000","last_unstale":"2023-11-20T07:00:58.302885+0000","last_undegraded":"2023-11-20T07:00:58.302885+0000","last_fullsized":"2023-11-20T07:00:58.302885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317887+0000","last_change":"2023-11-20T07:00:53.657962+0000","last_active":"2023-11-20T07:00:58.317887+0000","last_peered":"2023-11-20T07:00:58.317887+0000","last_clean":"2023-11-20T07:00:58.317887+0000","last_became_active":"2023-11-20T07:00:53.657573+0000","last_became_peered":"2023-11-20T07:00:53.657573+0000","last_unstale":"2023-11-20T07:00:58.317887+0000","last_undegraded":"2023-11-20T07:00:58.317887+0000","last_fullsized":"2023-11-20T07:00:58.317887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:20.103551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493065+0000","last_change":"2023-11-20T07:00:43.158695+0000","last_active":"2023-11-20T07:00:58.493065+0000","last_peered":"2023-11-20T07:00:58.493065+0000","last_clean":"2023-11-20T07:00:58.493065+0000","last_became_active":"2023-11-20T07:00:43.157454+0000","last_became_peered":"2023-11-20T07:00:43.157454+0000","last_unstale":"2023-11-20T07:00:58.493065+0000","last_undegraded":"2023-11-20T07:00:58.493065+0000","last_fullsized":"2023-11-20T07:00:58.493065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_clean_scrub_stamp":"2023-11-20T07:00:42.001721+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:44:20.907460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.306704+0000","last_change":"2023-11-20T07:00:58.498801+0000","last_active":"2023-11-20T07:00:59.306704+0000","last_peered":"2023-11-20T07:00:59.306704+0000","last_clean":"2023-11-20T07:00:59.306704+0000","last_became_active":"2023-11-20T07:00:58.498293+0000","last_became_peered":"2023-11-20T07:00:58.498293+0000","last_unstale":"2023-11-20T07:00:59.306704+0000","last_undegraded":"2023-11-20T07:00:59.306704+0000","last_fullsized":"2023-11-20T07:00:59.306704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:45.316086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493410+0000","last_change":"2023-11-20T07:00:54.327998+0000","last_active":"2023-11-20T07:00:58.493410+0000","last_peered":"2023-11-20T07:00:58.493410+0000","last_clean":"2023-11-20T07:00:58.493410+0000","last_became_active":"2023-11-20T07:00:54.327745+0000","last_became_peered":"2023-11-20T07:00:54.327745+0000","last_unstale":"2023-11-20T07:00:58.493410+0000","last_undegraded":"2023-11-20T07:00:58.493410+0000","last_fullsized":"2023-11-20T07:00:58.493410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:34.029377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.313957+0000","last_change":"2023-11-20T07:00:53.655190+0000","last_active":"2023-11-20T07:00:58.313957+0000","last_peered":"2023-11-20T07:00:58.313957+0000","last_clean":"2023-11-20T07:00:58.313957+0000","last_became_active":"2023-11-20T07:00:53.654911+0000","last_became_peered":"2023-11-20T07:00:53.654911+0000","last_unstale":"2023-11-20T07:00:58.313957+0000","last_undegraded":"2023-11-20T07:00:58.313957+0000","last_fullsized":"2023-11-20T07:00:58.313957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:00:18.310844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.306340+0000","last_change":"2023-11-20T07:00:58.494982+0000","last_active":"2023-11-20T07:00:59.306340+0000","last_peered":"2023-11-20T07:00:59.306340+0000","last_clean":"2023-11-20T07:00:59.306340+0000","last_became_active":"2023-11-20T07:00:58.494289+0000","last_became_peered":"2023-11-20T07:00:58.494289+0000","last_unstale":"2023-11-20T07:00:59.306340+0000","last_undegraded":"2023-11-20T07:00:59.306340+0000","last_fullsized":"2023-11-20T07:00:59.306340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:12.994548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317961+0000","last_change":"2023-11-20T07:00:54.313077+0000","last_active":"2023-11-20T07:00:58.317961+0000","last_peered":"2023-11-20T07:00:58.317961+0000","last_clean":"2023-11-20T07:00:58.317961+0000","last_became_active":"2023-11-20T07:00:54.312340+0000","last_became_peered":"2023-11-20T07:00:54.312340+0000","last_unstale":"2023-11-20T07:00:58.317961+0000","last_undegraded":"2023-11-20T07:00:58.317961+0000","last_fullsized":"2023-11-20T07:00:58.317961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:41.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317512+0000","last_change":"2023-11-20T07:00:53.645227+0000","last_active":"2023-11-20T07:00:58.317512+0000","last_peered":"2023-11-20T07:00:58.317512+0000","last_clean":"2023-11-20T07:00:58.317512+0000","last_became_active":"2023-11-20T07:00:53.644948+0000","last_became_peered":"2023-11-20T07:00:53.644948+0000","last_unstale":"2023-11-20T07:00:58.317512+0000","last_undegraded":"2023-11-20T07:00:58.317512+0000","last_fullsized":"2023-11-20T07:00:58.317512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:16.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806374+0000","last_change":"2023-11-20T07:00:58.328865+0000","last_active":"2023-11-20T07:00:59.806374+0000","last_peered":"2023-11-20T07:00:59.806374+0000","last_clean":"2023-11-20T07:00:59.806374+0000","last_became_active":"2023-11-20T07:00:58.326797+0000","last_became_peered":"2023-11-20T07:00:58.326797+0000","last_unstale":"2023-11-20T07:00:59.806374+0000","last_undegraded":"2023-11-20T07:00:59.806374+0000","last_fullsized":"2023-11-20T07:00:59.806374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:37.701282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494804+0000","last_change":"2023-11-20T07:00:54.322679+0000","last_active":"2023-11-20T07:00:58.494804+0000","last_peered":"2023-11-20T07:00:58.494804+0000","last_clean":"2023-11-20T07:00:58.494804+0000","last_became_active":"2023-11-20T07:00:54.322402+0000","last_became_peered":"2023-11-20T07:00:54.322402+0000","last_unstale":"2023-11-20T07:00:58.494804+0000","last_undegraded":"2023-11-20T07:00:58.494804+0000","last_fullsized":"2023-11-20T07:00:58.494804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:55:30.890692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.312002+0000","last_change":"2023-11-20T07:00:53.648554+0000","last_active":"2023-11-20T07:00:58.312002+0000","last_peered":"2023-11-20T07:00:58.312002+0000","last_clean":"2023-11-20T07:00:58.312002+0000","last_became_active":"2023-11-20T07:00:53.648235+0000","last_became_peered":"2023-11-20T07:00:53.648235+0000","last_unstale":"2023-11-20T07:00:58.312002+0000","last_undegraded":"2023-11-20T07:00:58.312002+0000","last_fullsized":"2023-11-20T07:00:58.312002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:18.352244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.804873+0000","last_change":"2023-11-20T07:00:58.495397+0000","last_active":"2023-11-20T07:00:59.804873+0000","last_peered":"2023-11-20T07:00:59.804873+0000","last_clean":"2023-11-20T07:00:59.804873+0000","last_became_active":"2023-11-20T07:00:58.494254+0000","last_became_peered":"2023-11-20T07:00:58.494254+0000","last_unstale":"2023-11-20T07:00:59.804873+0000","last_undegraded":"2023-11-20T07:00:59.804873+0000","last_fullsized":"2023-11-20T07:00:59.804873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:26.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494056+0000","last_change":"2023-11-20T07:00:54.323607+0000","last_active":"2023-11-20T07:00:58.494056+0000","last_peered":"2023-11-20T07:00:58.494056+0000","last_clean":"2023-11-20T07:00:58.494056+0000","last_became_active":"2023-11-20T07:00:54.322379+0000","last_became_peered":"2023-11-20T07:00:54.322379+0000","last_unstale":"2023-11-20T07:00:58.494056+0000","last_undegraded":"2023-11-20T07:00:58.494056+0000","last_fullsized":"2023-11-20T07:00:58.494056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:19.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310927+0000","last_change":"2023-11-20T07:00:53.649849+0000","last_active":"2023-11-20T07:00:58.310927+0000","last_peered":"2023-11-20T07:00:58.310927+0000","last_clean":"2023-11-20T07:00:58.310927+0000","last_became_active":"2023-11-20T07:00:53.649515+0000","last_became_peered":"2023-11-20T07:00:53.649515+0000","last_unstale":"2023-11-20T07:00:58.310927+0000","last_undegraded":"2023-11-20T07:00:58.310927+0000","last_fullsized":"2023-11-20T07:00:58.310927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307960+0000","last_change":"2023-11-20T07:00:58.323467+0000","last_active":"2023-11-20T07:00:59.307960+0000","last_peered":"2023-11-20T07:00:59.307960+0000","last_clean":"2023-11-20T07:00:59.307960+0000","last_became_active":"2023-11-20T07:00:58.323069+0000","last_became_peered":"2023-11-20T07:00:58.323069+0000","last_unstale":"2023-11-20T07:00:59.307960+0000","last_undegraded":"2023-11-20T07:00:59.307960+0000","last_fullsized":"2023-11-20T07:00:59.307960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:13.803757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493206+0000","last_change":"2023-11-20T07:00:54.319865+0000","last_active":"2023-11-20T07:00:58.493206+0000","last_peered":"2023-11-20T07:00:58.493206+0000","last_clean":"2023-11-20T07:00:58.493206+0000","last_became_active":"2023-11-20T07:00:54.319507+0000","last_became_peered":"2023-11-20T07:00:54.319507+0000","last_unstale":"2023-11-20T07:00:58.493206+0000","last_undegraded":"2023-11-20T07:00:58.493206+0000","last_fullsized":"2023-11-20T07:00:58.493206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:43.757635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.313020+0000","last_change":"2023-11-20T07:00:53.645113+0000","last_active":"2023-11-20T07:00:58.313020+0000","last_peered":"2023-11-20T07:00:58.313020+0000","last_clean":"2023-11-20T07:00:58.313020+0000","last_became_active":"2023-11-20T07:00:53.644649+0000","last_became_peered":"2023-11-20T07:00:53.644649+0000","last_unstale":"2023-11-20T07:00:58.313020+0000","last_undegraded":"2023-11-20T07:00:58.313020+0000","last_fullsized":"2023-11-20T07:00:58.313020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.807526+0000","last_change":"2023-11-20T07:00:58.331774+0000","last_active":"2023-11-20T07:00:59.807526+0000","last_peered":"2023-11-20T07:00:59.807526+0000","last_clean":"2023-11-20T07:00:59.807526+0000","last_became_active":"2023-11-20T07:00:58.331450+0000","last_became_peered":"2023-11-20T07:00:58.331450+0000","last_unstale":"2023-11-20T07:00:59.807526+0000","last_undegraded":"2023-11-20T07:00:59.807526+0000","last_fullsized":"2023-11-20T07:00:59.807526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:22.921101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.309552+0000","last_change":"2023-11-20T07:00:54.311720+0000","last_active":"2023-11-20T07:00:58.309552+0000","last_peered":"2023-11-20T07:00:58.309552+0000","last_clean":"2023-11-20T07:00:58.309552+0000","last_became_active":"2023-11-20T07:00:54.311043+0000","last_became_peered":"2023-11-20T07:00:54.311043+0000","last_unstale":"2023-11-20T07:00:58.309552+0000","last_undegraded":"2023-11-20T07:00:58.309552+0000","last_fullsized":"2023-11-20T07:00:58.309552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:16.073686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.309511+0000","last_change":"2023-11-20T07:00:53.641657+0000","last_active":"2023-11-20T07:00:58.309511+0000","last_peered":"2023-11-20T07:00:58.309511+0000","last_clean":"2023-11-20T07:00:58.309511+0000","last_became_active":"2023-11-20T07:00:53.641339+0000","last_became_peered":"2023-11-20T07:00:53.641339+0000","last_unstale":"2023-11-20T07:00:58.309511+0000","last_undegraded":"2023-11-20T07:00:58.309511+0000","last_fullsized":"2023-11-20T07:00:58.309511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:10.249731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806340+0000","last_change":"2023-11-20T07:00:58.499394+0000","last_active":"2023-11-20T07:00:59.806340+0000","last_peered":"2023-11-20T07:00:59.806340+0000","last_clean":"2023-11-20T07:00:59.806340+0000","last_became_active":"2023-11-20T07:00:58.498964+0000","last_became_peered":"2023-11-20T07:00:58.498964+0000","last_unstale":"2023-11-20T07:00:59.806340+0000","last_undegraded":"2023-11-20T07:00:59.806340+0000","last_fullsized":"2023-11-20T07:00:59.806340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:29:17.940481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493222+0000","last_change":"2023-11-20T07:00:54.322332+0000","last_active":"2023-11-20T07:00:58.493222+0000","last_peered":"2023-11-20T07:00:58.493222+0000","last_clean":"2023-11-20T07:00:58.493222+0000","last_became_active":"2023-11-20T07:00:54.322039+0000","last_became_peered":"2023-11-20T07:00:54.322039+0000","last_unstale":"2023-11-20T07:00:58.493222+0000","last_undegraded":"2023-11-20T07:00:58.493222+0000","last_fullsized":"2023-11-20T07:00:58.493222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:41.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318421+0000","last_change":"2023-11-20T07:00:53.658482+0000","last_active":"2023-11-20T07:00:58.318421+0000","last_peered":"2023-11-20T07:00:58.318421+0000","last_clean":"2023-11-20T07:00:58.318421+0000","last_became_active":"2023-11-20T07:00:53.657099+0000","last_became_peered":"2023-11-20T07:00:53.657099+0000","last_unstale":"2023-11-20T07:00:58.318421+0000","last_undegraded":"2023-11-20T07:00:58.318421+0000","last_fullsized":"2023-11-20T07:00:58.318421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:15.067561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805595+0000","last_change":"2023-11-20T07:00:58.495295+0000","last_active":"2023-11-20T07:00:59.805595+0000","last_peered":"2023-11-20T07:00:59.805595+0000","last_clean":"2023-11-20T07:00:59.805595+0000","last_became_active":"2023-11-20T07:00:58.494557+0000","last_became_peered":"2023-11-20T07:00:58.494557+0000","last_unstale":"2023-11-20T07:00:59.805595+0000","last_undegraded":"2023-11-20T07:00:59.805595+0000","last_fullsized":"2023-11-20T07:00:59.805595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:55:33.954628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.320074+0000","last_change":"2023-11-20T07:00:54.311785+0000","last_active":"2023-11-20T07:00:58.320074+0000","last_peered":"2023-11-20T07:00:58.320074+0000","last_clean":"2023-11-20T07:00:58.320074+0000","last_became_active":"2023-11-20T07:00:54.311435+0000","last_became_peered":"2023-11-20T07:00:54.311435+0000","last_unstale":"2023-11-20T07:00:58.320074+0000","last_undegraded":"2023-11-20T07:00:58.320074+0000","last_fullsized":"2023-11-20T07:00:58.320074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:27.408568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.319062+0000","last_change":"2023-11-20T07:00:53.651972+0000","last_active":"2023-11-20T07:00:58.319062+0000","last_peered":"2023-11-20T07:00:58.319062+0000","last_clean":"2023-11-20T07:00:58.319062+0000","last_became_active":"2023-11-20T07:00:53.651725+0000","last_became_peered":"2023-11-20T07:00:53.651725+0000","last_unstale":"2023-11-20T07:00:58.319062+0000","last_undegraded":"2023-11-20T07:00:58.319062+0000","last_fullsized":"2023-11-20T07:00:58.319062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:00:18.310844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806216+0000","last_change":"2023-11-20T07:00:58.498803+0000","last_active":"2023-11-20T07:00:59.806216+0000","last_peered":"2023-11-20T07:00:59.806216+0000","last_clean":"2023-11-20T07:00:59.806216+0000","last_became_active":"2023-11-20T07:00:58.498348+0000","last_became_peered":"2023-11-20T07:00:58.498348+0000","last_unstale":"2023-11-20T07:00:59.806216+0000","last_undegraded":"2023-11-20T07:00:59.806216+0000","last_fullsized":"2023-11-20T07:00:59.806216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:55:33.954628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493295+0000","last_change":"2023-11-20T07:00:54.320969+0000","last_active":"2023-11-20T07:00:58.493295+0000","last_peered":"2023-11-20T07:00:58.493295+0000","last_clean":"2023-11-20T07:00:58.493295+0000","last_became_active":"2023-11-20T07:00:54.320409+0000","last_became_peered":"2023-11-20T07:00:54.320409+0000","last_unstale":"2023-11-20T07:00:58.493295+0000","last_undegraded":"2023-11-20T07:00:58.493295+0000","last_fullsized":"2023-11-20T07:00:58.493295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:09.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:01:04.877592+0000","last_change":"2023-11-20T07:00:53.644264+0000","last_active":"2023-11-20T07:01:04.877592+0000","last_peered":"2023-11-20T07:01:04.877592+0000","last_clean":"2023-11-20T07:01:04.877592+0000","last_became_active":"2023-11-20T07:00:53.643140+0000","last_became_peered":"2023-11-20T07:00:53.643140+0000","last_unstale":"2023-11-20T07:01:04.877592+0000","last_undegraded":"2023-11-20T07:01:04.877592+0000","last_fullsized":"2023-11-20T07:01:04.877592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:34:36.600135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806734+0000","last_change":"2023-11-20T07:00:58.328933+0000","last_active":"2023-11-20T07:00:59.806734+0000","last_peered":"2023-11-20T07:00:59.806734+0000","last_clean":"2023-11-20T07:00:59.806734+0000","last_became_active":"2023-11-20T07:00:58.328561+0000","last_became_peered":"2023-11-20T07:00:58.328561+0000","last_unstale":"2023-11-20T07:00:59.806734+0000","last_undegraded":"2023-11-20T07:00:59.806734+0000","last_fullsized":"2023-11-20T07:00:59.806734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:22.921101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310790+0000","last_change":"2023-11-20T07:00:54.309203+0000","last_active":"2023-11-20T07:00:58.310790+0000","last_peered":"2023-11-20T07:00:58.310790+0000","last_clean":"2023-11-20T07:00:58.310790+0000","last_became_active":"2023-11-20T07:00:54.308899+0000","last_became_peered":"2023-11-20T07:00:54.308899+0000","last_unstale":"2023-11-20T07:00:58.310790+0000","last_undegraded":"2023-11-20T07:00:58.310790+0000","last_fullsized":"2023-11-20T07:00:58.310790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:34:37.606259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317463+0000","last_change":"2023-11-20T07:00:53.656825+0000","last_active":"2023-11-20T07:00:58.317463+0000","last_peered":"2023-11-20T07:00:58.317463+0000","last_clean":"2023-11-20T07:00:58.317463+0000","last_became_active":"2023-11-20T07:00:53.656508+0000","last_became_peered":"2023-11-20T07:00:53.656508+0000","last_unstale":"2023-11-20T07:00:58.317463+0000","last_undegraded":"2023-11-20T07:00:58.317463+0000","last_fullsized":"2023-11-20T07:00:58.317463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:10.249731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308277+0000","last_change":"2023-11-20T07:00:58.322540+0000","last_active":"2023-11-20T07:00:59.308277+0000","last_peered":"2023-11-20T07:00:59.308277+0000","last_clean":"2023-11-20T07:00:59.308277+0000","last_became_active":"2023-11-20T07:00:58.322104+0000","last_became_peered":"2023-11-20T07:00:58.322104+0000","last_unstale":"2023-11-20T07:00:59.308277+0000","last_undegraded":"2023-11-20T07:00:59.308277+0000","last_fullsized":"2023-11-20T07:00:59.308277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:42:00.476914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326762+0000","last_change":"2023-11-20T07:00:54.318615+0000","last_active":"2023-11-20T07:00:58.326762+0000","last_peered":"2023-11-20T07:00:58.326762+0000","last_clean":"2023-11-20T07:00:58.326762+0000","last_became_active":"2023-11-20T07:00:54.318374+0000","last_became_peered":"2023-11-20T07:00:54.318374+0000","last_unstale":"2023-11-20T07:00:58.326762+0000","last_undegraded":"2023-11-20T07:00:58.326762+0000","last_fullsized":"2023-11-20T07:00:58.326762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318588+0000","last_change":"2023-11-20T07:00:53.663688+0000","last_active":"2023-11-20T07:00:58.318588+0000","last_peered":"2023-11-20T07:00:58.318588+0000","last_clean":"2023-11-20T07:00:58.318588+0000","last_became_active":"2023-11-20T07:00:53.663314+0000","last_became_peered":"2023-11-20T07:00:53.663314+0000","last_unstale":"2023-11-20T07:00:58.318588+0000","last_undegraded":"2023-11-20T07:00:58.318588+0000","last_fullsized":"2023-11-20T07:00:58.318588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:38.340586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805253+0000","last_change":"2023-11-20T07:00:58.325558+0000","last_active":"2023-11-20T07:00:59.805253+0000","last_peered":"2023-11-20T07:00:59.805253+0000","last_clean":"2023-11-20T07:00:59.805253+0000","last_became_active":"2023-11-20T07:00:58.323820+0000","last_became_peered":"2023-11-20T07:00:58.323820+0000","last_unstale":"2023-11-20T07:00:59.805253+0000","last_undegraded":"2023-11-20T07:00:59.805253+0000","last_fullsized":"2023-11-20T07:00:59.805253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:56:08.258067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317817+0000","last_change":"2023-11-20T07:00:54.322025+0000","last_active":"2023-11-20T07:00:58.317817+0000","last_peered":"2023-11-20T07:00:58.317817+0000","last_clean":"2023-11-20T07:00:58.317817+0000","last_became_active":"2023-11-20T07:00:54.319123+0000","last_became_peered":"2023-11-20T07:00:54.319123+0000","last_unstale":"2023-11-20T07:00:58.317817+0000","last_undegraded":"2023-11-20T07:00:58.317817+0000","last_fullsized":"2023-11-20T07:00:58.317817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:30.418920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311738+0000","last_change":"2023-11-20T07:00:53.658099+0000","last_active":"2023-11-20T07:00:58.311738+0000","last_peered":"2023-11-20T07:00:58.311738+0000","last_clean":"2023-11-20T07:00:58.311738+0000","last_became_active":"2023-11-20T07:00:53.657497+0000","last_became_peered":"2023-11-20T07:00:53.657497+0000","last_unstale":"2023-11-20T07:00:58.311738+0000","last_undegraded":"2023-11-20T07:00:58.311738+0000","last_fullsized":"2023-11-20T07:00:58.311738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:59:39.879563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805495+0000","last_change":"2023-11-20T07:00:58.500441+0000","last_active":"2023-11-20T07:00:59.805495+0000","last_peered":"2023-11-20T07:00:59.805495+0000","last_clean":"2023-11-20T07:00:59.805495+0000","last_became_active":"2023-11-20T07:00:58.499609+0000","last_became_peered":"2023-11-20T07:00:58.499609+0000","last_unstale":"2023-11-20T07:00:59.805495+0000","last_undegraded":"2023-11-20T07:00:59.805495+0000","last_fullsized":"2023-11-20T07:00:59.805495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:26.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.807449+0000","last_change":"2023-11-20T07:00:58.503634+0000","last_active":"2023-11-20T07:00:59.807449+0000","last_peered":"2023-11-20T07:00:59.807449+0000","last_clean":"2023-11-20T07:00:59.807449+0000","last_became_active":"2023-11-20T07:00:58.503079+0000","last_became_peered":"2023-11-20T07:00:58.503079+0000","last_unstale":"2023-11-20T07:00:59.807449+0000","last_undegraded":"2023-11-20T07:00:59.807449+0000","last_fullsized":"2023-11-20T07:00:59.807449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:34.090825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316198+0000","last_change":"2023-11-20T07:00:54.313144+0000","last_active":"2023-11-20T07:00:58.316198+0000","last_peered":"2023-11-20T07:00:58.316198+0000","last_clean":"2023-11-20T07:00:58.316198+0000","last_became_active":"2023-11-20T07:00:54.312847+0000","last_became_peered":"2023-11-20T07:00:54.312847+0000","last_unstale":"2023-11-20T07:00:58.316198+0000","last_undegraded":"2023-11-20T07:00:58.316198+0000","last_fullsized":"2023-11-20T07:00:58.316198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318078+0000","last_change":"2023-11-20T07:00:53.653998+0000","last_active":"2023-11-20T07:00:58.318078+0000","last_peered":"2023-11-20T07:00:58.318078+0000","last_clean":"2023-11-20T07:00:58.318078+0000","last_became_active":"2023-11-20T07:00:53.653691+0000","last_became_peered":"2023-11-20T07:00:53.653691+0000","last_unstale":"2023-11-20T07:00:58.318078+0000","last_undegraded":"2023-11-20T07:00:58.318078+0000","last_fullsized":"2023-11-20T07:00:58.318078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:06.154369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307016+0000","last_change":"2023-11-20T07:00:58.328082+0000","last_active":"2023-11-20T07:00:59.307016+0000","last_peered":"2023-11-20T07:00:59.307016+0000","last_clean":"2023-11-20T07:00:59.307016+0000","last_became_active":"2023-11-20T07:00:58.327691+0000","last_became_peered":"2023-11-20T07:00:58.327691+0000","last_unstale":"2023-11-20T07:00:59.307016+0000","last_undegraded":"2023-11-20T07:00:59.307016+0000","last_fullsized":"2023-11-20T07:00:59.307016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:37.701282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303177+0000","last_change":"2023-11-20T07:00:54.313955+0000","last_active":"2023-11-20T07:00:58.303177+0000","last_peered":"2023-11-20T07:00:58.303177+0000","last_clean":"2023-11-20T07:00:58.303177+0000","last_became_active":"2023-11-20T07:00:54.313653+0000","last_became_peered":"2023-11-20T07:00:54.313653+0000","last_unstale":"2023-11-20T07:00:58.303177+0000","last_undegraded":"2023-11-20T07:00:58.303177+0000","last_fullsized":"2023-11-20T07:00:58.303177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303337+0000","last_change":"2023-11-20T07:00:53.649943+0000","last_active":"2023-11-20T07:00:58.303337+0000","last_peered":"2023-11-20T07:00:58.303337+0000","last_clean":"2023-11-20T07:00:58.303337+0000","last_became_active":"2023-11-20T07:00:53.649583+0000","last_became_peered":"2023-11-20T07:00:53.649583+0000","last_unstale":"2023-11-20T07:00:58.303337+0000","last_undegraded":"2023-11-20T07:00:58.303337+0000","last_fullsized":"2023-11-20T07:00:58.303337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:44.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310821+0000","last_change":"2023-11-20T07:00:53.641711+0000","last_active":"2023-11-20T07:00:58.310821+0000","last_peered":"2023-11-20T07:00:58.310821+0000","last_clean":"2023-11-20T07:00:58.310821+0000","last_became_active":"2023-11-20T07:00:53.641380+0000","last_became_peered":"2023-11-20T07:00:53.641380+0000","last_unstale":"2023-11-20T07:00:58.310821+0000","last_undegraded":"2023-11-20T07:00:58.310821+0000","last_fullsized":"2023-11-20T07:00:58.310821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:16.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318975+0000","last_change":"2023-11-20T07:00:54.299129+0000","last_active":"2023-11-20T07:00:58.318975+0000","last_peered":"2023-11-20T07:00:58.318975+0000","last_clean":"2023-11-20T07:00:58.318975+0000","last_became_active":"2023-11-20T07:00:54.298681+0000","last_became_peered":"2023-11-20T07:00:54.298681+0000","last_unstale":"2023-11-20T07:00:58.318975+0000","last_undegraded":"2023-11-20T07:00:58.318975+0000","last_fullsized":"2023-11-20T07:00:58.318975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.305689+0000","last_change":"2023-11-20T07:00:58.328570+0000","last_active":"2023-11-20T07:00:59.305689+0000","last_peered":"2023-11-20T07:00:59.305689+0000","last_clean":"2023-11-20T07:00:59.305689+0000","last_became_active":"2023-11-20T07:00:58.328166+0000","last_became_peered":"2023-11-20T07:00:58.328166+0000","last_unstale":"2023-11-20T07:00:59.305689+0000","last_undegraded":"2023-11-20T07:00:59.305689+0000","last_fullsized":"2023-11-20T07:00:59.305689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:10.832398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303452+0000","last_change":"2023-11-20T07:00:53.653770+0000","last_active":"2023-11-20T07:00:58.303452+0000","last_peered":"2023-11-20T07:00:58.303452+0000","last_clean":"2023-11-20T07:00:58.303452+0000","last_became_active":"2023-11-20T07:00:53.653466+0000","last_became_peered":"2023-11-20T07:00:53.653466+0000","last_unstale":"2023-11-20T07:00:58.303452+0000","last_undegraded":"2023-11-20T07:00:58.303452+0000","last_fullsized":"2023-11-20T07:00:58.303452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310410+0000","last_change":"2023-11-20T07:00:54.308587+0000","last_active":"2023-11-20T07:00:58.310410+0000","last_peered":"2023-11-20T07:00:58.310410+0000","last_clean":"2023-11-20T07:00:58.310410+0000","last_became_active":"2023-11-20T07:00:54.308181+0000","last_became_peered":"2023-11-20T07:00:54.308181+0000","last_unstale":"2023-11-20T07:00:58.310410+0000","last_undegraded":"2023-11-20T07:00:58.310410+0000","last_fullsized":"2023-11-20T07:00:58.310410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:45.559098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805869+0000","last_change":"2023-11-20T07:00:58.326468+0000","last_active":"2023-11-20T07:00:59.805869+0000","last_peered":"2023-11-20T07:00:59.805869+0000","last_clean":"2023-11-20T07:00:59.805869+0000","last_became_active":"2023-11-20T07:00:58.325258+0000","last_became_peered":"2023-11-20T07:00:58.325258+0000","last_unstale":"2023-11-20T07:00:59.805869+0000","last_undegraded":"2023-11-20T07:00:59.805869+0000","last_fullsized":"2023-11-20T07:00:59.805869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:58:39.439432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.309466+0000","last_change":"2023-11-20T07:00:54.304862+0000","last_active":"2023-11-20T07:00:58.309466+0000","last_peered":"2023-11-20T07:00:58.309466+0000","last_clean":"2023-11-20T07:00:58.309466+0000","last_became_active":"2023-11-20T07:00:54.303650+0000","last_became_peered":"2023-11-20T07:00:54.303650+0000","last_unstale":"2023-11-20T07:00:58.309466+0000","last_undegraded":"2023-11-20T07:00:58.309466+0000","last_fullsized":"2023-11-20T07:00:58.309466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.312778+0000","last_change":"2023-11-20T07:00:54.324075+0000","last_active":"2023-11-20T07:00:58.312778+0000","last_peered":"2023-11-20T07:00:58.312778+0000","last_clean":"2023-11-20T07:00:58.312778+0000","last_became_active":"2023-11-20T07:00:54.323676+0000","last_became_peered":"2023-11-20T07:00:54.323676+0000","last_unstale":"2023-11-20T07:00:58.312778+0000","last_undegraded":"2023-11-20T07:00:58.312778+0000","last_fullsized":"2023-11-20T07:00:58.312778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:34:37.606259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318377+0000","last_change":"2023-11-20T07:00:54.318169+0000","last_active":"2023-11-20T07:00:58.318377+0000","last_peered":"2023-11-20T07:00:58.318377+0000","last_clean":"2023-11-20T07:00:58.318377+0000","last_became_active":"2023-11-20T07:00:54.317900+0000","last_became_peered":"2023-11-20T07:00:54.317900+0000","last_unstale":"2023-11-20T07:00:58.318377+0000","last_undegraded":"2023-11-20T07:00:58.318377+0000","last_fullsized":"2023-11-20T07:00:58.318377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:09.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318884+0000","last_change":"2023-11-20T07:00:54.312618+0000","last_active":"2023-11-20T07:00:58.318884+0000","last_peered":"2023-11-20T07:00:58.318884+0000","last_clean":"2023-11-20T07:00:58.318884+0000","last_became_active":"2023-11-20T07:00:54.312347+0000","last_became_peered":"2023-11-20T07:00:54.312347+0000","last_unstale":"2023-11-20T07:00:58.318884+0000","last_undegraded":"2023-11-20T07:00:58.318884+0000","last_fullsized":"2023-11-20T07:00:58.318884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303777+0000","last_change":"2023-11-20T07:00:54.320244+0000","last_active":"2023-11-20T07:00:58.303777+0000","last_peered":"2023-11-20T07:00:58.303777+0000","last_clean":"2023-11-20T07:00:58.303777+0000","last_became_active":"2023-11-20T07:00:54.319980+0000","last_became_peered":"2023-11-20T07:00:54.319980+0000","last_unstale":"2023-11-20T07:00:58.303777+0000","last_undegraded":"2023-11-20T07:00:58.303777+0000","last_fullsized":"2023-11-20T07:00:58.303777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:10.131851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317033+0000","last_change":"2023-11-20T07:00:54.306675+0000","last_active":"2023-11-20T07:00:58.317033+0000","last_peered":"2023-11-20T07:00:58.317033+0000","last_clean":"2023-11-20T07:00:58.317033+0000","last_became_active":"2023-11-20T07:00:54.306368+0000","last_became_peered":"2023-11-20T07:00:54.306368+0000","last_unstale":"2023-11-20T07:00:58.317033+0000","last_undegraded":"2023-11-20T07:00:58.317033+0000","last_fullsized":"2023-11-20T07:00:58.317033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311347+0000","last_change":"2023-11-20T07:00:54.311331+0000","last_active":"2023-11-20T07:00:58.311347+0000","last_peered":"2023-11-20T07:00:58.311347+0000","last_clean":"2023-11-20T07:00:58.311347+0000","last_became_active":"2023-11-20T07:00:54.311018+0000","last_became_peered":"2023-11-20T07:00:54.311018+0000","last_unstale":"2023-11-20T07:00:58.311347+0000","last_undegraded":"2023-11-20T07:00:58.311347+0000","last_fullsized":"2023-11-20T07:00:58.311347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.305111+0000","last_change":"2023-11-20T07:00:54.319932+0000","last_active":"2023-11-20T07:00:58.305111+0000","last_peered":"2023-11-20T07:00:58.305111+0000","last_clean":"2023-11-20T07:00:58.305111+0000","last_became_active":"2023-11-20T07:00:54.319701+0000","last_became_peered":"2023-11-20T07:00:54.319701+0000","last_unstale":"2023-11-20T07:00:58.305111+0000","last_undegraded":"2023-11-20T07:00:58.305111+0000","last_fullsized":"2023-11-20T07:00:58.305111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:41:56.805008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318044+0000","last_change":"2023-11-20T07:00:54.318299+0000","last_active":"2023-11-20T07:00:58.318044+0000","last_peered":"2023-11-20T07:00:58.318044+0000","last_clean":"2023-11-20T07:00:58.318044+0000","last_became_active":"2023-11-20T07:00:54.312610+0000","last_became_peered":"2023-11-20T07:00:54.312610+0000","last_unstale":"2023-11-20T07:00:58.318044+0000","last_undegraded":"2023-11-20T07:00:58.318044+0000","last_fullsized":"2023-11-20T07:00:58.318044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303139+0000","last_change":"2023-11-20T07:00:54.316271+0000","last_active":"2023-11-20T07:00:58.303139+0000","last_peered":"2023-11-20T07:00:58.303139+0000","last_clean":"2023-11-20T07:00:58.303139+0000","last_became_active":"2023-11-20T07:00:54.315955+0000","last_became_peered":"2023-11-20T07:00:54.315955+0000","last_unstale":"2023-11-20T07:00:58.303139+0000","last_undegraded":"2023-11-20T07:00:58.303139+0000","last_fullsized":"2023-11-20T07:00:58.303139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318282+0000","last_change":"2023-11-20T07:00:54.317416+0000","last_active":"2023-11-20T07:00:58.318282+0000","last_peered":"2023-11-20T07:00:58.318282+0000","last_clean":"2023-11-20T07:00:58.318282+0000","last_became_active":"2023-11-20T07:00:54.316794+0000","last_became_peered":"2023-11-20T07:00:54.316794+0000","last_unstale":"2023-11-20T07:00:58.318282+0000","last_undegraded":"2023-11-20T07:00:58.318282+0000","last_fullsized":"2023-11-20T07:00:58.318282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:43.757635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318783+0000","last_change":"2023-11-20T07:00:54.308603+0000","last_active":"2023-11-20T07:00:58.318783+0000","last_peered":"2023-11-20T07:00:58.318783+0000","last_clean":"2023-11-20T07:00:58.318783+0000","last_became_active":"2023-11-20T07:00:54.308324+0000","last_became_peered":"2023-11-20T07:00:54.308324+0000","last_unstale":"2023-11-20T07:00:58.318783+0000","last_undegraded":"2023-11-20T07:00:58.318783+0000","last_fullsized":"2023-11-20T07:00:58.318783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310585+0000","last_change":"2023-11-20T07:00:54.315438+0000","last_active":"2023-11-20T07:00:58.310585+0000","last_peered":"2023-11-20T07:00:58.310585+0000","last_clean":"2023-11-20T07:00:58.310585+0000","last_became_active":"2023-11-20T07:00:54.315182+0000","last_became_peered":"2023-11-20T07:00:54.315182+0000","last_unstale":"2023-11-20T07:00:58.310585+0000","last_undegraded":"2023-11-20T07:00:58.310585+0000","last_fullsized":"2023-11-20T07:00:58.310585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493594+0000","last_change":"2023-11-20T07:00:54.320102+0000","last_active":"2023-11-20T07:00:58.493594+0000","last_peered":"2023-11-20T07:00:58.493594+0000","last_clean":"2023-11-20T07:00:58.493594+0000","last_became_active":"2023-11-20T07:00:54.313876+0000","last_became_peered":"2023-11-20T07:00:54.313876+0000","last_unstale":"2023-11-20T07:00:58.493594+0000","last_undegraded":"2023-11-20T07:00:58.493594+0000","last_fullsized":"2023-11-20T07:00:58.493594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:30.418920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.314165+0000","last_change":"2023-11-20T07:00:54.308769+0000","last_active":"2023-11-20T07:00:58.314165+0000","last_peered":"2023-11-20T07:00:58.314165+0000","last_clean":"2023-11-20T07:00:58.314165+0000","last_became_active":"2023-11-20T07:00:54.307885+0000","last_became_peered":"2023-11-20T07:00:54.307885+0000","last_unstale":"2023-11-20T07:00:58.314165+0000","last_undegraded":"2023-11-20T07:00:58.314165+0000","last_fullsized":"2023-11-20T07:00:58.314165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:11.255855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318308+0000","last_change":"2023-11-20T07:00:54.318879+0000","last_active":"2023-11-20T07:00:58.318308+0000","last_peered":"2023-11-20T07:00:58.318308+0000","last_clean":"2023-11-20T07:00:58.318308+0000","last_became_active":"2023-11-20T07:00:54.318590+0000","last_became_peered":"2023-11-20T07:00:54.318590+0000","last_unstale":"2023-11-20T07:00:58.318308+0000","last_undegraded":"2023-11-20T07:00:58.318308+0000","last_fullsized":"2023-11-20T07:00:58.318308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:19.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317955+0000","last_change":"2023-11-20T07:00:54.318760+0000","last_active":"2023-11-20T07:00:58.317955+0000","last_peered":"2023-11-20T07:00:58.317955+0000","last_clean":"2023-11-20T07:00:58.317955+0000","last_became_active":"2023-11-20T07:00:54.318437+0000","last_became_peered":"2023-11-20T07:00:54.318437+0000","last_unstale":"2023-11-20T07:00:58.317955+0000","last_undegraded":"2023-11-20T07:00:58.317955+0000","last_fullsized":"2023-11-20T07:00:58.317955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316266+0000","last_change":"2023-11-20T07:00:54.315538+0000","last_active":"2023-11-20T07:00:58.316266+0000","last_peered":"2023-11-20T07:00:58.316266+0000","last_clean":"2023-11-20T07:00:58.316266+0000","last_became_active":"2023-11-20T07:00:54.315233+0000","last_became_peered":"2023-11-20T07:00:54.315233+0000","last_unstale":"2023-11-20T07:00:58.316266+0000","last_undegraded":"2023-11-20T07:00:58.316266+0000","last_fullsized":"2023-11-20T07:00:58.316266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.319999+0000","last_change":"2023-11-20T07:00:54.307661+0000","last_active":"2023-11-20T07:00:58.319999+0000","last_peered":"2023-11-20T07:00:58.319999+0000","last_clean":"2023-11-20T07:00:58.319999+0000","last_became_active":"2023-11-20T07:00:54.306975+0000","last_became_peered":"2023-11-20T07:00:54.306975+0000","last_unstale":"2023-11-20T07:00:58.319999+0000","last_undegraded":"2023-11-20T07:00:58.319999+0000","last_fullsized":"2023-11-20T07:00:58.319999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:17.914788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303292+0000","last_change":"2023-11-20T07:00:54.307989+0000","last_active":"2023-11-20T07:00:58.303292+0000","last_peered":"2023-11-20T07:00:58.303292+0000","last_clean":"2023-11-20T07:00:58.303292+0000","last_became_active":"2023-11-20T07:00:54.307712+0000","last_became_peered":"2023-11-20T07:00:54.307712+0000","last_unstale":"2023-11-20T07:00:58.303292+0000","last_undegraded":"2023-11-20T07:00:58.303292+0000","last_fullsized":"2023-11-20T07:00:58.303292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310788+0000","last_change":"2023-11-20T07:00:54.307874+0000","last_active":"2023-11-20T07:00:58.310788+0000","last_peered":"2023-11-20T07:00:58.310788+0000","last_clean":"2023-11-20T07:00:58.310788+0000","last_became_active":"2023-11-20T07:00:54.307257+0000","last_became_peered":"2023-11-20T07:00:54.307257+0000","last_unstale":"2023-11-20T07:00:58.310788+0000","last_undegraded":"2023-11-20T07:00:58.310788+0000","last_fullsized":"2023-11-20T07:00:58.310788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:38:49.218835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311723+0000","last_change":"2023-11-20T07:00:54.320026+0000","last_active":"2023-11-20T07:00:58.311723+0000","last_peered":"2023-11-20T07:00:58.311723+0000","last_clean":"2023-11-20T07:00:58.311723+0000","last_became_active":"2023-11-20T07:00:54.319737+0000","last_became_peered":"2023-11-20T07:00:54.319737+0000","last_unstale":"2023-11-20T07:00:58.311723+0000","last_undegraded":"2023-11-20T07:00:58.311723+0000","last_fullsized":"2023-11-20T07:00:58.311723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311297+0000","last_change":"2023-11-20T07:00:54.323404+0000","last_active":"2023-11-20T07:00:58.311297+0000","last_peered":"2023-11-20T07:00:58.311297+0000","last_clean":"2023-11-20T07:00:58.311297+0000","last_became_active":"2023-11-20T07:00:54.323122+0000","last_became_peered":"2023-11-20T07:00:54.323122+0000","last_unstale":"2023-11-20T07:00:58.311297+0000","last_undegraded":"2023-11-20T07:00:58.311297+0000","last_fullsized":"2023-11-20T07:00:58.311297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494710+0000","last_change":"2023-11-20T07:00:54.320729+0000","last_active":"2023-11-20T07:00:58.494710+0000","last_peered":"2023-11-20T07:00:58.494710+0000","last_clean":"2023-11-20T07:00:58.494710+0000","last_became_active":"2023-11-20T07:00:54.320394+0000","last_became_peered":"2023-11-20T07:00:54.320394+0000","last_unstale":"2023-11-20T07:00:58.494710+0000","last_undegraded":"2023-11-20T07:00:58.494710+0000","last_fullsized":"2023-11-20T07:00:58.494710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:19:22.025419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.302533+0000","last_change":"2023-11-20T07:00:54.322697+0000","last_active":"2023-11-20T07:00:58.302533+0000","last_peered":"2023-11-20T07:00:58.302533+0000","last_clean":"2023-11-20T07:00:58.302533+0000","last_became_active":"2023-11-20T07:00:54.322432+0000","last_became_peered":"2023-11-20T07:00:54.322432+0000","last_unstale":"2023-11-20T07:00:58.302533+0000","last_undegraded":"2023-11-20T07:00:58.302533+0000","last_fullsized":"2023-11-20T07:00:58.302533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:16.073686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493090+0000","last_change":"2023-11-20T07:00:54.319125+0000","last_active":"2023-11-20T07:00:58.493090+0000","last_peered":"2023-11-20T07:00:58.493090+0000","last_clean":"2023-11-20T07:00:58.493090+0000","last_became_active":"2023-11-20T07:00:54.314729+0000","last_became_peered":"2023-11-20T07:00:54.314729+0000","last_unstale":"2023-11-20T07:00:58.493090+0000","last_undegraded":"2023-11-20T07:00:58.493090+0000","last_fullsized":"2023-11-20T07:00:58.493090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:10.131851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318318+0000","last_change":"2023-11-20T07:00:54.317580+0000","last_active":"2023-11-20T07:00:58.318318+0000","last_peered":"2023-11-20T07:00:58.318318+0000","last_clean":"2023-11-20T07:00:58.318318+0000","last_became_active":"2023-11-20T07:00:54.317144+0000","last_became_peered":"2023-11-20T07:00:54.317144+0000","last_unstale":"2023-11-20T07:00:58.318318+0000","last_undegraded":"2023-11-20T07:00:58.318318+0000","last_fullsized":"2023-11-20T07:00:58.318318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:10.131851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493163+0000","last_change":"2023-11-20T07:00:54.313588+0000","last_active":"2023-11-20T07:00:58.493163+0000","last_peered":"2023-11-20T07:00:58.493163+0000","last_clean":"2023-11-20T07:00:58.493163+0000","last_became_active":"2023-11-20T07:00:54.309057+0000","last_became_peered":"2023-11-20T07:00:54.309057+0000","last_unstale":"2023-11-20T07:00:58.493163+0000","last_undegraded":"2023-11-20T07:00:58.493163+0000","last_fullsized":"2023-11-20T07:00:58.493163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:41:56.805008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317745+0000","last_change":"2023-11-20T07:00:54.316503+0000","last_active":"2023-11-20T07:00:58.317745+0000","last_peered":"2023-11-20T07:00:58.317745+0000","last_clean":"2023-11-20T07:00:58.317745+0000","last_became_active":"2023-11-20T07:00:54.316046+0000","last_became_peered":"2023-11-20T07:00:54.316046+0000","last_unstale":"2023-11-20T07:00:58.317745+0000","last_undegraded":"2023-11-20T07:00:58.317745+0000","last_fullsized":"2023-11-20T07:00:58.317745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318929+0000","last_change":"2023-11-20T07:00:54.303021+0000","last_active":"2023-11-20T07:00:58.318929+0000","last_peered":"2023-11-20T07:00:58.318929+0000","last_clean":"2023-11-20T07:00:58.318929+0000","last_became_active":"2023-11-20T07:00:54.302616+0000","last_became_peered":"2023-11-20T07:00:54.302616+0000","last_unstale":"2023-11-20T07:00:58.318929+0000","last_undegraded":"2023-11-20T07:00:58.318929+0000","last_fullsized":"2023-11-20T07:00:58.318929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:23:17.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316083+0000","last_change":"2023-11-20T07:00:54.310934+0000","last_active":"2023-11-20T07:00:58.316083+0000","last_peered":"2023-11-20T07:00:58.316083+0000","last_clean":"2023-11-20T07:00:58.316083+0000","last_became_active":"2023-11-20T07:00:54.306577+0000","last_became_peered":"2023-11-20T07:00:54.306577+0000","last_unstale":"2023-11-20T07:00:58.316083+0000","last_undegraded":"2023-11-20T07:00:58.316083+0000","last_fullsized":"2023-11-20T07:00:58.316083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494543+0000","last_change":"2023-11-20T07:00:54.313082+0000","last_active":"2023-11-20T07:00:58.494543+0000","last_peered":"2023-11-20T07:00:58.494543+0000","last_clean":"2023-11-20T07:00:58.494543+0000","last_became_active":"2023-11-20T07:00:54.312728+0000","last_became_peered":"2023-11-20T07:00:54.312728+0000","last_unstale":"2023-11-20T07:00:58.494543+0000","last_undegraded":"2023-11-20T07:00:58.494543+0000","last_fullsized":"2023-11-20T07:00:58.494543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:04.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T07:01:18.602 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T07:01:18.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.774+0000 7f6a9bd3e640 1 Processor -- start 2023-11-20T07:01:18.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.774+0000 7f6a9bd3e640 1 -- start start 2023-11-20T07:01:18.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a9bd3e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a940b00e0 0x7f6a940b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a9bd3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a940cca20 0x7f6a940cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a9bd3e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a940cb1d0 con 0x7f6a9415a880 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a9bd3e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a940b0ab0 con 0x7f6a940b00e0 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a9bd3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a940cb4b0 con 0x7f6a940cca20 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a992d9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a940b00e0 0x7f6a940b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a99ada640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6a9415a880 0x7f6a9415dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52432/0 (socket says 172.21.15.88:52432) 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a99ada640 1 -- 172.21.15.88:0/730472003 learned_addr learned my addr 172.21.15.88:0/730472003 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a9a2db640 1 --2- 172.21.15.88:0/730472003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a940cca20 0x7f6a940cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a992d9640 1 -- 172.21.15.88:0/730472003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a940cca20 msgr2=0x7f6a940cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a992d9640 1 --2- 172.21.15.88:0/730472003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a940cca20 0x7f6a940cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a992d9640 1 -- 172.21.15.88:0/730472003 >> v1:172.21.15.88:6789/0 conn(0x7f6a9415a880 legacy=0x7f6a9415dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a98ad8640 1 -- 172.21.15.88:0/730472003 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992945141 0 0) 0x7f6a940cb1d0 con 0x7f6a9415a880 2023-11-20T07:01:18.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.778+0000 7f6a992d9640 1 -- 172.21.15.88:0/730472003 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a940cb790 con 0x7f6a940b00e0 2023-11-20T07:01:18.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a992d9640 1 --2- 172.21.15.88:0/730472003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a940b00e0 0x7f6a940b0570 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a840097c0 tx=0x7f6a8401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1599ba25e8b198cb server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:18.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a98ad8640 1 -- 172.21.15.88:0/730472003 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840ab600 con 0x7f6a940b00e0 2023-11-20T07:01:18.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a98ad8640 1 -- 172.21.15.88:0/730472003 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a840a7050 con 0x7f6a940b00e0 2023-11-20T07:01:18.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a98ad8640 1 -- 172.21.15.88:0/730472003 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840ab980 con 0x7f6a940b00e0 2023-11-20T07:01:18.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/730472003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a940b00e0 msgr2=0x7f6a940b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a9bd3e640 1 --2- 172.21.15.88:0/730472003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a940b00e0 0x7f6a940b0570 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a840097c0 tx=0x7f6a8401c480 comp rx=0 tx=0).stop 2023-11-20T07:01:18.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/730472003 shutdown_connections 2023-11-20T07:01:18.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a9bd3e640 1 --2- 172.21.15.88:0/730472003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a940cca20 0x7f6a940cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a9bd3e640 1 --2- 172.21.15.88:0/730472003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a940b00e0 0x7f6a940b0570 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/730472003 >> 172.21.15.88:0/730472003 conn(0x7f6a9406c190 msgr2=0x7f6a9406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:18.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/730472003 shutdown_connections 2023-11-20T07:01:18.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/730472003 wait complete. 2023-11-20T07:01:18.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a9bd3e640 1 Processor -- start 2023-11-20T07:01:18.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.782+0000 7f6a9bd3e640 1 -- start start 2023-11-20T07:01:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a9bd3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a940b00e0 0x7f6a940b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a9bd3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a940cca20 0x7f6a94157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a9bd3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a9415a880 0x7f6a9415f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a9bd3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a941597d0 con 0x7f6a940cca20 2023-11-20T07:01:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a9bd3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a94159210 con 0x7f6a940b00e0 2023-11-20T07:01:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a9bd3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a941594f0 con 0x7f6a9415a880 2023-11-20T07:01:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a992d9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a940cca20 0x7f6a94157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a992d9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a940cca20 0x7f6a94157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53864/0 (socket says 172.21.15.88:53864) 2023-11-20T07:01:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a992d9640 1 -- 172.21.15.88:0/4063101393 learned_addr learned my addr 172.21.15.88:0/4063101393 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a99ada640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a940b00e0 0x7f6a940b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a9a2db640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a9415a880 0x7f6a9415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a992d9640 1 -- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a9415a880 msgr2=0x7f6a9415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a992d9640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a9415a880 0x7f6a9415f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a992d9640 1 -- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a940b00e0 msgr2=0x7f6a940b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a992d9640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a940b00e0 0x7f6a940b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a992d9640 1 -- 172.21.15.88:0/4063101393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a84009420 con 0x7f6a940cca20 2023-11-20T07:01:18.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a992d9640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a940cca20 0x7f6a94157c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6a840ae040 tx=0x7f6a84019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:18.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a8a7fc640 1 -- 172.21.15.88:0/4063101393 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840b4840 con 0x7f6a940cca20 2023-11-20T07:01:18.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a8a7fc640 1 -- 172.21.15.88:0/4063101393 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a840b49c0 con 0x7f6a940cca20 2023-11-20T07:01:18.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/4063101393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a940c20f0 con 0x7f6a940cca20 2023-11-20T07:01:18.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a8a7fc640 1 -- 172.21.15.88:0/4063101393 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840b4d70 con 0x7f6a940cca20 2023-11-20T07:01:18.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/4063101393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a941581c0 con 0x7f6a940cca20 2023-11-20T07:01:18.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/4063101393 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a940c1f50 con 0x7f6a940cca20 2023-11-20T07:01:18.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.786+0000 7f6a8a7fc640 1 -- 172.21.15.88:0/4063101393 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6a840b2040 con 0x7f6a940cca20 2023-11-20T07:01:18.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.790+0000 7f6a8a7fc640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6a780664a0 0x7f6a78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:18.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.790+0000 7f6a8a7fc640 1 -- 172.21.15.88:0/4063101393 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6a8411e990 con 0x7f6a940cca20 2023-11-20T07:01:18.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.790+0000 7f6a99ada640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6a780664a0 0x7f6a78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:18.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.790+0000 7f6a99ada640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6a780664a0 0x7f6a78068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007fd0 tx=0x7f6a90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:18.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.790+0000 7f6a8a7fc640 1 -- 172.21.15.88:0/4063101393 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6a840ebcb0 con 0x7f6a940cca20 2023-11-20T07:01:18.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.938+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/4063101393 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a940c90a0 con 0x7f6a780664a0 2023-11-20T07:01:18.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.946+0000 7f6a8a7fc640 1 -- 172.21.15.88:0/4063101393 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345325 (secure 0 0 0) 0x7f6a90001cb0 con 0x7f6a780664a0 2023-11-20T07:01:18.950 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:18.952 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-20T07:01:18.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.950+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6a780664a0 msgr2=0x7f6a78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.950+0000 7f6a9bd3e640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6a780664a0 0x7f6a78068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007fd0 tx=0x7f6a90009040 comp rx=0 tx=0).stop 2023-11-20T07:01:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.950+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/4063101393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a940cca20 msgr2=0x7f6a94157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.950+0000 7f6a9bd3e640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a940cca20 0x7f6a94157c80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6a840ae040 tx=0x7f6a84019220 comp rx=0 tx=0).stop 2023-11-20T07:01:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.950+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/4063101393 shutdown_connections 2023-11-20T07:01:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.950+0000 7f6a9bd3e640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6a780664a0 0x7f6a78068960 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.950+0000 7f6a9bd3e640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a9415a880 0x7f6a9415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.950+0000 7f6a9bd3e640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a940cca20 0x7f6a94157c80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.950+0000 7f6a9bd3e640 1 --2- 172.21.15.88:0/4063101393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a940b00e0 0x7f6a940b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.950+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/4063101393 >> 172.21.15.88:0/4063101393 conn(0x7f6a9406c190 msgr2=0x7f6a9415e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.950+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/4063101393 shutdown_connections 2023-11-20T07:01:18.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:18.950+0000 7f6a9bd3e640 1 -- 172.21.15.88:0/4063101393 wait complete. 2023-11-20T07:01:18.970 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-11-20T07:01:17.536354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3284992,"data_stored":1988254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003362"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326844+0000","last_change":"2023-11-20T07:00:53.659408+0000","last_active":"2023-11-20T07:00:58.326844+0000","last_peered":"2023-11-20T07:00:58.326844+0000","last_clean":"2023-11-20T07:00:58.326844+0000","last_became_active":"2023-11-20T07:00:53.658981+0000","last_became_peered":"2023-11-20T07:00:53.658981+0000","last_unstale":"2023-11-20T07:00:58.326844+0000","last_undegraded":"2023-11-20T07:00:58.326844+0000","last_fullsized":"2023-11-20T07:00:58.326844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:10.249731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.304069+0000","last_change":"2023-11-20T07:00:54.314501+0000","last_active":"2023-11-20T07:00:58.304069+0000","last_peered":"2023-11-20T07:00:58.304069+0000","last_clean":"2023-11-20T07:00:58.304069+0000","last_became_active":"2023-11-20T07:00:54.314212+0000","last_became_peered":"2023-11-20T07:00:54.314212+0000","last_unstale":"2023-11-20T07:00:58.304069+0000","last_undegraded":"2023-11-20T07:00:58.304069+0000","last_fullsized":"2023-11-20T07:00:58.304069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:43.757635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805339+0000","last_change":"2023-11-20T07:00:58.500585+0000","last_active":"2023-11-20T07:00:59.805339+0000","last_peered":"2023-11-20T07:00:59.805339+0000","last_clean":"2023-11-20T07:00:59.805339+0000","last_became_active":"2023-11-20T07:00:58.500209+0000","last_became_peered":"2023-11-20T07:00:58.500209+0000","last_unstale":"2023-11-20T07:00:59.805339+0000","last_undegraded":"2023-11-20T07:00:59.805339+0000","last_fullsized":"2023-11-20T07:00:59.805339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:10:13.701470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.304262+0000","last_change":"2023-11-20T07:00:53.652110+0000","last_active":"2023-11-20T07:00:58.304262+0000","last_peered":"2023-11-20T07:00:58.304262+0000","last_clean":"2023-11-20T07:00:58.304262+0000","last_became_active":"2023-11-20T07:00:53.651824+0000","last_became_peered":"2023-11-20T07:00:53.651824+0000","last_unstale":"2023-11-20T07:00:58.304262+0000","last_undegraded":"2023-11-20T07:00:58.304262+0000","last_fullsized":"2023-11-20T07:00:58.304262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:16.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326690+0000","last_change":"2023-11-20T07:00:54.318618+0000","last_active":"2023-11-20T07:00:58.326690+0000","last_peered":"2023-11-20T07:00:58.326690+0000","last_clean":"2023-11-20T07:00:58.326690+0000","last_became_active":"2023-11-20T07:00:54.318411+0000","last_became_peered":"2023-11-20T07:00:54.318411+0000","last_unstale":"2023-11-20T07:00:58.326690+0000","last_undegraded":"2023-11-20T07:00:58.326690+0000","last_fullsized":"2023-11-20T07:00:58.326690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:16.073686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307275+0000","last_change":"2023-11-20T07:00:58.320861+0000","last_active":"2023-11-20T07:00:59.307275+0000","last_peered":"2023-11-20T07:00:59.307275+0000","last_clean":"2023-11-20T07:00:59.307275+0000","last_became_active":"2023-11-20T07:00:58.320417+0000","last_became_peered":"2023-11-20T07:00:58.320417+0000","last_unstale":"2023-11-20T07:00:59.307275+0000","last_undegraded":"2023-11-20T07:00:59.307275+0000","last_fullsized":"2023-11-20T07:00:59.307275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:22.712728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494050+0000","last_change":"2023-11-20T07:00:53.656292+0000","last_active":"2023-11-20T07:00:58.494050+0000","last_peered":"2023-11-20T07:00:58.494050+0000","last_clean":"2023-11-20T07:00:58.494050+0000","last_became_active":"2023-11-20T07:00:53.656026+0000","last_became_peered":"2023-11-20T07:00:53.656026+0000","last_unstale":"2023-11-20T07:00:58.494050+0000","last_undegraded":"2023-11-20T07:00:58.494050+0000","last_fullsized":"2023-11-20T07:00:58.494050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:38.340586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317862+0000","last_change":"2023-11-20T07:00:54.322765+0000","last_active":"2023-11-20T07:00:58.317862+0000","last_peered":"2023-11-20T07:00:58.317862+0000","last_clean":"2023-11-20T07:00:58.317862+0000","last_became_active":"2023-11-20T07:00:54.322547+0000","last_became_peered":"2023-11-20T07:00:54.322547+0000","last_unstale":"2023-11-20T07:00:58.317862+0000","last_undegraded":"2023-11-20T07:00:58.317862+0000","last_fullsized":"2023-11-20T07:00:58.317862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:41:56.805008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307365+0000","last_change":"2023-11-20T07:00:58.325322+0000","last_active":"2023-11-20T07:00:59.307365+0000","last_peered":"2023-11-20T07:00:59.307365+0000","last_clean":"2023-11-20T07:00:59.307365+0000","last_became_active":"2023-11-20T07:00:58.324869+0000","last_became_peered":"2023-11-20T07:00:58.324869+0000","last_unstale":"2023-11-20T07:00:59.307365+0000","last_undegraded":"2023-11-20T07:00:59.307365+0000","last_fullsized":"2023-11-20T07:00:59.307365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:43.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493286+0000","last_change":"2023-11-20T07:00:53.661990+0000","last_active":"2023-11-20T07:00:58.493286+0000","last_peered":"2023-11-20T07:00:58.493286+0000","last_clean":"2023-11-20T07:00:58.493286+0000","last_became_active":"2023-11-20T07:00:53.661634+0000","last_became_peered":"2023-11-20T07:00:53.661634+0000","last_unstale":"2023-11-20T07:00:58.493286+0000","last_undegraded":"2023-11-20T07:00:58.493286+0000","last_fullsized":"2023-11-20T07:00:58.493286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:44.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318481+0000","last_change":"2023-11-20T07:00:54.322610+0000","last_active":"2023-11-20T07:00:58.318481+0000","last_peered":"2023-11-20T07:00:58.318481+0000","last_clean":"2023-11-20T07:00:58.318481+0000","last_became_active":"2023-11-20T07:00:54.322196+0000","last_became_peered":"2023-11-20T07:00:54.322196+0000","last_unstale":"2023-11-20T07:00:58.318481+0000","last_undegraded":"2023-11-20T07:00:58.318481+0000","last_fullsized":"2023-11-20T07:00:58.318481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:34.029377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307622+0000","last_change":"2023-11-20T07:00:58.326848+0000","last_active":"2023-11-20T07:00:59.307622+0000","last_peered":"2023-11-20T07:00:59.307622+0000","last_clean":"2023-11-20T07:00:59.307622+0000","last_became_active":"2023-11-20T07:00:58.326426+0000","last_became_peered":"2023-11-20T07:00:58.326426+0000","last_unstale":"2023-11-20T07:00:59.307622+0000","last_undegraded":"2023-11-20T07:00:59.307622+0000","last_fullsized":"2023-11-20T07:00:59.307622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:21.571196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310719+0000","last_change":"2023-11-20T07:00:54.313413+0000","last_active":"2023-11-20T07:00:58.310719+0000","last_peered":"2023-11-20T07:00:58.310719+0000","last_clean":"2023-11-20T07:00:58.310719+0000","last_became_active":"2023-11-20T07:00:54.311349+0000","last_became_peered":"2023-11-20T07:00:54.311349+0000","last_unstale":"2023-11-20T07:00:58.310719+0000","last_undegraded":"2023-11-20T07:00:58.310719+0000","last_fullsized":"2023-11-20T07:00:58.310719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493287+0000","last_change":"2023-11-20T07:00:53.653466+0000","last_active":"2023-11-20T07:00:58.493287+0000","last_peered":"2023-11-20T07:00:58.493287+0000","last_clean":"2023-11-20T07:00:58.493287+0000","last_became_active":"2023-11-20T07:00:53.653211+0000","last_became_peered":"2023-11-20T07:00:53.653211+0000","last_unstale":"2023-11-20T07:00:58.493287+0000","last_undegraded":"2023-11-20T07:00:58.493287+0000","last_fullsized":"2023-11-20T07:00:58.493287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308698+0000","last_change":"2023-11-20T07:00:58.326758+0000","last_active":"2023-11-20T07:00:59.308698+0000","last_peered":"2023-11-20T07:00:59.308698+0000","last_clean":"2023-11-20T07:00:59.308698+0000","last_became_active":"2023-11-20T07:00:58.326338+0000","last_became_peered":"2023-11-20T07:00:58.326338+0000","last_unstale":"2023-11-20T07:00:59.308698+0000","last_undegraded":"2023-11-20T07:00:59.308698+0000","last_fullsized":"2023-11-20T07:00:59.308698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:37.701282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303367+0000","last_change":"2023-11-20T07:00:54.316618+0000","last_active":"2023-11-20T07:00:58.303367+0000","last_peered":"2023-11-20T07:00:58.303367+0000","last_clean":"2023-11-20T07:00:58.303367+0000","last_became_active":"2023-11-20T07:00:54.316344+0000","last_became_peered":"2023-11-20T07:00:54.316344+0000","last_unstale":"2023-11-20T07:00:58.303367+0000","last_undegraded":"2023-11-20T07:00:58.303367+0000","last_fullsized":"2023-11-20T07:00:58.303367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.319497+0000","last_change":"2023-11-20T07:00:53.648232+0000","last_active":"2023-11-20T07:00:58.319497+0000","last_peered":"2023-11-20T07:00:58.319497+0000","last_clean":"2023-11-20T07:00:58.319497+0000","last_became_active":"2023-11-20T07:00:53.647945+0000","last_became_peered":"2023-11-20T07:00:53.647945+0000","last_unstale":"2023-11-20T07:00:58.319497+0000","last_undegraded":"2023-11-20T07:00:58.319497+0000","last_fullsized":"2023-11-20T07:00:58.319497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:23:16.836796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308291+0000","last_change":"2023-11-20T07:00:58.328131+0000","last_active":"2023-11-20T07:00:59.308291+0000","last_peered":"2023-11-20T07:00:59.308291+0000","last_clean":"2023-11-20T07:00:59.308291+0000","last_became_active":"2023-11-20T07:00:58.327741+0000","last_became_peered":"2023-11-20T07:00:58.327741+0000","last_unstale":"2023-11-20T07:00:59.308291+0000","last_undegraded":"2023-11-20T07:00:59.308291+0000","last_fullsized":"2023-11-20T07:00:59.308291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:12.994548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303298+0000","last_change":"2023-11-20T07:00:54.310162+0000","last_active":"2023-11-20T07:00:58.303298+0000","last_peered":"2023-11-20T07:00:58.303298+0000","last_clean":"2023-11-20T07:00:58.303298+0000","last_became_active":"2023-11-20T07:00:54.309901+0000","last_became_peered":"2023-11-20T07:00:54.309901+0000","last_unstale":"2023-11-20T07:00:58.303298+0000","last_undegraded":"2023-11-20T07:00:58.303298+0000","last_fullsized":"2023-11-20T07:00:58.303298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316319+0000","last_change":"2023-11-20T07:00:53.647565+0000","last_active":"2023-11-20T07:00:58.316319+0000","last_peered":"2023-11-20T07:00:58.316319+0000","last_clean":"2023-11-20T07:00:58.316319+0000","last_became_active":"2023-11-20T07:00:53.647292+0000","last_became_peered":"2023-11-20T07:00:53.647292+0000","last_unstale":"2023-11-20T07:00:58.316319+0000","last_undegraded":"2023-11-20T07:00:58.316319+0000","last_fullsized":"2023-11-20T07:00:58.316319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:06.154369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.808266+0000","last_change":"2023-11-20T07:00:58.499121+0000","last_active":"2023-11-20T07:00:59.808266+0000","last_peered":"2023-11-20T07:00:59.808266+0000","last_clean":"2023-11-20T07:00:59.808266+0000","last_became_active":"2023-11-20T07:00:58.498681+0000","last_became_peered":"2023-11-20T07:00:58.498681+0000","last_unstale":"2023-11-20T07:00:59.808266+0000","last_undegraded":"2023-11-20T07:00:59.808266+0000","last_fullsized":"2023-11-20T07:00:59.808266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:19:25.697324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310377+0000","last_change":"2023-11-20T07:00:54.307003+0000","last_active":"2023-11-20T07:00:58.310377+0000","last_peered":"2023-11-20T07:00:58.310377+0000","last_clean":"2023-11-20T07:00:58.310377+0000","last_became_active":"2023-11-20T07:00:54.306416+0000","last_became_peered":"2023-11-20T07:00:54.306416+0000","last_unstale":"2023-11-20T07:00:58.310377+0000","last_undegraded":"2023-11-20T07:00:58.310377+0000","last_fullsized":"2023-11-20T07:00:58.310377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:00:19.316968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.492960+0000","last_change":"2023-11-20T07:00:53.658929+0000","last_active":"2023-11-20T07:00:58.492960+0000","last_peered":"2023-11-20T07:00:58.492960+0000","last_clean":"2023-11-20T07:00:58.492960+0000","last_became_active":"2023-11-20T07:00:53.656722+0000","last_became_peered":"2023-11-20T07:00:53.656722+0000","last_unstale":"2023-11-20T07:00:58.492960+0000","last_undegraded":"2023-11-20T07:00:58.492960+0000","last_fullsized":"2023-11-20T07:00:58.492960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:18.352244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308589+0000","last_change":"2023-11-20T07:00:58.328021+0000","last_active":"2023-11-20T07:00:59.308589+0000","last_peered":"2023-11-20T07:00:59.308589+0000","last_clean":"2023-11-20T07:00:59.308589+0000","last_became_active":"2023-11-20T07:00:58.327571+0000","last_became_peered":"2023-11-20T07:00:58.327571+0000","last_unstale":"2023-11-20T07:00:59.308589+0000","last_undegraded":"2023-11-20T07:00:59.308589+0000","last_fullsized":"2023-11-20T07:00:59.308589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:45.316086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326462+0000","last_change":"2023-11-20T07:00:54.307130+0000","last_active":"2023-11-20T07:00:58.326462+0000","last_peered":"2023-11-20T07:00:58.326462+0000","last_clean":"2023-11-20T07:00:58.326462+0000","last_became_active":"2023-11-20T07:00:54.306858+0000","last_became_peered":"2023-11-20T07:00:54.306858+0000","last_unstale":"2023-11-20T07:00:58.326462+0000","last_undegraded":"2023-11-20T07:00:58.326462+0000","last_fullsized":"2023-11-20T07:00:58.326462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:07.160493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311818+0000","last_change":"2023-11-20T07:00:53.658355+0000","last_active":"2023-11-20T07:00:58.311818+0000","last_peered":"2023-11-20T07:00:58.311818+0000","last_clean":"2023-11-20T07:00:58.311818+0000","last_became_active":"2023-11-20T07:00:53.657868+0000","last_became_peered":"2023-11-20T07:00:53.657868+0000","last_unstale":"2023-11-20T07:00:58.311818+0000","last_undegraded":"2023-11-20T07:00:58.311818+0000","last_fullsized":"2023-11-20T07:00:58.311818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308040+0000","last_change":"2023-11-20T07:00:58.500426+0000","last_active":"2023-11-20T07:00:59.308040+0000","last_peered":"2023-11-20T07:00:59.308040+0000","last_clean":"2023-11-20T07:00:59.308040+0000","last_became_active":"2023-11-20T07:00:58.498422+0000","last_became_peered":"2023-11-20T07:00:58.498422+0000","last_unstale":"2023-11-20T07:00:59.308040+0000","last_undegraded":"2023-11-20T07:00:59.308040+0000","last_fullsized":"2023-11-20T07:00:59.308040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:47.429541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.305106+0000","last_change":"2023-11-20T07:00:54.317201+0000","last_active":"2023-11-20T07:00:58.305106+0000","last_peered":"2023-11-20T07:00:58.305106+0000","last_clean":"2023-11-20T07:00:58.305106+0000","last_became_active":"2023-11-20T07:00:54.316914+0000","last_became_peered":"2023-11-20T07:00:54.316914+0000","last_unstale":"2023-11-20T07:00:58.305106+0000","last_undegraded":"2023-11-20T07:00:58.305106+0000","last_fullsized":"2023-11-20T07:00:58.305106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:09.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316138+0000","last_change":"2023-11-20T07:00:53.645493+0000","last_active":"2023-11-20T07:00:58.316138+0000","last_peered":"2023-11-20T07:00:58.316138+0000","last_clean":"2023-11-20T07:00:58.316138+0000","last_became_active":"2023-11-20T07:00:53.644350+0000","last_became_peered":"2023-11-20T07:00:53.644350+0000","last_unstale":"2023-11-20T07:00:58.316138+0000","last_undegraded":"2023-11-20T07:00:58.316138+0000","last_fullsized":"2023-11-20T07:00:58.316138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806145+0000","last_change":"2023-11-20T07:00:58.499371+0000","last_active":"2023-11-20T07:00:59.806145+0000","last_peered":"2023-11-20T07:00:59.806145+0000","last_clean":"2023-11-20T07:00:59.806145+0000","last_became_active":"2023-11-20T07:00:58.498953+0000","last_became_peered":"2023-11-20T07:00:58.498953+0000","last_unstale":"2023-11-20T07:00:59.806145+0000","last_undegraded":"2023-11-20T07:00:59.806145+0000","last_fullsized":"2023-11-20T07:00:59.806145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:03:22.099699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318416+0000","last_change":"2023-11-20T07:00:54.309275+0000","last_active":"2023-11-20T07:00:58.318416+0000","last_peered":"2023-11-20T07:00:58.318416+0000","last_clean":"2023-11-20T07:00:58.318416+0000","last_became_active":"2023-11-20T07:00:54.309012+0000","last_became_peered":"2023-11-20T07:00:54.309012+0000","last_unstale":"2023-11-20T07:00:58.318416+0000","last_undegraded":"2023-11-20T07:00:58.318416+0000","last_fullsized":"2023-11-20T07:00:58.318416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494554+0000","last_change":"2023-11-20T07:00:53.654465+0000","last_active":"2023-11-20T07:00:58.494554+0000","last_peered":"2023-11-20T07:00:58.494554+0000","last_clean":"2023-11-20T07:00:58.494554+0000","last_became_active":"2023-11-20T07:00:53.654148+0000","last_became_peered":"2023-11-20T07:00:53.654148+0000","last_unstale":"2023-11-20T07:00:58.494554+0000","last_undegraded":"2023-11-20T07:00:58.494554+0000","last_fullsized":"2023-11-20T07:00:58.494554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:38.670481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806267+0000","last_change":"2023-11-20T07:00:58.503543+0000","last_active":"2023-11-20T07:00:59.806267+0000","last_peered":"2023-11-20T07:00:59.806267+0000","last_clean":"2023-11-20T07:00:59.806267+0000","last_became_active":"2023-11-20T07:00:58.502762+0000","last_became_peered":"2023-11-20T07:00:58.502762+0000","last_unstale":"2023-11-20T07:00:59.806267+0000","last_undegraded":"2023-11-20T07:00:59.806267+0000","last_fullsized":"2023-11-20T07:00:59.806267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:45.316086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318563+0000","last_change":"2023-11-20T07:00:54.316224+0000","last_active":"2023-11-20T07:00:58.318563+0000","last_peered":"2023-11-20T07:00:58.318563+0000","last_clean":"2023-11-20T07:00:58.318563+0000","last_became_active":"2023-11-20T07:00:54.315909+0000","last_became_peered":"2023-11-20T07:00:54.315909+0000","last_unstale":"2023-11-20T07:00:58.318563+0000","last_undegraded":"2023-11-20T07:00:58.318563+0000","last_fullsized":"2023-11-20T07:00:58.318563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:04.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318503+0000","last_change":"2023-11-20T07:00:53.650522+0000","last_active":"2023-11-20T07:00:58.318503+0000","last_peered":"2023-11-20T07:00:58.318503+0000","last_clean":"2023-11-20T07:00:58.318503+0000","last_became_active":"2023-11-20T07:00:53.649787+0000","last_became_peered":"2023-11-20T07:00:53.649787+0000","last_unstale":"2023-11-20T07:00:58.318503+0000","last_undegraded":"2023-11-20T07:00:58.318503+0000","last_fullsized":"2023-11-20T07:00:58.318503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:18.352244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805309+0000","last_change":"2023-11-20T07:00:58.329318+0000","last_active":"2023-11-20T07:00:59.805309+0000","last_peered":"2023-11-20T07:00:59.805309+0000","last_clean":"2023-11-20T07:00:59.805309+0000","last_became_active":"2023-11-20T07:00:58.327572+0000","last_became_peered":"2023-11-20T07:00:58.327572+0000","last_unstale":"2023-11-20T07:00:59.805309+0000","last_undegraded":"2023-11-20T07:00:59.805309+0000","last_fullsized":"2023-11-20T07:00:59.805309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:34.090825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310713+0000","last_change":"2023-11-20T07:00:54.300938+0000","last_active":"2023-11-20T07:00:58.310713+0000","last_peered":"2023-11-20T07:00:58.310713+0000","last_clean":"2023-11-20T07:00:58.310713+0000","last_became_active":"2023-11-20T07:00:54.300489+0000","last_became_peered":"2023-11-20T07:00:54.300489+0000","last_unstale":"2023-11-20T07:00:58.310713+0000","last_undegraded":"2023-11-20T07:00:58.310713+0000","last_fullsized":"2023-11-20T07:00:58.310713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:19.358368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318471+0000","last_change":"2023-11-20T07:00:53.657372+0000","last_active":"2023-11-20T07:00:58.318471+0000","last_peered":"2023-11-20T07:00:58.318471+0000","last_clean":"2023-11-20T07:00:58.318471+0000","last_became_active":"2023-11-20T07:00:53.656783+0000","last_became_peered":"2023-11-20T07:00:53.656783+0000","last_unstale":"2023-11-20T07:00:58.318471+0000","last_undegraded":"2023-11-20T07:00:58.318471+0000","last_fullsized":"2023-11-20T07:00:58.318471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:06.245657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806936+0000","last_change":"2023-11-20T07:00:58.334074+0000","last_active":"2023-11-20T07:00:59.806936+0000","last_peered":"2023-11-20T07:00:59.806936+0000","last_clean":"2023-11-20T07:00:59.806936+0000","last_became_active":"2023-11-20T07:00:58.333819+0000","last_became_peered":"2023-11-20T07:00:58.333819+0000","last_unstale":"2023-11-20T07:00:59.806936+0000","last_undegraded":"2023-11-20T07:00:59.806936+0000","last_fullsized":"2023-11-20T07:00:59.806936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:08.554606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.315908+0000","last_change":"2023-11-20T07:00:54.308292+0000","last_active":"2023-11-20T07:00:58.315908+0000","last_peered":"2023-11-20T07:00:58.315908+0000","last_clean":"2023-11-20T07:00:58.315908+0000","last_became_active":"2023-11-20T07:00:54.306747+0000","last_became_peered":"2023-11-20T07:00:54.306747+0000","last_unstale":"2023-11-20T07:00:58.315908+0000","last_undegraded":"2023-11-20T07:00:58.315908+0000","last_fullsized":"2023-11-20T07:00:58.315908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.312862+0000","last_change":"2023-11-20T07:00:53.643036+0000","last_active":"2023-11-20T07:00:58.312862+0000","last_peered":"2023-11-20T07:00:58.312862+0000","last_clean":"2023-11-20T07:00:58.312862+0000","last_became_active":"2023-11-20T07:00:53.642571+0000","last_became_peered":"2023-11-20T07:00:53.642571+0000","last_unstale":"2023-11-20T07:00:58.312862+0000","last_undegraded":"2023-11-20T07:00:58.312862+0000","last_fullsized":"2023-11-20T07:00:58.312862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:44.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.808276+0000","last_change":"2023-11-20T07:00:58.333236+0000","last_active":"2023-11-20T07:00:59.808276+0000","last_peered":"2023-11-20T07:00:59.808276+0000","last_clean":"2023-11-20T07:00:59.808276+0000","last_became_active":"2023-11-20T07:00:58.332618+0000","last_became_peered":"2023-11-20T07:00:58.332618+0000","last_unstale":"2023-11-20T07:00:59.808276+0000","last_undegraded":"2023-11-20T07:00:59.808276+0000","last_fullsized":"2023-11-20T07:00:59.808276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:55:34.562598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318629+0000","last_change":"2023-11-20T07:00:54.297521+0000","last_active":"2023-11-20T07:00:58.318629+0000","last_peered":"2023-11-20T07:00:58.318629+0000","last_clean":"2023-11-20T07:00:58.318629+0000","last_became_active":"2023-11-20T07:00:54.297230+0000","last_became_peered":"2023-11-20T07:00:54.297230+0000","last_unstale":"2023-11-20T07:00:58.318629+0000","last_undegraded":"2023-11-20T07:00:58.318629+0000","last_fullsized":"2023-11-20T07:00:58.318629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:59:40.885687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.492983+0000","last_change":"2023-11-20T07:00:53.659113+0000","last_active":"2023-11-20T07:00:58.492983+0000","last_peered":"2023-11-20T07:00:58.492983+0000","last_clean":"2023-11-20T07:00:58.492983+0000","last_became_active":"2023-11-20T07:00:53.658547+0000","last_became_peered":"2023-11-20T07:00:53.658547+0000","last_unstale":"2023-11-20T07:00:58.492983+0000","last_undegraded":"2023-11-20T07:00:58.492983+0000","last_fullsized":"2023-11-20T07:00:58.492983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:38:48.212711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.807596+0000","last_change":"2023-11-20T07:00:58.503986+0000","last_active":"2023-11-20T07:00:59.807596+0000","last_peered":"2023-11-20T07:00:59.807596+0000","last_clean":"2023-11-20T07:00:59.807596+0000","last_became_active":"2023-11-20T07:00:58.503152+0000","last_became_peered":"2023-11-20T07:00:58.503152+0000","last_unstale":"2023-11-20T07:00:59.807596+0000","last_undegraded":"2023-11-20T07:00:59.807596+0000","last_fullsized":"2023-11-20T07:00:59.807596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:08.554606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.302885+0000","last_change":"2023-11-20T07:00:54.322661+0000","last_active":"2023-11-20T07:00:58.302885+0000","last_peered":"2023-11-20T07:00:58.302885+0000","last_clean":"2023-11-20T07:00:58.302885+0000","last_became_active":"2023-11-20T07:00:54.322420+0000","last_became_peered":"2023-11-20T07:00:54.322420+0000","last_unstale":"2023-11-20T07:00:58.302885+0000","last_undegraded":"2023-11-20T07:00:58.302885+0000","last_fullsized":"2023-11-20T07:00:58.302885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317887+0000","last_change":"2023-11-20T07:00:53.657962+0000","last_active":"2023-11-20T07:00:58.317887+0000","last_peered":"2023-11-20T07:00:58.317887+0000","last_clean":"2023-11-20T07:00:58.317887+0000","last_became_active":"2023-11-20T07:00:53.657573+0000","last_became_peered":"2023-11-20T07:00:53.657573+0000","last_unstale":"2023-11-20T07:00:58.317887+0000","last_undegraded":"2023-11-20T07:00:58.317887+0000","last_fullsized":"2023-11-20T07:00:58.317887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:20.103551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493065+0000","last_change":"2023-11-20T07:00:43.158695+0000","last_active":"2023-11-20T07:00:58.493065+0000","last_peered":"2023-11-20T07:00:58.493065+0000","last_clean":"2023-11-20T07:00:58.493065+0000","last_became_active":"2023-11-20T07:00:43.157454+0000","last_became_peered":"2023-11-20T07:00:43.157454+0000","last_unstale":"2023-11-20T07:00:58.493065+0000","last_undegraded":"2023-11-20T07:00:58.493065+0000","last_fullsized":"2023-11-20T07:00:58.493065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_clean_scrub_stamp":"2023-11-20T07:00:42.001721+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:44:20.907460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.306704+0000","last_change":"2023-11-20T07:00:58.498801+0000","last_active":"2023-11-20T07:00:59.306704+0000","last_peered":"2023-11-20T07:00:59.306704+0000","last_clean":"2023-11-20T07:00:59.306704+0000","last_became_active":"2023-11-20T07:00:58.498293+0000","last_became_peered":"2023-11-20T07:00:58.498293+0000","last_unstale":"2023-11-20T07:00:59.306704+0000","last_undegraded":"2023-11-20T07:00:59.306704+0000","last_fullsized":"2023-11-20T07:00:59.306704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:45.316086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493410+0000","last_change":"2023-11-20T07:00:54.327998+0000","last_active":"2023-11-20T07:00:58.493410+0000","last_peered":"2023-11-20T07:00:58.493410+0000","last_clean":"2023-11-20T07:00:58.493410+0000","last_became_active":"2023-11-20T07:00:54.327745+0000","last_became_peered":"2023-11-20T07:00:54.327745+0000","last_unstale":"2023-11-20T07:00:58.493410+0000","last_undegraded":"2023-11-20T07:00:58.493410+0000","last_fullsized":"2023-11-20T07:00:58.493410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:34.029377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.313957+0000","last_change":"2023-11-20T07:00:53.655190+0000","last_active":"2023-11-20T07:00:58.313957+0000","last_peered":"2023-11-20T07:00:58.313957+0000","last_clean":"2023-11-20T07:00:58.313957+0000","last_became_active":"2023-11-20T07:00:53.654911+0000","last_became_peered":"2023-11-20T07:00:53.654911+0000","last_unstale":"2023-11-20T07:00:58.313957+0000","last_undegraded":"2023-11-20T07:00:58.313957+0000","last_fullsized":"2023-11-20T07:00:58.313957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:00:18.310844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.306340+0000","last_change":"2023-11-20T07:00:58.494982+0000","last_active":"2023-11-20T07:00:59.306340+0000","last_peered":"2023-11-20T07:00:59.306340+0000","last_clean":"2023-11-20T07:00:59.306340+0000","last_became_active":"2023-11-20T07:00:58.494289+0000","last_became_peered":"2023-11-20T07:00:58.494289+0000","last_unstale":"2023-11-20T07:00:59.306340+0000","last_undegraded":"2023-11-20T07:00:59.306340+0000","last_fullsized":"2023-11-20T07:00:59.306340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:12.994548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317961+0000","last_change":"2023-11-20T07:00:54.313077+0000","last_active":"2023-11-20T07:00:58.317961+0000","last_peered":"2023-11-20T07:00:58.317961+0000","last_clean":"2023-11-20T07:00:58.317961+0000","last_became_active":"2023-11-20T07:00:54.312340+0000","last_became_peered":"2023-11-20T07:00:54.312340+0000","last_unstale":"2023-11-20T07:00:58.317961+0000","last_undegraded":"2023-11-20T07:00:58.317961+0000","last_fullsized":"2023-11-20T07:00:58.317961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:41.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317512+0000","last_change":"2023-11-20T07:00:53.645227+0000","last_active":"2023-11-20T07:00:58.317512+0000","last_peered":"2023-11-20T07:00:58.317512+0000","last_clean":"2023-11-20T07:00:58.317512+0000","last_became_active":"2023-11-20T07:00:53.644948+0000","last_became_peered":"2023-11-20T07:00:53.644948+0000","last_unstale":"2023-11-20T07:00:58.317512+0000","last_undegraded":"2023-11-20T07:00:58.317512+0000","last_fullsized":"2023-11-20T07:00:58.317512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:16.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806374+0000","last_change":"2023-11-20T07:00:58.328865+0000","last_active":"2023-11-20T07:00:59.806374+0000","last_peered":"2023-11-20T07:00:59.806374+0000","last_clean":"2023-11-20T07:00:59.806374+0000","last_became_active":"2023-11-20T07:00:58.326797+0000","last_became_peered":"2023-11-20T07:00:58.326797+0000","last_unstale":"2023-11-20T07:00:59.806374+0000","last_undegraded":"2023-11-20T07:00:59.806374+0000","last_fullsized":"2023-11-20T07:00:59.806374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:37.701282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494804+0000","last_change":"2023-11-20T07:00:54.322679+0000","last_active":"2023-11-20T07:00:58.494804+0000","last_peered":"2023-11-20T07:00:58.494804+0000","last_clean":"2023-11-20T07:00:58.494804+0000","last_became_active":"2023-11-20T07:00:54.322402+0000","last_became_peered":"2023-11-20T07:00:54.322402+0000","last_unstale":"2023-11-20T07:00:58.494804+0000","last_undegraded":"2023-11-20T07:00:58.494804+0000","last_fullsized":"2023-11-20T07:00:58.494804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:55:30.890692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.312002+0000","last_change":"2023-11-20T07:00:53.648554+0000","last_active":"2023-11-20T07:00:58.312002+0000","last_peered":"2023-11-20T07:00:58.312002+0000","last_clean":"2023-11-20T07:00:58.312002+0000","last_became_active":"2023-11-20T07:00:53.648235+0000","last_became_peered":"2023-11-20T07:00:53.648235+0000","last_unstale":"2023-11-20T07:00:58.312002+0000","last_undegraded":"2023-11-20T07:00:58.312002+0000","last_fullsized":"2023-11-20T07:00:58.312002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:18.352244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.804873+0000","last_change":"2023-11-20T07:00:58.495397+0000","last_active":"2023-11-20T07:00:59.804873+0000","last_peered":"2023-11-20T07:00:59.804873+0000","last_clean":"2023-11-20T07:00:59.804873+0000","last_became_active":"2023-11-20T07:00:58.494254+0000","last_became_peered":"2023-11-20T07:00:58.494254+0000","last_unstale":"2023-11-20T07:00:59.804873+0000","last_undegraded":"2023-11-20T07:00:59.804873+0000","last_fullsized":"2023-11-20T07:00:59.804873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:26.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494056+0000","last_change":"2023-11-20T07:00:54.323607+0000","last_active":"2023-11-20T07:00:58.494056+0000","last_peered":"2023-11-20T07:00:58.494056+0000","last_clean":"2023-11-20T07:00:58.494056+0000","last_became_active":"2023-11-20T07:00:54.322379+0000","last_became_peered":"2023-11-20T07:00:54.322379+0000","last_unstale":"2023-11-20T07:00:58.494056+0000","last_undegraded":"2023-11-20T07:00:58.494056+0000","last_fullsized":"2023-11-20T07:00:58.494056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:19.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310927+0000","last_change":"2023-11-20T07:00:53.649849+0000","last_active":"2023-11-20T07:00:58.310927+0000","last_peered":"2023-11-20T07:00:58.310927+0000","last_clean":"2023-11-20T07:00:58.310927+0000","last_became_active":"2023-11-20T07:00:53.649515+0000","last_became_peered":"2023-11-20T07:00:53.649515+0000","last_unstale":"2023-11-20T07:00:58.310927+0000","last_undegraded":"2023-11-20T07:00:58.310927+0000","last_fullsized":"2023-11-20T07:00:58.310927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307960+0000","last_change":"2023-11-20T07:00:58.323467+0000","last_active":"2023-11-20T07:00:59.307960+0000","last_peered":"2023-11-20T07:00:59.307960+0000","last_clean":"2023-11-20T07:00:59.307960+0000","last_became_active":"2023-11-20T07:00:58.323069+0000","last_became_peered":"2023-11-20T07:00:58.323069+0000","last_unstale":"2023-11-20T07:00:59.307960+0000","last_undegraded":"2023-11-20T07:00:59.307960+0000","last_fullsized":"2023-11-20T07:00:59.307960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:13.803757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493206+0000","last_change":"2023-11-20T07:00:54.319865+0000","last_active":"2023-11-20T07:00:58.493206+0000","last_peered":"2023-11-20T07:00:58.493206+0000","last_clean":"2023-11-20T07:00:58.493206+0000","last_became_active":"2023-11-20T07:00:54.319507+0000","last_became_peered":"2023-11-20T07:00:54.319507+0000","last_unstale":"2023-11-20T07:00:58.493206+0000","last_undegraded":"2023-11-20T07:00:58.493206+0000","last_fullsized":"2023-11-20T07:00:58.493206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:43.757635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.313020+0000","last_change":"2023-11-20T07:00:53.645113+0000","last_active":"2023-11-20T07:00:58.313020+0000","last_peered":"2023-11-20T07:00:58.313020+0000","last_clean":"2023-11-20T07:00:58.313020+0000","last_became_active":"2023-11-20T07:00:53.644649+0000","last_became_peered":"2023-11-20T07:00:53.644649+0000","last_unstale":"2023-11-20T07:00:58.313020+0000","last_undegraded":"2023-11-20T07:00:58.313020+0000","last_fullsized":"2023-11-20T07:00:58.313020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.807526+0000","last_change":"2023-11-20T07:00:58.331774+0000","last_active":"2023-11-20T07:00:59.807526+0000","last_peered":"2023-11-20T07:00:59.807526+0000","last_clean":"2023-11-20T07:00:59.807526+0000","last_became_active":"2023-11-20T07:00:58.331450+0000","last_became_peered":"2023-11-20T07:00:58.331450+0000","last_unstale":"2023-11-20T07:00:59.807526+0000","last_undegraded":"2023-11-20T07:00:59.807526+0000","last_fullsized":"2023-11-20T07:00:59.807526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:22.921101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.309552+0000","last_change":"2023-11-20T07:00:54.311720+0000","last_active":"2023-11-20T07:00:58.309552+0000","last_peered":"2023-11-20T07:00:58.309552+0000","last_clean":"2023-11-20T07:00:58.309552+0000","last_became_active":"2023-11-20T07:00:54.311043+0000","last_became_peered":"2023-11-20T07:00:54.311043+0000","last_unstale":"2023-11-20T07:00:58.309552+0000","last_undegraded":"2023-11-20T07:00:58.309552+0000","last_fullsized":"2023-11-20T07:00:58.309552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:16.073686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.309511+0000","last_change":"2023-11-20T07:00:53.641657+0000","last_active":"2023-11-20T07:00:58.309511+0000","last_peered":"2023-11-20T07:00:58.309511+0000","last_clean":"2023-11-20T07:00:58.309511+0000","last_became_active":"2023-11-20T07:00:53.641339+0000","last_became_peered":"2023-11-20T07:00:53.641339+0000","last_unstale":"2023-11-20T07:00:58.309511+0000","last_undegraded":"2023-11-20T07:00:58.309511+0000","last_fullsized":"2023-11-20T07:00:58.309511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:10.249731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806340+0000","last_change":"2023-11-20T07:00:58.499394+0000","last_active":"2023-11-20T07:00:59.806340+0000","last_peered":"2023-11-20T07:00:59.806340+0000","last_clean":"2023-11-20T07:00:59.806340+0000","last_became_active":"2023-11-20T07:00:58.498964+0000","last_became_peered":"2023-11-20T07:00:58.498964+0000","last_unstale":"2023-11-20T07:00:59.806340+0000","last_undegraded":"2023-11-20T07:00:59.806340+0000","last_fullsized":"2023-11-20T07:00:59.806340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:29:17.940481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493222+0000","last_change":"2023-11-20T07:00:54.322332+0000","last_active":"2023-11-20T07:00:58.493222+0000","last_peered":"2023-11-20T07:00:58.493222+0000","last_clean":"2023-11-20T07:00:58.493222+0000","last_became_active":"2023-11-20T07:00:54.322039+0000","last_became_peered":"2023-11-20T07:00:54.322039+0000","last_unstale":"2023-11-20T07:00:58.493222+0000","last_undegraded":"2023-11-20T07:00:58.493222+0000","last_fullsized":"2023-11-20T07:00:58.493222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:41.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318421+0000","last_change":"2023-11-20T07:00:53.658482+0000","last_active":"2023-11-20T07:00:58.318421+0000","last_peered":"2023-11-20T07:00:58.318421+0000","last_clean":"2023-11-20T07:00:58.318421+0000","last_became_active":"2023-11-20T07:00:53.657099+0000","last_became_peered":"2023-11-20T07:00:53.657099+0000","last_unstale":"2023-11-20T07:00:58.318421+0000","last_undegraded":"2023-11-20T07:00:58.318421+0000","last_fullsized":"2023-11-20T07:00:58.318421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:15.067561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805595+0000","last_change":"2023-11-20T07:00:58.495295+0000","last_active":"2023-11-20T07:00:59.805595+0000","last_peered":"2023-11-20T07:00:59.805595+0000","last_clean":"2023-11-20T07:00:59.805595+0000","last_became_active":"2023-11-20T07:00:58.494557+0000","last_became_peered":"2023-11-20T07:00:58.494557+0000","last_unstale":"2023-11-20T07:00:59.805595+0000","last_undegraded":"2023-11-20T07:00:59.805595+0000","last_fullsized":"2023-11-20T07:00:59.805595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:55:33.954628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.320074+0000","last_change":"2023-11-20T07:00:54.311785+0000","last_active":"2023-11-20T07:00:58.320074+0000","last_peered":"2023-11-20T07:00:58.320074+0000","last_clean":"2023-11-20T07:00:58.320074+0000","last_became_active":"2023-11-20T07:00:54.311435+0000","last_became_peered":"2023-11-20T07:00:54.311435+0000","last_unstale":"2023-11-20T07:00:58.320074+0000","last_undegraded":"2023-11-20T07:00:58.320074+0000","last_fullsized":"2023-11-20T07:00:58.320074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:27.408568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.319062+0000","last_change":"2023-11-20T07:00:53.651972+0000","last_active":"2023-11-20T07:00:58.319062+0000","last_peered":"2023-11-20T07:00:58.319062+0000","last_clean":"2023-11-20T07:00:58.319062+0000","last_became_active":"2023-11-20T07:00:53.651725+0000","last_became_peered":"2023-11-20T07:00:53.651725+0000","last_unstale":"2023-11-20T07:00:58.319062+0000","last_undegraded":"2023-11-20T07:00:58.319062+0000","last_fullsized":"2023-11-20T07:00:58.319062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:00:18.310844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806216+0000","last_change":"2023-11-20T07:00:58.498803+0000","last_active":"2023-11-20T07:00:59.806216+0000","last_peered":"2023-11-20T07:00:59.806216+0000","last_clean":"2023-11-20T07:00:59.806216+0000","last_became_active":"2023-11-20T07:00:58.498348+0000","last_became_peered":"2023-11-20T07:00:58.498348+0000","last_unstale":"2023-11-20T07:00:59.806216+0000","last_undegraded":"2023-11-20T07:00:59.806216+0000","last_fullsized":"2023-11-20T07:00:59.806216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:55:33.954628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493295+0000","last_change":"2023-11-20T07:00:54.320969+0000","last_active":"2023-11-20T07:00:58.493295+0000","last_peered":"2023-11-20T07:00:58.493295+0000","last_clean":"2023-11-20T07:00:58.493295+0000","last_became_active":"2023-11-20T07:00:54.320409+0000","last_became_peered":"2023-11-20T07:00:54.320409+0000","last_unstale":"2023-11-20T07:00:58.493295+0000","last_undegraded":"2023-11-20T07:00:58.493295+0000","last_fullsized":"2023-11-20T07:00:58.493295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:09.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:01:04.877592+0000","last_change":"2023-11-20T07:00:53.644264+0000","last_active":"2023-11-20T07:01:04.877592+0000","last_peered":"2023-11-20T07:01:04.877592+0000","last_clean":"2023-11-20T07:01:04.877592+0000","last_became_active":"2023-11-20T07:00:53.643140+0000","last_became_peered":"2023-11-20T07:00:53.643140+0000","last_unstale":"2023-11-20T07:01:04.877592+0000","last_undegraded":"2023-11-20T07:01:04.877592+0000","last_fullsized":"2023-11-20T07:01:04.877592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:34:36.600135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806734+0000","last_change":"2023-11-20T07:00:58.328933+0000","last_active":"2023-11-20T07:00:59.806734+0000","last_peered":"2023-11-20T07:00:59.806734+0000","last_clean":"2023-11-20T07:00:59.806734+0000","last_became_active":"2023-11-20T07:00:58.328561+0000","last_became_peered":"2023-11-20T07:00:58.328561+0000","last_unstale":"2023-11-20T07:00:59.806734+0000","last_undegraded":"2023-11-20T07:00:59.806734+0000","last_fullsized":"2023-11-20T07:00:59.806734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:22.921101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310790+0000","last_change":"2023-11-20T07:00:54.309203+0000","last_active":"2023-11-20T07:00:58.310790+0000","last_peered":"2023-11-20T07:00:58.310790+0000","last_clean":"2023-11-20T07:00:58.310790+0000","last_became_active":"2023-11-20T07:00:54.308899+0000","last_became_peered":"2023-11-20T07:00:54.308899+0000","last_unstale":"2023-11-20T07:00:58.310790+0000","last_undegraded":"2023-11-20T07:00:58.310790+0000","last_fullsized":"2023-11-20T07:00:58.310790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:34:37.606259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317463+0000","last_change":"2023-11-20T07:00:53.656825+0000","last_active":"2023-11-20T07:00:58.317463+0000","last_peered":"2023-11-20T07:00:58.317463+0000","last_clean":"2023-11-20T07:00:58.317463+0000","last_became_active":"2023-11-20T07:00:53.656508+0000","last_became_peered":"2023-11-20T07:00:53.656508+0000","last_unstale":"2023-11-20T07:00:58.317463+0000","last_undegraded":"2023-11-20T07:00:58.317463+0000","last_fullsized":"2023-11-20T07:00:58.317463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:10.249731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308277+0000","last_change":"2023-11-20T07:00:58.322540+0000","last_active":"2023-11-20T07:00:59.308277+0000","last_peered":"2023-11-20T07:00:59.308277+0000","last_clean":"2023-11-20T07:00:59.308277+0000","last_became_active":"2023-11-20T07:00:58.322104+0000","last_became_peered":"2023-11-20T07:00:58.322104+0000","last_unstale":"2023-11-20T07:00:59.308277+0000","last_undegraded":"2023-11-20T07:00:59.308277+0000","last_fullsized":"2023-11-20T07:00:59.308277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:42:00.476914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326762+0000","last_change":"2023-11-20T07:00:54.318615+0000","last_active":"2023-11-20T07:00:58.326762+0000","last_peered":"2023-11-20T07:00:58.326762+0000","last_clean":"2023-11-20T07:00:58.326762+0000","last_became_active":"2023-11-20T07:00:54.318374+0000","last_became_peered":"2023-11-20T07:00:54.318374+0000","last_unstale":"2023-11-20T07:00:58.326762+0000","last_undegraded":"2023-11-20T07:00:58.326762+0000","last_fullsized":"2023-11-20T07:00:58.326762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318588+0000","last_change":"2023-11-20T07:00:53.663688+0000","last_active":"2023-11-20T07:00:58.318588+0000","last_peered":"2023-11-20T07:00:58.318588+0000","last_clean":"2023-11-20T07:00:58.318588+0000","last_became_active":"2023-11-20T07:00:53.663314+0000","last_became_peered":"2023-11-20T07:00:53.663314+0000","last_unstale":"2023-11-20T07:00:58.318588+0000","last_undegraded":"2023-11-20T07:00:58.318588+0000","last_fullsized":"2023-11-20T07:00:58.318588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:38.340586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805253+0000","last_change":"2023-11-20T07:00:58.325558+0000","last_active":"2023-11-20T07:00:59.805253+0000","last_peered":"2023-11-20T07:00:59.805253+0000","last_clean":"2023-11-20T07:00:59.805253+0000","last_became_active":"2023-11-20T07:00:58.323820+0000","last_became_peered":"2023-11-20T07:00:58.323820+0000","last_unstale":"2023-11-20T07:00:59.805253+0000","last_undegraded":"2023-11-20T07:00:59.805253+0000","last_fullsized":"2023-11-20T07:00:59.805253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:56:08.258067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317817+0000","last_change":"2023-11-20T07:00:54.322025+0000","last_active":"2023-11-20T07:00:58.317817+0000","last_peered":"2023-11-20T07:00:58.317817+0000","last_clean":"2023-11-20T07:00:58.317817+0000","last_became_active":"2023-11-20T07:00:54.319123+0000","last_became_peered":"2023-11-20T07:00:54.319123+0000","last_unstale":"2023-11-20T07:00:58.317817+0000","last_undegraded":"2023-11-20T07:00:58.317817+0000","last_fullsized":"2023-11-20T07:00:58.317817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:30.418920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311738+0000","last_change":"2023-11-20T07:00:53.658099+0000","last_active":"2023-11-20T07:00:58.311738+0000","last_peered":"2023-11-20T07:00:58.311738+0000","last_clean":"2023-11-20T07:00:58.311738+0000","last_became_active":"2023-11-20T07:00:53.657497+0000","last_became_peered":"2023-11-20T07:00:53.657497+0000","last_unstale":"2023-11-20T07:00:58.311738+0000","last_undegraded":"2023-11-20T07:00:58.311738+0000","last_fullsized":"2023-11-20T07:00:58.311738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:59:39.879563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805495+0000","last_change":"2023-11-20T07:00:58.500441+0000","last_active":"2023-11-20T07:00:59.805495+0000","last_peered":"2023-11-20T07:00:59.805495+0000","last_clean":"2023-11-20T07:00:59.805495+0000","last_became_active":"2023-11-20T07:00:58.499609+0000","last_became_peered":"2023-11-20T07:00:58.499609+0000","last_unstale":"2023-11-20T07:00:59.805495+0000","last_undegraded":"2023-11-20T07:00:59.805495+0000","last_fullsized":"2023-11-20T07:00:59.805495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:26.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.807449+0000","last_change":"2023-11-20T07:00:58.503634+0000","last_active":"2023-11-20T07:00:59.807449+0000","last_peered":"2023-11-20T07:00:59.807449+0000","last_clean":"2023-11-20T07:00:59.807449+0000","last_became_active":"2023-11-20T07:00:58.503079+0000","last_became_peered":"2023-11-20T07:00:58.503079+0000","last_unstale":"2023-11-20T07:00:59.807449+0000","last_undegraded":"2023-11-20T07:00:59.807449+0000","last_fullsized":"2023-11-20T07:00:59.807449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:34.090825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316198+0000","last_change":"2023-11-20T07:00:54.313144+0000","last_active":"2023-11-20T07:00:58.316198+0000","last_peered":"2023-11-20T07:00:58.316198+0000","last_clean":"2023-11-20T07:00:58.316198+0000","last_became_active":"2023-11-20T07:00:54.312847+0000","last_became_peered":"2023-11-20T07:00:54.312847+0000","last_unstale":"2023-11-20T07:00:58.316198+0000","last_undegraded":"2023-11-20T07:00:58.316198+0000","last_fullsized":"2023-11-20T07:00:58.316198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318078+0000","last_change":"2023-11-20T07:00:53.653998+0000","last_active":"2023-11-20T07:00:58.318078+0000","last_peered":"2023-11-20T07:00:58.318078+0000","last_clean":"2023-11-20T07:00:58.318078+0000","last_became_active":"2023-11-20T07:00:53.653691+0000","last_became_peered":"2023-11-20T07:00:53.653691+0000","last_unstale":"2023-11-20T07:00:58.318078+0000","last_undegraded":"2023-11-20T07:00:58.318078+0000","last_fullsized":"2023-11-20T07:00:58.318078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:06.154369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307016+0000","last_change":"2023-11-20T07:00:58.328082+0000","last_active":"2023-11-20T07:00:59.307016+0000","last_peered":"2023-11-20T07:00:59.307016+0000","last_clean":"2023-11-20T07:00:59.307016+0000","last_became_active":"2023-11-20T07:00:58.327691+0000","last_became_peered":"2023-11-20T07:00:58.327691+0000","last_unstale":"2023-11-20T07:00:59.307016+0000","last_undegraded":"2023-11-20T07:00:59.307016+0000","last_fullsized":"2023-11-20T07:00:59.307016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:37.701282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303177+0000","last_change":"2023-11-20T07:00:54.313955+0000","last_active":"2023-11-20T07:00:58.303177+0000","last_peered":"2023-11-20T07:00:58.303177+0000","last_clean":"2023-11-20T07:00:58.303177+0000","last_became_active":"2023-11-20T07:00:54.313653+0000","last_became_peered":"2023-11-20T07:00:54.313653+0000","last_unstale":"2023-11-20T07:00:58.303177+0000","last_undegraded":"2023-11-20T07:00:58.303177+0000","last_fullsized":"2023-11-20T07:00:58.303177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303337+0000","last_change":"2023-11-20T07:00:53.649943+0000","last_active":"2023-11-20T07:00:58.303337+0000","last_peered":"2023-11-20T07:00:58.303337+0000","last_clean":"2023-11-20T07:00:58.303337+0000","last_became_active":"2023-11-20T07:00:53.649583+0000","last_became_peered":"2023-11-20T07:00:53.649583+0000","last_unstale":"2023-11-20T07:00:58.303337+0000","last_undegraded":"2023-11-20T07:00:58.303337+0000","last_fullsized":"2023-11-20T07:00:58.303337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:44.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310821+0000","last_change":"2023-11-20T07:00:53.641711+0000","last_active":"2023-11-20T07:00:58.310821+0000","last_peered":"2023-11-20T07:00:58.310821+0000","last_clean":"2023-11-20T07:00:58.310821+0000","last_became_active":"2023-11-20T07:00:53.641380+0000","last_became_peered":"2023-11-20T07:00:53.641380+0000","last_unstale":"2023-11-20T07:00:58.310821+0000","last_undegraded":"2023-11-20T07:00:58.310821+0000","last_fullsized":"2023-11-20T07:00:58.310821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:16.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318975+0000","last_change":"2023-11-20T07:00:54.299129+0000","last_active":"2023-11-20T07:00:58.318975+0000","last_peered":"2023-11-20T07:00:58.318975+0000","last_clean":"2023-11-20T07:00:58.318975+0000","last_became_active":"2023-11-20T07:00:54.298681+0000","last_became_peered":"2023-11-20T07:00:54.298681+0000","last_unstale":"2023-11-20T07:00:58.318975+0000","last_undegraded":"2023-11-20T07:00:58.318975+0000","last_fullsized":"2023-11-20T07:00:58.318975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.305689+0000","last_change":"2023-11-20T07:00:58.328570+0000","last_active":"2023-11-20T07:00:59.305689+0000","last_peered":"2023-11-20T07:00:59.305689+0000","last_clean":"2023-11-20T07:00:59.305689+0000","last_became_active":"2023-11-20T07:00:58.328166+0000","last_became_peered":"2023-11-20T07:00:58.328166+0000","last_unstale":"2023-11-20T07:00:59.305689+0000","last_undegraded":"2023-11-20T07:00:59.305689+0000","last_fullsized":"2023-11-20T07:00:59.305689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:10.832398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303452+0000","last_change":"2023-11-20T07:00:53.653770+0000","last_active":"2023-11-20T07:00:58.303452+0000","last_peered":"2023-11-20T07:00:58.303452+0000","last_clean":"2023-11-20T07:00:58.303452+0000","last_became_active":"2023-11-20T07:00:53.653466+0000","last_became_peered":"2023-11-20T07:00:53.653466+0000","last_unstale":"2023-11-20T07:00:58.303452+0000","last_undegraded":"2023-11-20T07:00:58.303452+0000","last_fullsized":"2023-11-20T07:00:58.303452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310410+0000","last_change":"2023-11-20T07:00:54.308587+0000","last_active":"2023-11-20T07:00:58.310410+0000","last_peered":"2023-11-20T07:00:58.310410+0000","last_clean":"2023-11-20T07:00:58.310410+0000","last_became_active":"2023-11-20T07:00:54.308181+0000","last_became_peered":"2023-11-20T07:00:54.308181+0000","last_unstale":"2023-11-20T07:00:58.310410+0000","last_undegraded":"2023-11-20T07:00:58.310410+0000","last_fullsized":"2023-11-20T07:00:58.310410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:45.559098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805869+0000","last_change":"2023-11-20T07:00:58.326468+0000","last_active":"2023-11-20T07:00:59.805869+0000","last_peered":"2023-11-20T07:00:59.805869+0000","last_clean":"2023-11-20T07:00:59.805869+0000","last_became_active":"2023-11-20T07:00:58.325258+0000","last_became_peered":"2023-11-20T07:00:58.325258+0000","last_unstale":"2023-11-20T07:00:59.805869+0000","last_undegraded":"2023-11-20T07:00:59.805869+0000","last_fullsized":"2023-11-20T07:00:59.805869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:58:39.439432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.309466+0000","last_change":"2023-11-20T07:00:54.304862+0000","last_active":"2023-11-20T07:00:58.309466+0000","last_peered":"2023-11-20T07:00:58.309466+0000","last_clean":"2023-11-20T07:00:58.309466+0000","last_became_active":"2023-11-20T07:00:54.303650+0000","last_became_peered":"2023-11-20T07:00:54.303650+0000","last_unstale":"2023-11-20T07:00:58.309466+0000","last_undegraded":"2023-11-20T07:00:58.309466+0000","last_fullsized":"2023-11-20T07:00:58.309466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.312778+0000","last_change":"2023-11-20T07:00:54.324075+0000","last_active":"2023-11-20T07:00:58.312778+0000","last_peered":"2023-11-20T07:00:58.312778+0000","last_clean":"2023-11-20T07:00:58.312778+0000","last_became_active":"2023-11-20T07:00:54.323676+0000","last_became_peered":"2023-11-20T07:00:54.323676+0000","last_unstale":"2023-11-20T07:00:58.312778+0000","last_undegraded":"2023-11-20T07:00:58.312778+0000","last_fullsized":"2023-11-20T07:00:58.312778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:34:37.606259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318377+0000","last_change":"2023-11-20T07:00:54.318169+0000","last_active":"2023-11-20T07:00:58.318377+0000","last_peered":"2023-11-20T07:00:58.318377+0000","last_clean":"2023-11-20T07:00:58.318377+0000","last_became_active":"2023-11-20T07:00:54.317900+0000","last_became_peered":"2023-11-20T07:00:54.317900+0000","last_unstale":"2023-11-20T07:00:58.318377+0000","last_undegraded":"2023-11-20T07:00:58.318377+0000","last_fullsized":"2023-11-20T07:00:58.318377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:09.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318884+0000","last_change":"2023-11-20T07:00:54.312618+0000","last_active":"2023-11-20T07:00:58.318884+0000","last_peered":"2023-11-20T07:00:58.318884+0000","last_clean":"2023-11-20T07:00:58.318884+0000","last_became_active":"2023-11-20T07:00:54.312347+0000","last_became_peered":"2023-11-20T07:00:54.312347+0000","last_unstale":"2023-11-20T07:00:58.318884+0000","last_undegraded":"2023-11-20T07:00:58.318884+0000","last_fullsized":"2023-11-20T07:00:58.318884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303777+0000","last_change":"2023-11-20T07:00:54.320244+0000","last_active":"2023-11-20T07:00:58.303777+0000","last_peered":"2023-11-20T07:00:58.303777+0000","last_clean":"2023-11-20T07:00:58.303777+0000","last_became_active":"2023-11-20T07:00:54.319980+0000","last_became_peered":"2023-11-20T07:00:54.319980+0000","last_unstale":"2023-11-20T07:00:58.303777+0000","last_undegraded":"2023-11-20T07:00:58.303777+0000","last_fullsized":"2023-11-20T07:00:58.303777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:10.131851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317033+0000","last_change":"2023-11-20T07:00:54.306675+0000","last_active":"2023-11-20T07:00:58.317033+0000","last_peered":"2023-11-20T07:00:58.317033+0000","last_clean":"2023-11-20T07:00:58.317033+0000","last_became_active":"2023-11-20T07:00:54.306368+0000","last_became_peered":"2023-11-20T07:00:54.306368+0000","last_unstale":"2023-11-20T07:00:58.317033+0000","last_undegraded":"2023-11-20T07:00:58.317033+0000","last_fullsized":"2023-11-20T07:00:58.317033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311347+0000","last_change":"2023-11-20T07:00:54.311331+0000","last_active":"2023-11-20T07:00:58.311347+0000","last_peered":"2023-11-20T07:00:58.311347+0000","last_clean":"2023-11-20T07:00:58.311347+0000","last_became_active":"2023-11-20T07:00:54.311018+0000","last_became_peered":"2023-11-20T07:00:54.311018+0000","last_unstale":"2023-11-20T07:00:58.311347+0000","last_undegraded":"2023-11-20T07:00:58.311347+0000","last_fullsized":"2023-11-20T07:00:58.311347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.305111+0000","last_change":"2023-11-20T07:00:54.319932+0000","last_active":"2023-11-20T07:00:58.305111+0000","last_peered":"2023-11-20T07:00:58.305111+0000","last_clean":"2023-11-20T07:00:58.305111+0000","last_became_active":"2023-11-20T07:00:54.319701+0000","last_became_peered":"2023-11-20T07:00:54.319701+0000","last_unstale":"2023-11-20T07:00:58.305111+0000","last_undegraded":"2023-11-20T07:00:58.305111+0000","last_fullsized":"2023-11-20T07:00:58.305111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:41:56.805008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318044+0000","last_change":"2023-11-20T07:00:54.318299+0000","last_active":"2023-11-20T07:00:58.318044+0000","last_peered":"2023-11-20T07:00:58.318044+0000","last_clean":"2023-11-20T07:00:58.318044+0000","last_became_active":"2023-11-20T07:00:54.312610+0000","last_became_peered":"2023-11-20T07:00:54.312610+0000","last_unstale":"2023-11-20T07:00:58.318044+0000","last_undegraded":"2023-11-20T07:00:58.318044+0000","last_fullsized":"2023-11-20T07:00:58.318044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303139+0000","last_change":"2023-11-20T07:00:54.316271+0000","last_active":"2023-11-20T07:00:58.303139+0000","last_peered":"2023-11-20T07:00:58.303139+0000","last_clean":"2023-11-20T07:00:58.303139+0000","last_became_active":"2023-11-20T07:00:54.315955+0000","last_became_peered":"2023-11-20T07:00:54.315955+0000","last_unstale":"2023-11-20T07:00:58.303139+0000","last_undegraded":"2023-11-20T07:00:58.303139+0000","last_fullsized":"2023-11-20T07:00:58.303139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318282+0000","last_change":"2023-11-20T07:00:54.317416+0000","last_active":"2023-11-20T07:00:58.318282+0000","last_peered":"2023-11-20T07:00:58.318282+0000","last_clean":"2023-11-20T07:00:58.318282+0000","last_became_active":"2023-11-20T07:00:54.316794+0000","last_became_peered":"2023-11-20T07:00:54.316794+0000","last_unstale":"2023-11-20T07:00:58.318282+0000","last_undegraded":"2023-11-20T07:00:58.318282+0000","last_fullsized":"2023-11-20T07:00:58.318282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:43.757635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318783+0000","last_change":"2023-11-20T07:00:54.308603+0000","last_active":"2023-11-20T07:00:58.318783+0000","last_peered":"2023-11-20T07:00:58.318783+0000","last_clean":"2023-11-20T07:00:58.318783+0000","last_became_active":"2023-11-20T07:00:54.308324+0000","last_became_peered":"2023-11-20T07:00:54.308324+0000","last_unstale":"2023-11-20T07:00:58.318783+0000","last_undegraded":"2023-11-20T07:00:58.318783+0000","last_fullsized":"2023-11-20T07:00:58.318783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310585+0000","last_change":"2023-11-20T07:00:54.315438+0000","last_active":"2023-11-20T07:00:58.310585+0000","last_peered":"2023-11-20T07:00:58.310585+0000","last_clean":"2023-11-20T07:00:58.310585+0000","last_became_active":"2023-11-20T07:00:54.315182+0000","last_became_peered":"2023-11-20T07:00:54.315182+0000","last_unstale":"2023-11-20T07:00:58.310585+0000","last_undegraded":"2023-11-20T07:00:58.310585+0000","last_fullsized":"2023-11-20T07:00:58.310585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493594+0000","last_change":"2023-11-20T07:00:54.320102+0000","last_active":"2023-11-20T07:00:58.493594+0000","last_peered":"2023-11-20T07:00:58.493594+0000","last_clean":"2023-11-20T07:00:58.493594+0000","last_became_active":"2023-11-20T07:00:54.313876+0000","last_became_peered":"2023-11-20T07:00:54.313876+0000","last_unstale":"2023-11-20T07:00:58.493594+0000","last_undegraded":"2023-11-20T07:00:58.493594+0000","last_fullsized":"2023-11-20T07:00:58.493594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:30.418920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.314165+0000","last_change":"2023-11-20T07:00:54.308769+0000","last_active":"2023-11-20T07:00:58.314165+0000","last_peered":"2023-11-20T07:00:58.314165+0000","last_clean":"2023-11-20T07:00:58.314165+0000","last_became_active":"2023-11-20T07:00:54.307885+0000","last_became_peered":"2023-11-20T07:00:54.307885+0000","last_unstale":"2023-11-20T07:00:58.314165+0000","last_undegraded":"2023-11-20T07:00:58.314165+0000","last_fullsized":"2023-11-20T07:00:58.314165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:11.255855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318308+0000","last_change":"2023-11-20T07:00:54.318879+0000","last_active":"2023-11-20T07:00:58.318308+0000","last_peered":"2023-11-20T07:00:58.318308+0000","last_clean":"2023-11-20T07:00:58.318308+0000","last_became_active":"2023-11-20T07:00:54.318590+0000","last_became_peered":"2023-11-20T07:00:54.318590+0000","last_unstale":"2023-11-20T07:00:58.318308+0000","last_undegraded":"2023-11-20T07:00:58.318308+0000","last_fullsized":"2023-11-20T07:00:58.318308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:19.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317955+0000","last_change":"2023-11-20T07:00:54.318760+0000","last_active":"2023-11-20T07:00:58.317955+0000","last_peered":"2023-11-20T07:00:58.317955+0000","last_clean":"2023-11-20T07:00:58.317955+0000","last_became_active":"2023-11-20T07:00:54.318437+0000","last_became_peered":"2023-11-20T07:00:54.318437+0000","last_unstale":"2023-11-20T07:00:58.317955+0000","last_undegraded":"2023-11-20T07:00:58.317955+0000","last_fullsized":"2023-11-20T07:00:58.317955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316266+0000","last_change":"2023-11-20T07:00:54.315538+0000","last_active":"2023-11-20T07:00:58.316266+0000","last_peered":"2023-11-20T07:00:58.316266+0000","last_clean":"2023-11-20T07:00:58.316266+0000","last_became_active":"2023-11-20T07:00:54.315233+0000","last_became_peered":"2023-11-20T07:00:54.315233+0000","last_unstale":"2023-11-20T07:00:58.316266+0000","last_undegraded":"2023-11-20T07:00:58.316266+0000","last_fullsized":"2023-11-20T07:00:58.316266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.319999+0000","last_change":"2023-11-20T07:00:54.307661+0000","last_active":"2023-11-20T07:00:58.319999+0000","last_peered":"2023-11-20T07:00:58.319999+0000","last_clean":"2023-11-20T07:00:58.319999+0000","last_became_active":"2023-11-20T07:00:54.306975+0000","last_became_peered":"2023-11-20T07:00:54.306975+0000","last_unstale":"2023-11-20T07:00:58.319999+0000","last_undegraded":"2023-11-20T07:00:58.319999+0000","last_fullsized":"2023-11-20T07:00:58.319999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:17.914788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303292+0000","last_change":"2023-11-20T07:00:54.307989+0000","last_active":"2023-11-20T07:00:58.303292+0000","last_peered":"2023-11-20T07:00:58.303292+0000","last_clean":"2023-11-20T07:00:58.303292+0000","last_became_active":"2023-11-20T07:00:54.307712+0000","last_became_peered":"2023-11-20T07:00:54.307712+0000","last_unstale":"2023-11-20T07:00:58.303292+0000","last_undegraded":"2023-11-20T07:00:58.303292+0000","last_fullsized":"2023-11-20T07:00:58.303292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310788+0000","last_change":"2023-11-20T07:00:54.307874+0000","last_active":"2023-11-20T07:00:58.310788+0000","last_peered":"2023-11-20T07:00:58.310788+0000","last_clean":"2023-11-20T07:00:58.310788+0000","last_became_active":"2023-11-20T07:00:54.307257+0000","last_became_peered":"2023-11-20T07:00:54.307257+0000","last_unstale":"2023-11-20T07:00:58.310788+0000","last_undegraded":"2023-11-20T07:00:58.310788+0000","last_fullsized":"2023-11-20T07:00:58.310788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:38:49.218835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311723+0000","last_change":"2023-11-20T07:00:54.320026+0000","last_active":"2023-11-20T07:00:58.311723+0000","last_peered":"2023-11-20T07:00:58.311723+0000","last_clean":"2023-11-20T07:00:58.311723+0000","last_became_active":"2023-11-20T07:00:54.319737+0000","last_became_peered":"2023-11-20T07:00:54.319737+0000","last_unstale":"2023-11-20T07:00:58.311723+0000","last_undegraded":"2023-11-20T07:00:58.311723+0000","last_fullsized":"2023-11-20T07:00:58.311723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311297+0000","last_change":"2023-11-20T07:00:54.323404+0000","last_active":"2023-11-20T07:00:58.311297+0000","last_peered":"2023-11-20T07:00:58.311297+0000","last_clean":"2023-11-20T07:00:58.311297+0000","last_became_active":"2023-11-20T07:00:54.323122+0000","last_became_peered":"2023-11-20T07:00:54.323122+0000","last_unstale":"2023-11-20T07:00:58.311297+0000","last_undegraded":"2023-11-20T07:00:58.311297+0000","last_fullsized":"2023-11-20T07:00:58.311297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494710+0000","last_change":"2023-11-20T07:00:54.320729+0000","last_active":"2023-11-20T07:00:58.494710+0000","last_peered":"2023-11-20T07:00:58.494710+0000","last_clean":"2023-11-20T07:00:58.494710+0000","last_became_active":"2023-11-20T07:00:54.320394+0000","last_became_peered":"2023-11-20T07:00:54.320394+0000","last_unstale":"2023-11-20T07:00:58.494710+0000","last_undegraded":"2023-11-20T07:00:58.494710+0000","last_fullsized":"2023-11-20T07:00:58.494710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:19:22.025419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.302533+0000","last_change":"2023-11-20T07:00:54.322697+0000","last_active":"2023-11-20T07:00:58.302533+0000","last_peered":"2023-11-20T07:00:58.302533+0000","last_clean":"2023-11-20T07:00:58.302533+0000","last_became_active":"2023-11-20T07:00:54.322432+0000","last_became_peered":"2023-11-20T07:00:54.322432+0000","last_unstale":"2023-11-20T07:00:58.302533+0000","last_undegraded":"2023-11-20T07:00:58.302533+0000","last_fullsized":"2023-11-20T07:00:58.302533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:16.073686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493090+0000","last_change":"2023-11-20T07:00:54.319125+0000","last_active":"2023-11-20T07:00:58.493090+0000","last_peered":"2023-11-20T07:00:58.493090+0000","last_clean":"2023-11-20T07:00:58.493090+0000","last_became_active":"2023-11-20T07:00:54.314729+0000","last_became_peered":"2023-11-20T07:00:54.314729+0000","last_unstale":"2023-11-20T07:00:58.493090+0000","last_undegraded":"2023-11-20T07:00:58.493090+0000","last_fullsized":"2023-11-20T07:00:58.493090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:10.131851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318318+0000","last_change":"2023-11-20T07:00:54.317580+0000","last_active":"2023-11-20T07:00:58.318318+0000","last_peered":"2023-11-20T07:00:58.318318+0000","last_clean":"2023-11-20T07:00:58.318318+0000","last_became_active":"2023-11-20T07:00:54.317144+0000","last_became_peered":"2023-11-20T07:00:54.317144+0000","last_unstale":"2023-11-20T07:00:58.318318+0000","last_undegraded":"2023-11-20T07:00:58.318318+0000","last_fullsized":"2023-11-20T07:00:58.318318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:10.131851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493163+0000","last_change":"2023-11-20T07:00:54.313588+0000","last_active":"2023-11-20T07:00:58.493163+0000","last_peered":"2023-11-20T07:00:58.493163+0000","last_clean":"2023-11-20T07:00:58.493163+0000","last_became_active":"2023-11-20T07:00:54.309057+0000","last_became_peered":"2023-11-20T07:00:54.309057+0000","last_unstale":"2023-11-20T07:00:58.493163+0000","last_undegraded":"2023-11-20T07:00:58.493163+0000","last_fullsized":"2023-11-20T07:00:58.493163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:41:56.805008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317745+0000","last_change":"2023-11-20T07:00:54.316503+0000","last_active":"2023-11-20T07:00:58.317745+0000","last_peered":"2023-11-20T07:00:58.317745+0000","last_clean":"2023-11-20T07:00:58.317745+0000","last_became_active":"2023-11-20T07:00:54.316046+0000","last_became_peered":"2023-11-20T07:00:54.316046+0000","last_unstale":"2023-11-20T07:00:58.317745+0000","last_undegraded":"2023-11-20T07:00:58.317745+0000","last_fullsized":"2023-11-20T07:00:58.317745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318929+0000","last_change":"2023-11-20T07:00:54.303021+0000","last_active":"2023-11-20T07:00:58.318929+0000","last_peered":"2023-11-20T07:00:58.318929+0000","last_clean":"2023-11-20T07:00:58.318929+0000","last_became_active":"2023-11-20T07:00:54.302616+0000","last_became_peered":"2023-11-20T07:00:54.302616+0000","last_unstale":"2023-11-20T07:00:58.318929+0000","last_undegraded":"2023-11-20T07:00:58.318929+0000","last_fullsized":"2023-11-20T07:00:58.318929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:23:17.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316083+0000","last_change":"2023-11-20T07:00:54.310934+0000","last_active":"2023-11-20T07:00:58.316083+0000","last_peered":"2023-11-20T07:00:58.316083+0000","last_clean":"2023-11-20T07:00:58.316083+0000","last_became_active":"2023-11-20T07:00:54.306577+0000","last_became_peered":"2023-11-20T07:00:54.306577+0000","last_unstale":"2023-11-20T07:00:58.316083+0000","last_undegraded":"2023-11-20T07:00:58.316083+0000","last_fullsized":"2023-11-20T07:00:58.316083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494543+0000","last_change":"2023-11-20T07:00:54.313082+0000","last_active":"2023-11-20T07:00:58.494543+0000","last_peered":"2023-11-20T07:00:58.494543+0000","last_clean":"2023-11-20T07:00:58.494543+0000","last_became_active":"2023-11-20T07:00:54.312728+0000","last_became_peered":"2023-11-20T07:00:54.312728+0000","last_unstale":"2023-11-20T07:00:58.494543+0000","last_undegraded":"2023-11-20T07:00:58.494543+0000","last_fullsized":"2023-11-20T07:00:58.494543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:04.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T07:01:18.975 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-20T07:01:18.976 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-20T07:01:18.976 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-20T07:01:18.976 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-20T07:01:18.976 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-20T07:01:19.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.150+0000 7f8ad69aa640 1 Processor -- start 2023-11-20T07:01:19.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.154+0000 7f8ad69aa640 1 -- start start 2023-11-20T07:01:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.154+0000 7f8ad69aa640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ad00cf090 0x7f8ad00cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.154+0000 7f8ad69aa640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad00c65f0 con 0x7f8ad015ca70 2023-11-20T07:01:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.154+0000 7f8ad69aa640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad00cdf80 con 0x7f8ad00c6ad0 2023-11-20T07:01:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.154+0000 7f8ad69aa640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad00cfa60 con 0x7f8ad00cf090 2023-11-20T07:01:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.154+0000 7f8acf7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ad00cf090 0x7f8ad00cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.154+0000 7f8acf7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ad00cf090 0x7f8ad00cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53868/0 (socket says 172.21.15.88:53868) 2023-11-20T07:01:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.154+0000 7f8acf7fe640 1 -- 172.21.15.88:0/3238814251 learned_addr learned my addr 172.21.15.88:0/3238814251 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.154+0000 7f8acffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8ad015ca70 0x7f8ad00d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52448/0 (socket says 172.21.15.88:52448) 2023-11-20T07:01:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.154+0000 7f8acf7fe640 1 -- 172.21.15.88:0/3238814251 >> v1:172.21.15.175:6789/0 conn(0x7f8ad00c6ad0 legacy=0x7f8ad00c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:19.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.154+0000 7f8acf7fe640 1 -- 172.21.15.88:0/3238814251 >> v1:172.21.15.88:6789/0 conn(0x7f8ad015ca70 legacy=0x7f8ad00d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.154+0000 7f8acf7fe640 1 -- 172.21.15.88:0/3238814251 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad00ce260 con 0x7f8ad00cf090 2023-11-20T07:01:19.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8acf7fe640 1 --2- 172.21.15.88:0/3238814251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ad00cf090 0x7f8ad00cf520 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009870 tx=0x7f8ac401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04ebcb64156b24b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:19.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8aceffd640 1 -- 172.21.15.88:0/3238814251 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4004230 con 0x7f8ad00cf090 2023-11-20T07:01:19.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8aceffd640 1 -- 172.21.15.88:0/3238814251 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac40a7050 con 0x7f8ad00cf090 2023-11-20T07:01:19.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8aceffd640 1 -- 172.21.15.88:0/3238814251 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4003620 con 0x7f8ad00cf090 2023-11-20T07:01:19.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8ad69aa640 1 -- 172.21.15.88:0/3238814251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ad00cf090 msgr2=0x7f8ad00cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8ad69aa640 1 --2- 172.21.15.88:0/3238814251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ad00cf090 0x7f8ad00cf520 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009870 tx=0x7f8ac401c500 comp rx=0 tx=0).stop 2023-11-20T07:01:19.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8ad69aa640 1 -- 172.21.15.88:0/3238814251 shutdown_connections 2023-11-20T07:01:19.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8ad69aa640 1 --2- 172.21.15.88:0/3238814251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ad00cf090 0x7f8ad00cf520 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8ad69aa640 1 -- 172.21.15.88:0/3238814251 >> 172.21.15.88:0/3238814251 conn(0x7f8ad009bc50 msgr2=0x7f8ad00d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:19.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8ad69aa640 1 -- 172.21.15.88:0/3238814251 shutdown_connections 2023-11-20T07:01:19.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8ad69aa640 1 -- 172.21.15.88:0/3238814251 wait complete. 2023-11-20T07:01:19.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8ad69aa640 1 Processor -- start 2023-11-20T07:01:19.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.158+0000 7f8ad69aa640 1 -- start start 2023-11-20T07:01:19.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8ad69aa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ad00c6ad0 0x7f8ad00c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8ad69aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ad00cf090 0x7f8ad00cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8ad69aa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ad015ca70 0x7f8ad00b76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8ad69aa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad013d860 con 0x7f8ad00cf090 2023-11-20T07:01:19.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8ad69aa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad013db40 con 0x7f8ad015ca70 2023-11-20T07:01:19.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8ad69aa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad013f280 con 0x7f8ad00c6ad0 2023-11-20T07:01:19.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8acf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ad00cf090 0x7f8ad00cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8acf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ad00cf090 0x7f8ad00cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53874/0 (socket says 172.21.15.88:53874) 2023-11-20T07:01:19.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8acf7fe640 1 -- 172.21.15.88:0/2888497951 learned_addr learned my addr 172.21.15.88:0/2888497951 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:19.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8acf7fe640 1 -- 172.21.15.88:0/2888497951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ad00c6ad0 msgr2=0x7f8ad00c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8acf7fe640 1 --2- 172.21.15.88:0/2888497951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ad00c6ad0 0x7f8ad00c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8acf7fe640 1 -- 172.21.15.88:0/2888497951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ad015ca70 msgr2=0x7f8ad00b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8acf7fe640 1 --2- 172.21.15.88:0/2888497951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ad015ca70 0x7f8ad00b76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8acf7fe640 1 -- 172.21.15.88:0/2888497951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac40094d0 con 0x7f8ad00cf090 2023-11-20T07:01:19.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8acf7fe640 1 --2- 172.21.15.88:0/2888497951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ad00cf090 0x7f8ad00cbae0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4019110 tx=0x7f8ac40192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:19.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8accff9640 1 -- 172.21.15.88:0/2888497951 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4003de0 con 0x7f8ad00cf090 2023-11-20T07:01:19.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8accff9640 1 -- 172.21.15.88:0/2888497951 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac40b6440 con 0x7f8ad00cf090 2023-11-20T07:01:19.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8accff9640 1 -- 172.21.15.88:0/2888497951 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac40b67d0 con 0x7f8ad00cf090 2023-11-20T07:01:19.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8ad69aa640 1 -- 172.21.15.88:0/2888497951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad00d38a0 con 0x7f8ad00cf090 2023-11-20T07:01:19.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8ad69aa640 1 -- 172.21.15.88:0/2888497951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad00cc830 con 0x7f8ad00cf090 2023-11-20T07:01:19.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8ad69aa640 1 -- 172.21.15.88:0/2888497951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad0074010 con 0x7f8ad00cf090 2023-11-20T07:01:19.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.162+0000 7f8accff9640 1 -- 172.21.15.88:0/2888497951 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8ac40b2040 con 0x7f8ad00cf090 2023-11-20T07:01:19.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.166+0000 7f8accff9640 1 --2- 172.21.15.88:0/2888497951 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8abc0664d0 0x7f8abc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.166+0000 7f8accff9640 1 -- 172.21.15.88:0/2888497951 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8ac411e5c0 con 0x7f8ad00cf090 2023-11-20T07:01:19.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.166+0000 7f8acffff640 1 --2- 172.21.15.88:0/2888497951 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8abc0664d0 0x7f8abc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.166+0000 7f8acffff640 1 --2- 172.21.15.88:0/2888497951 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8abc0664d0 0x7f8abc068990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0007fd0 tx=0x7f8ac0007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:19.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.170+0000 7f8accff9640 1 -- 172.21.15.88:0/2888497951 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ac40eb750 con 0x7f8ad00cf090 2023-11-20T07:01:19.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.358+0000 7f8ad69aa640 1 -- 172.21.15.88:0/2888497951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8ad006c1f0 con 0x7f8ad00cf090 2023-11-20T07:01:19.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.358+0000 7f8accff9640 1 -- 172.21.15.88:0/2888497951 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164437 (secure 0 0 0) 0x7f8ac40eed70 con 0x7f8ad00cf090 2023-11-20T07:01:19.361 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.362+0000 7f8ad69aa640 1 -- 172.21.15.88:0/2888497951 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8abc0664d0 msgr2=0x7f8abc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.362+0000 7f8ad69aa640 1 --2- 172.21.15.88:0/2888497951 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8abc0664d0 0x7f8abc068990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0007fd0 tx=0x7f8ac0007900 comp rx=0 tx=0).stop 2023-11-20T07:01:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.362+0000 7f8ad69aa640 1 -- 172.21.15.88:0/2888497951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ad00cf090 msgr2=0x7f8ad00cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.362+0000 7f8ad69aa640 1 --2- 172.21.15.88:0/2888497951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ad00cf090 0x7f8ad00cbae0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4019110 tx=0x7f8ac40192a0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.362+0000 7f8ad69aa640 1 -- 172.21.15.88:0/2888497951 shutdown_connections 2023-11-20T07:01:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.362+0000 7f8ad69aa640 1 --2- 172.21.15.88:0/2888497951 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8abc0664d0 0x7f8abc068990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.362+0000 7f8ad69aa640 1 --2- 172.21.15.88:0/2888497951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ad015ca70 0x7f8ad00b76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.362+0000 7f8ad69aa640 1 --2- 172.21.15.88:0/2888497951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ad00cf090 0x7f8ad00cbae0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.362+0000 7f8ad69aa640 1 --2- 172.21.15.88:0/2888497951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ad00c6ad0 0x7f8ad00c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.362+0000 7f8ad69aa640 1 -- 172.21.15.88:0/2888497951 >> 172.21.15.88:0/2888497951 conn(0x7f8ad009bc50 msgr2=0x7f8ad00d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:19.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.362+0000 7f8ad69aa640 1 -- 172.21.15.88:0/2888497951 shutdown_connections 2023-11-20T07:01:19.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.362+0000 7f8ad69aa640 1 -- 172.21.15.88:0/2888497951 wait complete. 2023-11-20T07:01:19.381 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":5,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":2500557545},{"type":"v1","addr":"172.21.15.175:6833","nonce":2500557545}]},"active_addr":"172.21.15.175:6833/2500557545","active_change":"2023-11-20T07:00:33.515270+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":3130853202}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":1904931521}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":1200899433}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":3268369595}]}]} 2023-11-20T07:01:19.385 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-20T07:01:19.385 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-20T07:01:19.385 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:19.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.522+0000 7fa87daea640 1 Processor -- start 2023-11-20T07:01:19.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.522+0000 7fa87daea640 1 -- start start 2023-11-20T07:01:19.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.522+0000 7fa87daea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8780b07f0 0x7fa87815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.522+0000 7fa87daea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87815be60 con 0x7fa878070c40 2023-11-20T07:01:19.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.522+0000 7fa87daea640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87815c1f0 con 0x7fa87815d690 2023-11-20T07:01:19.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.522+0000 7fa87daea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87815b3b0 con 0x7fa8780b07f0 2023-11-20T07:01:19.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.526+0000 7fa86ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8780b07f0 0x7fa87815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.526+0000 7fa86ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8780b07f0 0x7fa87815ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53886/0 (socket says 172.21.15.88:53886) 2023-11-20T07:01:19.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.526+0000 7fa86ffff640 1 -- 172.21.15.88:0/1862922623 learned_addr learned my addr 172.21.15.88:0/1862922623 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:19.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.526+0000 7fa86ffff640 1 -- 172.21.15.88:0/1862922623 >> v1:172.21.15.175:6789/0 conn(0x7fa87815d690 legacy=0x7fa878164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.526+0000 7fa86ffff640 1 -- 172.21.15.88:0/1862922623 >> v1:172.21.15.88:6789/0 conn(0x7fa878070c40 legacy=0x7fa8780b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.526+0000 7fa86ffff640 1 -- 172.21.15.88:0/1862922623 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa878071020 con 0x7fa8780b07f0 2023-11-20T07:01:19.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.526+0000 7fa876ffd640 1 -- 172.21.15.88:0/1862922623 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171356239 0 0) 0x7fa87815be60 con 0x7fa878070c40 2023-11-20T07:01:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.526+0000 7fa86ffff640 1 --2- 172.21.15.88:0/1862922623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8780b07f0 0x7fa87815ae70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa860009870 tx=0x7fa86001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86c6a5789c4f247 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.526+0000 7fa876ffd640 1 -- 172.21.15.88:0/1862922623 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8600aa610 con 0x7fa8780b07f0 2023-11-20T07:01:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.526+0000 7fa876ffd640 1 -- 172.21.15.88:0/1862922623 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8600a6040 con 0x7fa8780b07f0 2023-11-20T07:01:19.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.526+0000 7fa876ffd640 1 -- 172.21.15.88:0/1862922623 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8600aa990 con 0x7fa8780b07f0 2023-11-20T07:01:19.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 -- 172.21.15.88:0/1862922623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8780b07f0 msgr2=0x7fa87815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 --2- 172.21.15.88:0/1862922623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8780b07f0 0x7fa87815ae70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa860009870 tx=0x7fa86001c4b0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 -- 172.21.15.88:0/1862922623 shutdown_connections 2023-11-20T07:01:19.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 --2- 172.21.15.88:0/1862922623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8780b07f0 0x7fa87815ae70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 -- 172.21.15.88:0/1862922623 >> 172.21.15.88:0/1862922623 conn(0x7fa87806c190 msgr2=0x7fa87806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:19.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 -- 172.21.15.88:0/1862922623 shutdown_connections 2023-11-20T07:01:19.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 -- 172.21.15.88:0/1862922623 wait complete. 2023-11-20T07:01:19.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 Processor -- start 2023-11-20T07:01:19.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 -- start start 2023-11-20T07:01:19.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa878070c40 0x7fa878154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8780b07f0 0x7fa878147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa87815d690 0x7fa878149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87814a910 con 0x7fa878070c40 2023-11-20T07:01:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa878147aa0 con 0x7fa8780b07f0 2023-11-20T07:01:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa87daea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa878149c90 con 0x7fa87815d690 2023-11-20T07:01:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa8777fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa878070c40 0x7fa878154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa8777fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa878070c40 0x7fa878154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53900/0 (socket says 172.21.15.88:53900) 2023-11-20T07:01:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa8777fe640 1 -- 172.21.15.88:0/2572378129 learned_addr learned my addr 172.21.15.88:0/2572378129 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa86ffff640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8780b07f0 0x7fa878147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa877fff640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa87815d690 0x7fa878149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa8777fe640 1 -- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa87815d690 msgr2=0x7fa878149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa8777fe640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa87815d690 0x7fa878149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa8777fe640 1 -- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8780b07f0 msgr2=0x7fa878147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa8777fe640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8780b07f0 0x7fa878147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa8777fe640 1 -- 172.21.15.88:0/2572378129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600094d0 con 0x7fa878070c40 2023-11-20T07:01:19.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa877fff640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa87815d690 0x7fa878149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:19.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.530+0000 7fa8777fe640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa878070c40 0x7fa878154600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa86800c480 tx=0x7fa86800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.534+0000 7fa874ff9640 1 -- 172.21.15.88:0/2572378129 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868005480 con 0x7fa878070c40 2023-11-20T07:01:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.534+0000 7fa874ff9640 1 -- 172.21.15.88:0/2572378129 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa868003600 con 0x7fa878070c40 2023-11-20T07:01:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.534+0000 7fa87daea640 1 -- 172.21.15.88:0/2572378129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa878149f70 con 0x7fa878070c40 2023-11-20T07:01:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.534+0000 7fa874ff9640 1 -- 172.21.15.88:0/2572378129 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8680039b0 con 0x7fa878070c40 2023-11-20T07:01:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.534+0000 7fa87daea640 1 -- 172.21.15.88:0/2572378129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87814a530 con 0x7fa878070c40 2023-11-20T07:01:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.534+0000 7fa87daea640 1 -- 172.21.15.88:0/2572378129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa878074010 con 0x7fa878070c40 2023-11-20T07:01:19.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.534+0000 7fa874ff9640 1 -- 172.21.15.88:0/2572378129 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa868003b10 con 0x7fa878070c40 2023-11-20T07:01:19.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.534+0000 7fa874ff9640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8580664a0 0x7fa858068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.534+0000 7fa874ff9640 1 -- 172.21.15.88:0/2572378129 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa868083ca0 con 0x7fa878070c40 2023-11-20T07:01:19.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.534+0000 7fa86ffff640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8580664a0 0x7fa858068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.538+0000 7fa86ffff640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8580664a0 0x7fa858068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa8600ae000 tx=0x7fa8600b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:19.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.538+0000 7fa874ff9640 1 -- 172.21.15.88:0/2572378129 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa868050ec0 con 0x7fa878070c40 2023-11-20T07:01:19.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.690+0000 7fa87daea640 1 -- 172.21.15.88:0/2572378129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8780ad8f0 con 0x7fa878070c40 2023-11-20T07:01:19.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa874ff9640 1 -- 172.21.15.88:0/2572378129 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fa8680544e0 con 0x7fa878070c40 2023-11-20T07:01:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:19.694 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:19.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa87daea640 1 -- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8580664a0 msgr2=0x7fa858068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa87daea640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8580664a0 0x7fa858068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa8600ae000 tx=0x7fa8600b5040 comp rx=0 tx=0).stop 2023-11-20T07:01:19.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa87daea640 1 -- 172.21.15.88:0/2572378129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa878070c40 msgr2=0x7fa878154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa87daea640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa878070c40 0x7fa878154600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa86800c480 tx=0x7fa86800c940 comp rx=0 tx=0).stop 2023-11-20T07:01:19.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa87daea640 1 -- 172.21.15.88:0/2572378129 shutdown_connections 2023-11-20T07:01:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa87daea640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8580664a0 0x7fa858068960 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa87daea640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa87815d690 0x7fa878149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa87daea640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8780b07f0 0x7fa878147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa87daea640 1 --2- 172.21.15.88:0/2572378129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa878070c40 0x7fa878154600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa87daea640 1 -- 172.21.15.88:0/2572378129 >> 172.21.15.88:0/2572378129 conn(0x7fa87806c190 msgr2=0x7fa878154bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa87daea640 1 -- 172.21.15.88:0/2572378129 shutdown_connections 2023-11-20T07:01:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.694+0000 7fa87daea640 1 -- 172.21.15.88:0/2572378129 wait complete. 2023-11-20T07:01:19.715 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-20T07:01:19.716 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9f1b5640 1 Processor -- start 2023-11-20T07:01:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9f1b5640 1 -- start start 2023-11-20T07:01:19.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9f1b5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e9815c980 0x7f7e9806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9f1b5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7e980d1490 0x7f7e980b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9f1b5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980d3510 con 0x7f7e9815cd60 2023-11-20T07:01:19.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9f1b5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980cd2b0 con 0x7f7e980d1490 2023-11-20T07:01:19.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9f1b5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980d2f50 con 0x7f7e9815c980 2023-11-20T07:01:19.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9e9b4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7e980d1490 0x7f7e980b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9e9b4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7e980d1490 0x7f7e980b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53908/0 (socket says 172.21.15.88:53908) 2023-11-20T07:01:19.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9e9b4640 1 -- 172.21.15.88:0/290857012 learned_addr learned my addr 172.21.15.88:0/290857012 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9e1b3640 1 --2- 172.21.15.88:0/290857012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e9815c980 0x7f7e9806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9e9b4640 1 -- 172.21.15.88:0/290857012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e9815c980 msgr2=0x7f7e9806af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9e9b4640 1 --2- 172.21.15.88:0/290857012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e9815c980 0x7f7e9806af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9e9b4640 1 -- 172.21.15.88:0/290857012 >> v1:172.21.15.175:6789/0 conn(0x7f7e9815cd60 legacy=0x7f7e980d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9e9b4640 1 -- 172.21.15.88:0/290857012 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e980d3230 con 0x7f7e980d1490 2023-11-20T07:01:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.854+0000 7f7e9e1b3640 1 --2- 172.21.15.88:0/290857012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e9815c980 0x7f7e9806af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:19.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9e9b4640 1 --2- 172.21.15.88:0/290857012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e980d1490 0x7f7e980b1b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009e80 tx=0x7f7e9001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf46bec07e35152 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:19.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9d1b1640 1 -- 172.21.15.88:0/290857012 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e900a5740 con 0x7f7e980d1490 2023-11-20T07:01:19.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9d1b1640 1 -- 172.21.15.88:0/290857012 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e900a58a0 con 0x7f7e980d1490 2023-11-20T07:01:19.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9d1b1640 1 -- 172.21.15.88:0/290857012 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e900a5c30 con 0x7f7e980d1490 2023-11-20T07:01:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/290857012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e980d1490 msgr2=0x7f7e980b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9f1b5640 1 --2- 172.21.15.88:0/290857012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e980d1490 0x7f7e980b1b90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009e80 tx=0x7f7e9001c9b0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/290857012 shutdown_connections 2023-11-20T07:01:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9f1b5640 1 --2- 172.21.15.88:0/290857012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e980d1490 0x7f7e980b1b90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9f1b5640 1 --2- 172.21.15.88:0/290857012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e9815c980 0x7f7e9806af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/290857012 >> 172.21.15.88:0/290857012 conn(0x7f7e9809ba80 msgr2=0x7f7e980d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:19.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/290857012 shutdown_connections 2023-11-20T07:01:19.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/290857012 wait complete. 2023-11-20T07:01:19.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.858+0000 7f7e9f1b5640 1 Processor -- start 2023-11-20T07:01:19.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9f1b5640 1 -- start start 2023-11-20T07:01:19.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9f1b5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e980d1490 0x7f7e98155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9f1b5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e9815c980 0x7f7e98154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9f1b5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e9815cd60 0x7f7e98153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9f1b5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c84d0 con 0x7f7e9815cd60 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9f1b5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c7bc0 con 0x7f7e980d1490 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9f1b5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e981554a0 con 0x7f7e9815c980 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9e9b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e9815cd60 0x7f7e98153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9e9b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e9815cd60 0x7f7e98153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53912/0 (socket says 172.21.15.88:53912) 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9e9b4640 1 -- 172.21.15.88:0/3669816394 learned_addr learned my addr 172.21.15.88:0/3669816394 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9e1b3640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e980d1490 0x7f7e98155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9d9b2640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e9815c980 0x7f7e98154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9e9b4640 1 -- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e9815c980 msgr2=0x7f7e98154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9e9b4640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e9815c980 0x7f7e98154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9e9b4640 1 -- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e980d1490 msgr2=0x7f7e98155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:19.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9e9b4640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e980d1490 0x7f7e98155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9e9b4640 1 -- 172.21.15.88:0/3669816394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90009b30 con 0x7f7e9815cd60 2023-11-20T07:01:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9d9b2640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e9815c980 0x7f7e98154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9e9b4640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e9815cd60 0x7f7e98153dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7e9001b060 tx=0x7f7e90019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:19.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e8effd640 1 -- 172.21.15.88:0/3669816394 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e900b8670 con 0x7f7e9815cd60 2023-11-20T07:01:19.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e8effd640 1 -- 172.21.15.88:0/3669816394 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e900b87d0 con 0x7f7e9815cd60 2023-11-20T07:01:19.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/3669816394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e98154310 con 0x7f7e9815cd60 2023-11-20T07:01:19.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e8effd640 1 -- 172.21.15.88:0/3669816394 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e900b8b60 con 0x7f7e9815cd60 2023-11-20T07:01:19.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/3669816394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e980c7e10 con 0x7f7e9815cd60 2023-11-20T07:01:19.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.862+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/3669816394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e980c8610 con 0x7f7e9815cd60 2023-11-20T07:01:19.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.866+0000 7f7e8effd640 1 -- 172.21.15.88:0/3669816394 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7e900b8cc0 con 0x7f7e9815cd60 2023-11-20T07:01:19.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.866+0000 7f7e8effd640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7e7c0664a0 0x7f7e7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:19.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.866+0000 7f7e8effd640 1 -- 172.21.15.88:0/3669816394 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e9011f4c0 con 0x7f7e9815cd60 2023-11-20T07:01:19.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.866+0000 7f7e9e1b3640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7e7c0664a0 0x7f7e7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:19.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.866+0000 7f7e9e1b3640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7e7c0664a0 0x7f7e7c068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7e980c7b50 tx=0x7f7e94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:19.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:19.870+0000 7f7e8effd640 1 -- 172.21.15.88:0/3669816394 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7e980c8610 con 0x7f7e9815cd60 2023-11-20T07:01:20.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.022+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/3669816394 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e980c8610 con 0x7f7e9815cd60 2023-11-20T07:01:20.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.022+0000 7f7e8effd640 1 -- 172.21.15.88:0/3669816394 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f7e980c8610 con 0x7f7e9815cd60 2023-11-20T07:01:20.024 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:20.024 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:20.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.026+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7e7c0664a0 msgr2=0x7f7e7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.026+0000 7f7e9f1b5640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7e7c0664a0 0x7f7e7c068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7e980c7b50 tx=0x7f7e94008040 comp rx=0 tx=0).stop 2023-11-20T07:01:20.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.026+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/3669816394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e9815cd60 msgr2=0x7f7e98153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.026+0000 7f7e9f1b5640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e9815cd60 0x7f7e98153dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7e9001b060 tx=0x7f7e90019750 comp rx=0 tx=0).stop 2023-11-20T07:01:20.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.026+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/3669816394 shutdown_connections 2023-11-20T07:01:20.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.026+0000 7f7e9f1b5640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7e7c0664a0 0x7f7e7c068960 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.026+0000 7f7e9f1b5640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e9815c980 0x7f7e98154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.026+0000 7f7e9f1b5640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e9815cd60 0x7f7e98153dd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.026+0000 7f7e9f1b5640 1 --2- 172.21.15.88:0/3669816394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e980d1490 0x7f7e98155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.026+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/3669816394 >> 172.21.15.88:0/3669816394 conn(0x7f7e9809ba80 msgr2=0x7f7e9806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.026+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/3669816394 shutdown_connections 2023-11-20T07:01:20.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.026+0000 7f7e9f1b5640 1 -- 172.21.15.88:0/3669816394 wait complete. 2023-11-20T07:01:20.045 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-20T07:01:20.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-20T07:01:20.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-20T07:01:20.047 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-20T07:01:20.047 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-20T07:01:20.047 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-20T07:01:20.048 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-20T07:01:20.048 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-20T07:01:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.286+0000 7f15f729a640 1 Processor -- start 2023-11-20T07:01:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.286+0000 7f15f729a640 1 -- start start 2023-11-20T07:01:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.286+0000 7f15f729a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15e8054100 0x7f15e80e0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.286+0000 7f15f729a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f15e80e2d90 0x7f15e80e3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15effff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f15e8055800 0x7f15e80def90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52476/0 (socket says 172.21.15.88:52476) 2023-11-20T07:01:20.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f4835640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15e8054100 0x7f15e80e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f4835640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15e8054100 0x7f15e80e0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38288/0 (socket says 172.21.15.88:38288) 2023-11-20T07:01:20.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f5036640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f15e80e2d90 0x7f15e80e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f5036640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f15e80e2d90 0x7f15e80e3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53918/0 (socket says 172.21.15.88:53918) 2023-11-20T07:01:20.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15effff640 1 -- 172.21.15.88:0/3925282870 learned_addr learned my addr 172.21.15.88:0/3925282870 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:20.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f729a640 1 -- 172.21.15.88:0/3925282870 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e80e0760 con 0x7f15e8055800 2023-11-20T07:01:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f729a640 1 -- 172.21.15.88:0/3925282870 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e80e3760 con 0x7f15e80e2d90 2023-11-20T07:01:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7fe6c6e88640 1 Processor -- start 2023-11-20T07:01:20.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f729a640 1 -- 172.21.15.88:0/3925282870 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e80df6a0 con 0x7f15e8054100 2023-11-20T07:01:20.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7fe6c6e88640 1 -- start start 2023-11-20T07:01:20.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f6038640 1 -- 172.21.15.88:0/3925282870 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992064756 0 0) 0x7f15e80e0760 con 0x7f15e8055800 2023-11-20T07:01:20.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f6038640 1 -- 172.21.15.88:0/3925282870 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15e0003530 con 0x7f15e8055800 2023-11-20T07:01:20.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f5036640 1 -- 172.21.15.88:0/3925282870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15e8054100 msgr2=0x7f15e80e0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f5036640 1 --2- 172.21.15.88:0/3925282870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15e8054100 0x7f15e80e0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f5036640 1 -- 172.21.15.88:0/3925282870 >> v1:172.21.15.88:6789/0 conn(0x7f15e8055800 legacy=0x7f15e80def90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f4835640 1 --2- 172.21.15.88:0/3925282870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15e8054100 0x7f15e80e0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:20.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.290+0000 7f15f5036640 1 -- 172.21.15.88:0/3925282870 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8053060 con 0x7f15e80e2d90 2023-11-20T07:01:20.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c6e88640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6c01583f0 0x7fe6c015e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c6e88640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6c00afd90 0x7fe6c00b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c6e88640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c015ad20 con 0x7fe6c00b3e00 2023-11-20T07:01:20.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c6e88640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c00b0760 con 0x7fe6c00afd90 2023-11-20T07:01:20.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c6e88640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c015c7f0 con 0x7fe6c01583f0 2023-11-20T07:01:20.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c5e86640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6c01583f0 0x7fe6c015e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c5e86640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6c01583f0 0x7fe6c015e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38300/0 (socket says 172.21.15.88:38300) 2023-11-20T07:01:20.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c5e86640 1 -- 172.21.15.88:0/724248050 learned_addr learned my addr 172.21.15.88:0/724248050 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c6687640 1 --2- 172.21.15.88:0/724248050 >> v2:172.21.15.88:3300/0 conn(0x7fe6c00afd90 0x7fe6c00b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c5e86640 1 -- 172.21.15.88:0/724248050 >> v2:172.21.15.88:3300/0 conn(0x7fe6c00afd90 msgr2=0x7fe6c00b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c5e86640 1 --2- 172.21.15.88:0/724248050 >> v2:172.21.15.88:3300/0 conn(0x7fe6c00afd90 0x7fe6c00b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c5e86640 1 -- 172.21.15.88:0/724248050 >> v1:172.21.15.175:6789/0 conn(0x7fe6c00b3e00 legacy=0x7fe6c015c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7fe6c5e86640 1 -- 172.21.15.88:0/724248050 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c015e7c0 con 0x7fe6c01583f0 2023-11-20T07:01:20.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7f15f5036640 1 --2- 172.21.15.88:0/3925282870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15e80e2d90 0x7f15e80e3220 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f15f0000b70 tx=0x7f15f0098d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c15faa3ddc4bf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7f4940e6b640 1 Processor -- start 2023-11-20T07:01:20.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.294+0000 7f4940e6b640 1 -- start start 2023-11-20T07:01:20.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f15f6038640 1 -- 172.21.15.88:0/3925282870 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0072040 con 0x7f15e80e2d90 2023-11-20T07:01:20.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f15f6038640 1 -- 172.21.15.88:0/3925282870 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f0122990 con 0x7f15e80e2d90 2023-11-20T07:01:20.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f4940e6b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f493c164520 0x7f493c0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f4940e6b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f493c0b07f0 0x7f493c0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f4940e6b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c0c96f0 con 0x7f493c0ad960 2023-11-20T07:01:20.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f4940e6b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c164900 con 0x7f493c0b07f0 2023-11-20T07:01:20.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f4940e6b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0cb950 con 0x7f493c164520 2023-11-20T07:01:20.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f15f6038640 1 -- 172.21.15.88:0/3925282870 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f0122dc0 con 0x7f15e80e2d90 2023-11-20T07:01:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f493ad9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f493c0b07f0 0x7f493c0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f493ad9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f493c0b07f0 0x7f493c0cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:35992/0 (socket says 172.21.15.88:35992) 2023-11-20T07:01:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f493ad9d640 1 -- 172.21.15.88:0/961526032 learned_addr learned my addr 172.21.15.88:0/961526032 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f493a59c640 1 --2- 172.21.15.88:0/961526032 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f493c164520 0x7f493c0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f15f729a640 1 -- 172.21.15.88:0/3925282870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15e80e2d90 msgr2=0x7f15e80e3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f15f729a640 1 --2- 172.21.15.88:0/3925282870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15e80e2d90 0x7f15e80e3220 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f15f0000b70 tx=0x7f15f0098d10 comp rx=0 tx=0).stop 2023-11-20T07:01:20.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f15f729a640 1 -- 172.21.15.88:0/3925282870 shutdown_connections 2023-11-20T07:01:20.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f15f729a640 1 --2- 172.21.15.88:0/3925282870 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15e80e2d90 0x7f15e80e3220 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7fe6c5e86640 1 --2- 172.21.15.88:0/724248050 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6c01583f0 0x7fe6c015e1e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009870 tx=0x7fe6b001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d5ca0fac3280ddc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f493959a640 1 -- 172.21.15.88:0/961526032 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969364935 0 0) 0x7f493c0c96f0 con 0x7f493c0ad960 2023-11-20T07:01:20.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f15f729a640 1 --2- 172.21.15.88:0/3925282870 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15e8054100 0x7f15e80e0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f15f729a640 1 -- 172.21.15.88:0/3925282870 >> 172.21.15.88:0/3925282870 conn(0x7f15e8054ce0 msgr2=0x7f15e80550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f15f729a640 1 -- 172.21.15.88:0/3925282870 shutdown_connections 2023-11-20T07:01:20.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7fe6c4e84640 1 -- 172.21.15.88:0/724248050 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00ab600 con 0x7fe6c01583f0 2023-11-20T07:01:20.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7fe6c4e84640 1 -- 172.21.15.88:0/724248050 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b00a7050 con 0x7fe6c01583f0 2023-11-20T07:01:20.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7fe6c4e84640 1 -- 172.21.15.88:0/724248050 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00ab980 con 0x7fe6c01583f0 2023-11-20T07:01:20.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f15f729a640 1 -- 172.21.15.88:0/3925282870 wait complete. 2023-11-20T07:01:20.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f493a59c640 1 -- 172.21.15.88:0/961526032 >> v2:172.21.15.175:3300/0 conn(0x7f493c0b07f0 msgr2=0x7f493c0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f493a59c640 1 --2- 172.21.15.88:0/961526032 >> v2:172.21.15.175:3300/0 conn(0x7f493c0b07f0 0x7f493c0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f493a59c640 1 -- 172.21.15.88:0/961526032 >> v1:172.21.15.88:6789/0 conn(0x7f493c0ad960 legacy=0x7f493c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.298+0000 7f493a59c640 1 -- 172.21.15.88:0/961526032 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c0cbed0 con 0x7f493c164520 2023-11-20T07:01:20.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fe6c6e88640 1 -- 172.21.15.88:0/724248050 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6c01583f0 msgr2=0x7fe6c015e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fe6c6e88640 1 --2- 172.21.15.88:0/724248050 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6c01583f0 0x7fe6c015e1e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009870 tx=0x7fe6b001c510 comp rx=0 tx=0).stop 2023-11-20T07:01:20.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fe6c6e88640 1 -- 172.21.15.88:0/724248050 shutdown_connections 2023-11-20T07:01:20.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fe6c6e88640 1 --2- 172.21.15.88:0/724248050 >> v2:172.21.15.88:3300/0 conn(0x7fe6c00afd90 0x7fe6c00b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fe6c6e88640 1 --2- 172.21.15.88:0/724248050 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6c01583f0 0x7fe6c015e1e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fe6c6e88640 1 -- 172.21.15.88:0/724248050 >> 172.21.15.88:0/724248050 conn(0x7fe6c00cad90 msgr2=0x7fe6c00cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fd1873a3640 1 Processor -- start 2023-11-20T07:01:20.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fd1873a3640 1 -- start start 2023-11-20T07:01:20.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7f15f729a640 1 Processor -- start 2023-11-20T07:01:20.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7f7184594640 1 Processor -- start 2023-11-20T07:01:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7f15f729a640 1 -- start start 2023-11-20T07:01:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7f15f729a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15e8054100 0x7f15e80393f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7f15f729a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15e8055800 0x7f15e8039930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7f15f729a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e80e2d90 0x7f15e804bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7f15f729a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e804e0c0 con 0x7f15e8054100 2023-11-20T07:01:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7f15f729a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e804d4b0 con 0x7f15e80e2d90 2023-11-20T07:01:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7f15f729a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e804d790 con 0x7f15e8055800 2023-11-20T07:01:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fe6c6e88640 1 -- 172.21.15.88:0/724248050 shutdown_connections 2023-11-20T07:01:20.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fe6c6e88640 1 -- 172.21.15.88:0/724248050 wait complete. 2023-11-20T07:01:20.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fd1873a3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd18015c910 0x7fd1800d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fd1873a3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd1800d3170 0x7fd1800cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fd1873a3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1800ce730 con 0x7fd1800cefe0 2023-11-20T07:01:20.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fd1873a3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1800d17a0 con 0x7fd1800d3170 2023-11-20T07:01:20.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7fd1873a3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1800d0dd0 con 0x7fd18015c910 2023-11-20T07:01:20.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f15f4835640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15e8054100 0x7f15e80393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.302+0000 7f7184594640 1 -- start start 2023-11-20T07:01:20.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f7184594640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f717c0d1410 0x7f717c167960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f7184594640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c0d1930 con 0x7f717c15cf00 2023-11-20T07:01:20.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f7184594640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c0d1c10 con 0x7f717c0ce0b0 2023-11-20T07:01:20.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f7184594640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717c15d2e0 con 0x7f717c0d1410 2023-11-20T07:01:20.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f15effff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15e8055800 0x7f15e8039930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f15effff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15e8055800 0x7f15e8039930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38330/0 (socket says 172.21.15.88:38330) 2023-11-20T07:01:20.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f15effff640 1 -- 172.21.15.88:0/3062695573 learned_addr learned my addr 172.21.15.88:0/3062695573 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f493a59c640 1 --2- 172.21.15.88:0/961526032 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f493c164520 0x7f493c0ce010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4934009d90 tx=0x7f493401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=884f221ae556042b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fd1863a1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd18015c910 0x7fd1800d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f15f5036640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e80e2d90 0x7f15e804bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fe6c6e88640 1 Processor -- start 2023-11-20T07:01:20.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fd186ba2640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd1800cefe0 0x7fd18006b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:49110/0 (socket says 172.21.15.88:49110) 2023-11-20T07:01:20.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fd186ba2640 1 -- 172.21.15.88:0/2166678671 learned_addr learned my addr 172.21.15.88:0/2166678671 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:20.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f493959a640 1 -- 172.21.15.88:0/961526032 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49340a5a00 con 0x7f493c164520 2023-11-20T07:01:20.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f493959a640 1 -- 172.21.15.88:0/961526032 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49340a5b60 con 0x7f493c164520 2023-11-20T07:01:20.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f493959a640 1 -- 172.21.15.88:0/961526032 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49340ad440 con 0x7f493c164520 2023-11-20T07:01:20.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fe6c6e88640 1 -- start start 2023-11-20T07:01:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f15f5036640 1 -- 172.21.15.88:0/3062695573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15e8055800 msgr2=0x7f15e8039930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f15f5036640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15e8055800 0x7f15e8039930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f15f5036640 1 -- 172.21.15.88:0/3062695573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15e8054100 msgr2=0x7f15e80393f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f15f5036640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15e8054100 0x7f15e80393f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f15f5036640 1 -- 172.21.15.88:0/3062695573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f004f100 con 0x7f15e80e2d90 2023-11-20T07:01:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f15f4835640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f15e8054100 0x7f15e80393f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fd185ba0640 1 --2- 172.21.15.88:0/2166678671 >> v2:172.21.15.88:3300/0 conn(0x7fd1800d3170 0x7fd1800cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fd1863a1640 1 -- 172.21.15.88:0/2166678671 >> v2:172.21.15.88:3300/0 conn(0x7fd1800d3170 msgr2=0x7fd1800cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fd1863a1640 1 --2- 172.21.15.88:0/2166678671 >> v2:172.21.15.88:3300/0 conn(0x7fd1800d3170 0x7fd1800cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fd1863a1640 1 -- 172.21.15.88:0/2166678671 >> v1:172.21.15.175:6789/0 conn(0x7fd1800cefe0 legacy=0x7fd18006b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fd1863a1640 1 -- 172.21.15.88:0/2166678671 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1800d04a0 con 0x7fd18015c910 2023-11-20T07:01:20.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fd185ba0640 1 --2- 172.21.15.88:0/2166678671 >> v2:172.21.15.88:3300/0 conn(0x7fd1800d3170 0x7fd1800cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:20.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f7181b2f640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f717c0ce0b0 0x7f717c0d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:49116/0 (socket says 172.21.15.88:49116) 2023-11-20T07:01:20.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f7181b2f640 1 -- 172.21.15.88:0/3423395550 learned_addr learned my addr 172.21.15.88:0/3423395550 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:20.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f7182330640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f717c15cf00 0x7f717c0cd9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52486/0 (socket says 172.21.15.88:52486) 2023-11-20T07:01:20.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f4940e6b640 1 -- 172.21.15.88:0/961526032 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f493c164520 msgr2=0x7f493c0ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f4940e6b640 1 --2- 172.21.15.88:0/961526032 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f493c164520 0x7f493c0ce010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4934009d90 tx=0x7f493401c940 comp rx=0 tx=0).stop 2023-11-20T07:01:20.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f3d95006640 1 Processor -- start 2023-11-20T07:01:20.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f3d95006640 1 -- start start 2023-11-20T07:01:20.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773018256 0 0) 0x7f717c0d1c10 con 0x7f717c0ce0b0 2023-11-20T07:01:20.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7168003530 con 0x7f717c0ce0b0 2023-11-20T07:01:20.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f7182b31640 1 --2- 172.21.15.88:0/3423395550 >> v2:172.21.15.175:3300/0 conn(0x7f717c0d1410 0x7f717c167960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f15f5036640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e80e2d90 0x7f15e804bdb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15f0063a60 tx=0x7f15f0095bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f4940e6b640 1 -- 172.21.15.88:0/961526032 shutdown_connections 2023-11-20T07:01:20.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f4940e6b640 1 --2- 172.21.15.88:0/961526032 >> v2:172.21.15.175:3300/0 conn(0x7f493c0b07f0 0x7f493c0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f4940e6b640 1 --2- 172.21.15.88:0/961526032 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f493c164520 0x7f493c0ce010 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f4940e6b640 1 -- 172.21.15.88:0/961526032 >> 172.21.15.88:0/961526032 conn(0x7f493c06c190 msgr2=0x7f493c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f4940e6b640 1 -- 172.21.15.88:0/961526032 shutdown_connections 2023-11-20T07:01:20.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f4940e6b640 1 -- 172.21.15.88:0/961526032 wait complete. 2023-11-20T07:01:20.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3110723819 0 0) 0x7f7168003530 con 0x7f717c0ce0b0 2023-11-20T07:01:20.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 >> v2:172.21.15.175:3300/0 conn(0x7f717c0d1410 msgr2=0x7f717c167960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 --2- 172.21.15.88:0/3423395550 >> v2:172.21.15.175:3300/0 conn(0x7f717c0d1410 0x7f717c167960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 >> v1:172.21.15.88:6789/0 conn(0x7f717c15cf00 legacy=0x7f717c0cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c0d1ef0 con 0x7f717c0ce0b0 2023-11-20T07:01:20.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f7178001680 con 0x7f717c0ce0b0 2023-11-20T07:01:20.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 >> v1:172.21.15.175:6789/0 conn(0x7f717c0ce0b0 legacy=0x7f717c0d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 --2- 172.21.15.88:0/3423395550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71680039d0 0x7f7168003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 --2- 172.21.15.88:0/3423395550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71680047d0 0x7f7168004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 --2- 172.21.15.88:0/3423395550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71680052b0 0x7f716800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c15d2e0 con 0x7f71680052b0 2023-11-20T07:01:20.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716800c1d0 con 0x7f71680039d0 2023-11-20T07:01:20.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716800c390 con 0x7f71680047d0 2023-11-20T07:01:20.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f7182b31640 1 --2- 172.21.15.88:0/3423395550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71680052b0 0x7f716800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fe6c6e88640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6c00afd90 0x7fe6c01545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fe6c6e88640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6c00b3e00 0x7fe6c0151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7f7181b2f640 1 --2- 172.21.15.88:0/3423395550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71680047d0 0x7f7168004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.306+0000 7fe6c6e88640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c01583f0 0x7fe6c014b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c5e86640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6c00afd90 0x7fe6c01545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c5e86640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6c00afd90 0x7fe6c01545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53954/0 (socket says 172.21.15.88:53954) 2023-11-20T07:01:20.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c5e86640 1 -- 172.21.15.88:0/1268948149 learned_addr learned my addr 172.21.15.88:0/1268948149 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c0150060 con 0x7fe6c00afd90 2023-11-20T07:01:20.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c014f450 con 0x7fe6c01583f0 2023-11-20T07:01:20.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c014f730 con 0x7fe6c00b3e00 2023-11-20T07:01:20.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c6687640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c01583f0 0x7fe6c014b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c5685640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6c00b3e00 0x7fe6c0151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c5e86640 1 -- 172.21.15.88:0/1268948149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6c00b3e00 msgr2=0x7fe6c0151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c5e86640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6c00b3e00 0x7fe6c0151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c5e86640 1 -- 172.21.15.88:0/1268948149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c01583f0 msgr2=0x7fe6c014b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c5e86640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c01583f0 0x7fe6c014b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fe6c5e86640 1 -- 172.21.15.88:0/1268948149 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b00094d0 con 0x7fe6c00afd90 2023-11-20T07:01:20.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d95006640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d90160b50 0x7f3d900afd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d95006640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3d900c1920 0x7f3d900b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d95006640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3d90160f30 0x7f3d90164950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d95006640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9006cd20 con 0x7f3d90160f30 2023-11-20T07:01:20.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d95006640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9006c110 con 0x7f3d900c1920 2023-11-20T07:01:20.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d95006640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9006c3f0 con 0x7f3d90160b50 2023-11-20T07:01:20.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f7182b31640 1 -- 172.21.15.88:0/3423395550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71680047d0 msgr2=0x7f7168004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f7182b31640 1 --2- 172.21.15.88:0/3423395550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71680047d0 0x7f7168004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f7182b31640 1 -- 172.21.15.88:0/3423395550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71680039d0 msgr2=0x7f7168003df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-20T07:01:20.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f7182b31640 1 --2- 172.21.15.88:0/3423395550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71680039d0 0x7f7168003df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f7182b31640 1 -- 172.21.15.88:0/3423395550 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7168003530 con 0x7f71680052b0 2023-11-20T07:01:20.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f7181b2f640 1 --2- 172.21.15.88:0/3423395550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71680047d0 0x7f7168004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:20.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f15edffb640 1 -- 172.21.15.88:0/3062695573 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f012a640 con 0x7f15e80e2d90 2023-11-20T07:01:20.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f15edffb640 1 -- 172.21.15.88:0/3062695573 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f012a7a0 con 0x7f15e80e2d90 2023-11-20T07:01:20.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f15edffb640 1 -- 172.21.15.88:0/3062695573 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f012ab10 con 0x7f15e80e2d90 2023-11-20T07:01:20.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f15f729a640 1 -- 172.21.15.88:0/3062695573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e804da70 con 0x7f15e80e2d90 2023-11-20T07:01:20.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f15f729a640 1 -- 172.21.15.88:0/3062695573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e804e550 con 0x7f15e80e2d90 2023-11-20T07:01:20.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f4940e6b640 1 Processor -- start 2023-11-20T07:01:20.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d8ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d90160b50 0x7f3d900afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d8f7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3d900c1920 0x7f3d900b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d8f7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3d900c1920 0x7f3d900b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36032/0 (socket says 172.21.15.88:36032) 2023-11-20T07:01:20.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fd1863a1640 1 --2- 172.21.15.88:0/2166678671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd18015c910 0x7fd1800d1260 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1700097a0 tx=0x7fd17001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd217b7a4de136b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d8f7fe640 1 -- 172.21.15.88:0/4169787363 learned_addr learned my addr 172.21.15.88:0/4169787363 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d8ffff640 1 -- 172.21.15.88:0/4169787363 >> v2:172.21.15.175:3300/0 conn(0x7f3d900c1920 msgr2=0x7f3d900b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d8ffff640 1 --2- 172.21.15.88:0/4169787363 >> v2:172.21.15.175:3300/0 conn(0x7f3d900c1920 0x7f3d900b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d8ffff640 1 -- 172.21.15.88:0/4169787363 >> v2:172.21.15.88:3300/0 conn(0x7f3d90160f30 msgr2=0x7f3d90164950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d8ffff640 1 --2- 172.21.15.88:0/4169787363 >> v2:172.21.15.88:3300/0 conn(0x7f3d90160f30 0x7f3d90164950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f3d8ffff640 1 -- 172.21.15.88:0/4169787363 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9006c6d0 con 0x7f3d90160b50 2023-11-20T07:01:20.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fd18539f640 1 -- 172.21.15.88:0/2166678671 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700ac600 con 0x7fd18015c910 2023-11-20T07:01:20.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fd18539f640 1 -- 172.21.15.88:0/2166678671 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1700a8050 con 0x7fd18015c910 2023-11-20T07:01:20.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7fd18539f640 1 -- 172.21.15.88:0/2166678671 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700ac980 con 0x7fd18015c910 2023-11-20T07:01:20.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fe6c5e86640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6c00afd90 0x7fe6c01545f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6b001a140 tx=0x7fe6b00192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f15d37fe640 1 -- 172.21.15.88:0/3062695573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15cc000fd0 con 0x7f15e80e2d90 2023-11-20T07:01:20.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.310+0000 7f4940e6b640 1 -- start start 2023-11-20T07:01:20.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fc0d210f640 1 Processor -- start 2023-11-20T07:01:20.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fc0d210f640 1 -- start start 2023-11-20T07:01:20.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f7182b31640 1 -- 172.21.15.88:0/3423395550 reap_dead start 2023-11-20T07:01:20.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fe6b67fc640 1 -- 172.21.15.88:0/1268948149 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00b5410 con 0x7fe6c00afd90 2023-11-20T07:01:20.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fd1873a3640 1 -- 172.21.15.88:0/2166678671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd18015c910 msgr2=0x7fd1800d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fd1873a3640 1 --2- 172.21.15.88:0/2166678671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd18015c910 0x7fd1800d1260 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1700097a0 tx=0x7fd17001c3a0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f7182b31640 1 --2- 172.21.15.88:0/3423395550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71680052b0 0x7f716800b990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7174007360 tx=0x7f717401ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb44be062f39a9b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c014fa10 con 0x7fe6c00afd90 2023-11-20T07:01:20.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c014c420 con 0x7fe6c00afd90 2023-11-20T07:01:20.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fe6b67fc640 1 -- 172.21.15.88:0/1268948149 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b00b5570 con 0x7fe6c00afd90 2023-11-20T07:01:20.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fe6b67fc640 1 -- 172.21.15.88:0/1268948149 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00b5410 con 0x7fe6c00afd90 2023-11-20T07:01:20.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f4940e6b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f493c0ad960 0x7f493c14f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71740a5c50 con 0x7f71680052b0 2023-11-20T07:01:20.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6c015f060 con 0x7fe6c00afd90 2023-11-20T07:01:20.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f4940e6b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c0b07f0 0x7f493c0c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f4940e6b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f493c164520 0x7f493c161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71740a5df0 con 0x7f71680052b0 2023-11-20T07:01:20.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f718132e640 1 -- 172.21.15.88:0/3423395550 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174003be0 con 0x7f71680052b0 2023-11-20T07:01:20.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f4940e6b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c161ba0 con 0x7f493c0b07f0 2023-11-20T07:01:20.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fd1873a3640 1 -- 172.21.15.88:0/2166678671 shutdown_connections 2023-11-20T07:01:20.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fd1873a3640 1 --2- 172.21.15.88:0/2166678671 >> v2:172.21.15.88:3300/0 conn(0x7fd1800d3170 0x7fd1800cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fd1873a3640 1 --2- 172.21.15.88:0/2166678671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd18015c910 0x7fd1800d1260 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fd1873a3640 1 -- 172.21.15.88:0/2166678671 >> 172.21.15.88:0/2166678671 conn(0x7fd18009bb50 msgr2=0x7fd1800d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f493a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f493c0ad960 0x7f493c14f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f4940e6b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0c84a0 con 0x7f493c0ad960 2023-11-20T07:01:20.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f4940e6b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c161200 con 0x7f493c164520 2023-11-20T07:01:20.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f493a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f493c0ad960 0x7f493c14f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36046/0 (socket says 172.21.15.88:36046) 2023-11-20T07:01:20.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f493a59c640 1 -- 172.21.15.88:0/2231567004 learned_addr learned my addr 172.21.15.88:0/2231567004 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f493ad9d640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f493c164520 0x7f493c161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fc0d210f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc0cc15a880 0x7fc0cc15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fc0d210f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0cc1614a0 con 0x7fc0cc0cda30 2023-11-20T07:01:20.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fc0d210f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0cc15e000 con 0x7fc0cc0b00e0 2023-11-20T07:01:20.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fc0d210f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0cc0cb1d0 con 0x7fc0cc15a880 2023-11-20T07:01:20.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fc0cbfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc0cc0cda30 0x7fc0cc160d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52500/0 (socket says 172.21.15.88:52500) 2023-11-20T07:01:20.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fc0cbfff640 1 -- 172.21.15.88:0/3354643699 learned_addr learned my addr 172.21.15.88:0/3354643699 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:20.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f7184594640 1 -- 172.21.15.88:0/3423395550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71680052b0 msgr2=0x7f716800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f7184594640 1 --2- 172.21.15.88:0/3423395550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71680052b0 0x7f716800b990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7174007360 tx=0x7f717401ce60 comp rx=0 tx=0).stop 2023-11-20T07:01:20.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f493ad9d640 1 -- 172.21.15.88:0/2231567004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f493c0ad960 msgr2=0x7f493c14f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f493ad9d640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f493c0ad960 0x7f493c14f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f493ad9d640 1 -- 172.21.15.88:0/2231567004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c0b07f0 msgr2=0x7f493c0c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f493ad9d640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493c0b07f0 0x7f493c0c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f493ad9d640 1 -- 172.21.15.88:0/2231567004 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934009a70 con 0x7f493c164520 2023-11-20T07:01:20.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f15edffb640 1 -- 172.21.15.88:0/3062695573 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f15f0131070 con 0x7f15e80e2d90 2023-11-20T07:01:20.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7fc0cb7fe640 1 --2- 172.21.15.88:0/3354643699 >> v2:172.21.15.88:3300/0 conn(0x7fc0cc15a880 0x7fc0cc15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598572090 0 0) 0x7fc0cc1614a0 con 0x7fc0cc0cda30 2023-11-20T07:01:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0b4003530 con 0x7fc0cc0cda30 2023-11-20T07:01:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fd1873a3640 1 -- 172.21.15.88:0/2166678671 shutdown_connections 2023-11-20T07:01:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f7184594640 1 -- 172.21.15.88:0/3423395550 shutdown_connections 2023-11-20T07:01:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f7184594640 1 --2- 172.21.15.88:0/3423395550 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71680052b0 0x7f716800b990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f7184594640 1 -- 172.21.15.88:0/3423395550 >> 172.21.15.88:0/3423395550 conn(0x7f717c0b4470 msgr2=0x7f717c0b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fd1873a3640 1 -- 172.21.15.88:0/2166678671 wait complete. 2023-11-20T07:01:20.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.314+0000 7f493ad9d640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f493c164520 0x7f493c161fc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f492c00e590 tx=0x7f492c00ea50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f492affd640 1 -- 172.21.15.88:0/2231567004 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c013680 con 0x7f493c164520 2023-11-20T07:01:20.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393992254 0 0) 0x7fc0cc15e000 con 0x7fc0cc0b00e0 2023-11-20T07:01:20.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0cc1614a0 con 0x7fc0cc0b00e0 2023-11-20T07:01:20.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f492affd640 1 -- 172.21.15.88:0/2231567004 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c0137e0 con 0x7f493c164520 2023-11-20T07:01:20.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fe6b67fc640 1 -- 172.21.15.88:0/1268948149 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe6b00b2050 con 0x7fe6c00afd90 2023-11-20T07:01:20.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f492affd640 1 -- 172.21.15.88:0/2231567004 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c013b70 con 0x7f493c164520 2023-11-20T07:01:20.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f4940e6b640 1 -- 172.21.15.88:0/2231567004 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c1614e0 con 0x7f493c164520 2023-11-20T07:01:20.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f3d8ffff640 1 --2- 172.21.15.88:0/4169787363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d90160b50 0x7f3d900afd90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3d90066f70 tx=0x7f3d8401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63044b15d1ab6286 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f15edffb640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f15d40664f0 0x7f15d40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fcb9391d640 1 Processor -- start 2023-11-20T07:01:20.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f4940e6b640 1 -- 172.21.15.88:0/2231567004 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c14fbf0 con 0x7f493c164520 2023-11-20T07:01:20.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f15edffb640 1 -- 172.21.15.88:0/3062695573 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f15f019ad60 con 0x7f15e80e2d90 2023-11-20T07:01:20.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f15edffb640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] conn(0x7f15d406fb30 0x7f15d4071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f15edffb640 1 -- 172.21.15.88:0/3062695573 --> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15d4072640 con 0x7f15d406fb30 2023-11-20T07:01:20.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f15edffb640 1 -- 172.21.15.88:0/3062695573 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15f019b0d0 con 0x7f15e80e2d90 2023-11-20T07:01:20.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fcb9391d640 1 -- start start 2023-11-20T07:01:20.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f15f4835640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f15d40664f0 0x7f15d40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1458912732 0 0) 0x7fc0b4003530 con 0x7fc0cc0cda30 2023-11-20T07:01:20.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 >> v2:172.21.15.88:3300/0 conn(0x7fc0cc15a880 msgr2=0x7fc0cc15dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 --2- 172.21.15.88:0/3354643699 >> v2:172.21.15.88:3300/0 conn(0x7fc0cc15a880 0x7fc0cc15dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 >> v1:172.21.15.175:6789/0 conn(0x7fc0cc0b00e0 legacy=0x7fc0cc160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc0cb4b0 con 0x7fc0cc0cda30 2023-11-20T07:01:20.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fc0bc001680 con 0x7fc0cc0cda30 2023-11-20T07:01:20.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 >> v1:172.21.15.88:6789/0 conn(0x7fc0cc0cda30 legacy=0x7fc0cc160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 --2- 172.21.15.88:0/3354643699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b4003b40 0x7fc0b4003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 --2- 172.21.15.88:0/3354643699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40047d0 0x7fc0b4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 --2- 172.21.15.88:0/3354643699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0b4005190 0x7fc0b400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c40015c0 con 0x7fc0b4003b40 2023-11-20T07:01:20.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc0cb1d0 con 0x7fc0b40047d0 2023-11-20T07:01:20.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b400c090 con 0x7fc0b4005190 2023-11-20T07:01:20.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0caffd640 1 --2- 172.21.15.88:0/3354643699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40047d0 0x7fc0b4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fe6b67fc640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6a4066560 0x7fe6a4068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fe6b67fc640 1 -- 172.21.15.88:0/1268948149 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe6b011e840 con 0x7fe6c00afd90 2023-11-20T07:01:20.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f7184594640 1 -- 172.21.15.88:0/3423395550 shutdown_connections 2023-11-20T07:01:20.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0cbfff640 1 --2- 172.21.15.88:0/3354643699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0b4005190 0x7fc0b400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fe6c5685640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6a4066560 0x7fe6a4068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0caffd640 1 -- 172.21.15.88:0/3354643699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0b4005190 msgr2=0x7fc0b400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0caffd640 1 --2- 172.21.15.88:0/3354643699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0b4005190 0x7fc0b400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0caffd640 1 -- 172.21.15.88:0/3354643699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b4003b40 msgr2=0x7fc0b4003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0caffd640 1 --2- 172.21.15.88:0/3354643699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b4003b40 0x7fc0b4003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0caffd640 1 -- 172.21.15.88:0/3354643699 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b4003530 con 0x7fc0b40047d0 2023-11-20T07:01:20.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fe6b67fc640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] conn(0x7fe6a406faa0 0x7fe6a4071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f15f4835640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f15d40664f0 0x7f15d40689b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f15dc006fd0 tx=0x7f15dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fd1873a3640 1 Processor -- start 2023-11-20T07:01:20.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fc0cbfff640 1 -- 172.21.15.88:0/3354643699 reap_dead start 2023-11-20T07:01:20.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fe6b67fc640 1 -- 172.21.15.88:0/1268948149 --> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6a40725b0 con 0x7fe6a406faa0 2023-11-20T07:01:20.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fe6b67fc640 1 -- 172.21.15.88:0/1268948149 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6b00b5410 con 0x7fe6c00afd90 2023-11-20T07:01:20.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fd1873a3640 1 -- start start 2023-11-20T07:01:20.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f3d8effd640 1 -- 172.21.15.88:0/4169787363 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d840ab610 con 0x7f3d90160b50 2023-11-20T07:01:20.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f3d8effd640 1 -- 172.21.15.88:0/4169787363 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d840ab770 con 0x7f3d90160b50 2023-11-20T07:01:20.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f3d8effd640 1 -- 172.21.15.88:0/4169787363 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d840abb00 con 0x7f3d90160b50 2023-11-20T07:01:20.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fe6c6687640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] conn(0x7fe6a406faa0 0x7fe6a4071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fe6c5685640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6a4066560 0x7fe6a4068a20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00b34c0 tx=0x7fe6bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7f4940e6b640 1 -- 172.21.15.88:0/2231567004 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f493c16de20 con 0x7f493c164520 2023-11-20T07:01:20.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7f7184594640 1 -- 172.21.15.88:0/3423395550 wait complete. 2023-11-20T07:01:20.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fcb9391d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c06ccb0 0x7fcb8c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fcb9391d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcb8c15ccd0 0x7fcb8c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.318+0000 7fcb9391d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcb8c0ccec0 0x7fcb8c0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb90eb8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcb8c15ccd0 0x7fcb8c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fe6c6687640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] conn(0x7fe6a406faa0 0x7fe6a4071ee0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb9391d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c15d4f0 con 0x7fcb8c0ccec0 2023-11-20T07:01:20.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb9391d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c070af0 con 0x7fcb8c15ccd0 2023-11-20T07:01:20.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb9391d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c070dd0 con 0x7fcb8c06ccb0 2023-11-20T07:01:20.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb916b9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c06ccb0 0x7fcb8c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb90eb8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcb8c15ccd0 0x7fcb8c0cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36070/0 (socket says 172.21.15.88:36070) 2023-11-20T07:01:20.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb90eb8640 1 -- 172.21.15.88:0/26319583 learned_addr learned my addr 172.21.15.88:0/26319583 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb91eba640 1 --2- 172.21.15.88:0/26319583 >> v2:172.21.15.88:3300/0 conn(0x7fcb8c0ccec0 0x7fcb8c0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1873a3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1800cefe0 0x7fd180155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1873a3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1800d3170 0x7fd18014ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1873a3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd18015c910 0x7fd1800b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1873a3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1800cb240 con 0x7fd1800d3170 2023-11-20T07:01:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1873a3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd180150400 con 0x7fd1800cefe0 2023-11-20T07:01:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1873a3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1800caf10 con 0x7fd18015c910 2023-11-20T07:01:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1863a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1800cefe0 0x7fd180155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1863a1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1800cefe0 0x7fd180155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36076/0 (socket says 172.21.15.88:36076) 2023-11-20T07:01:20.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1863a1640 1 -- 172.21.15.88:0/3780493493 learned_addr learned my addr 172.21.15.88:0/3780493493 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd186ba2640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd18015c910 0x7fd1800b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd185ba0640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1800d3170 0x7fd18014ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7f3d95006640 1 -- 172.21.15.88:0/4169787363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d90160b50 msgr2=0x7f3d900afd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7f3d95006640 1 --2- 172.21.15.88:0/4169787363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d90160b50 0x7f3d900afd90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3d90066f70 tx=0x7f3d8401c450 comp rx=0 tx=0).stop 2023-11-20T07:01:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7f3d95006640 1 -- 172.21.15.88:0/4169787363 shutdown_connections 2023-11-20T07:01:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7f3d95006640 1 --2- 172.21.15.88:0/4169787363 >> v2:172.21.15.88:3300/0 conn(0x7f3d90160f30 0x7f3d90164950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7f3d95006640 1 --2- 172.21.15.88:0/4169787363 >> v2:172.21.15.175:3300/0 conn(0x7f3d900c1920 0x7f3d900b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7f3d95006640 1 --2- 172.21.15.88:0/4169787363 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d90160b50 0x7f3d900afd90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7f3d95006640 1 -- 172.21.15.88:0/4169787363 >> 172.21.15.88:0/4169787363 conn(0x7f3d900cad90 msgr2=0x7f3d900cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fe6b67fc640 1 -- 172.21.15.88:0/1268948149 <== osd.1 v2:172.21.15.88:6823/1785526127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe6a40725b0 con 0x7fe6a406faa0 2023-11-20T07:01:20.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7f3d95006640 1 -- 172.21.15.88:0/4169787363 shutdown_connections 2023-11-20T07:01:20.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1863a1640 1 -- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd18015c910 msgr2=0x7fd1800b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1863a1640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd18015c910 0x7fd1800b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1863a1640 1 -- 172.21.15.88:0/3780493493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1800d3170 msgr2=0x7fd18014ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1863a1640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1800d3170 0x7fd18014ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1863a1640 1 -- 172.21.15.88:0/3780493493 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1700093b0 con 0x7fd1800cefe0 2023-11-20T07:01:20.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7f3d95006640 1 -- 172.21.15.88:0/4169787363 wait complete. 2023-11-20T07:01:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb90eb8640 1 -- 172.21.15.88:0/26319583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c06ccb0 msgr2=0x7fcb8c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb90eb8640 1 --2- 172.21.15.88:0/26319583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c06ccb0 0x7fcb8c15c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb90eb8640 1 -- 172.21.15.88:0/26319583 >> v2:172.21.15.88:3300/0 conn(0x7fcb8c0ccec0 msgr2=0x7fcb8c0712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb90eb8640 1 --2- 172.21.15.88:0/26319583 >> v2:172.21.15.88:3300/0 conn(0x7fcb8c0ccec0 0x7fcb8c0712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fcb90eb8640 1 -- 172.21.15.88:0/26319583 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c0c9130 con 0x7fcb8c15ccd0 2023-11-20T07:01:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1863a1640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1800cefe0 0x7fd180155ea0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd170019fd0 tx=0x7fd170019140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f492affd640 1 -- 172.21.15.88:0/2231567004 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f492c013cd0 con 0x7f493c164520 2023-11-20T07:01:20.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd176ffd640 1 -- 172.21.15.88:0/3780493493 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1700059a0 con 0x7fd1800cefe0 2023-11-20T07:01:20.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f7184594640 1 Processor -- start 2023-11-20T07:01:20.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1873a3640 1 -- 172.21.15.88:0/3780493493 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1801506a0 con 0x7fd1800cefe0 2023-11-20T07:01:20.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd176ffd640 1 -- 172.21.15.88:0/3780493493 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd170005b00 con 0x7fd1800cefe0 2023-11-20T07:01:20.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd176ffd640 1 -- 172.21.15.88:0/3780493493 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170005e90 con 0x7fd1800cefe0 2023-11-20T07:01:20.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.322+0000 7fd1873a3640 1 -- 172.21.15.88:0/3780493493 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1801563e0 con 0x7fd1800cefe0 2023-11-20T07:01:20.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fcb916b9640 1 --2- 172.21.15.88:0/26319583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c06ccb0 0x7fcb8c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:20.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f15effff640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] conn(0x7f15d406fb30 0x7f15d4071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f3d95006640 1 Processor -- start 2023-11-20T07:01:20.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f3d95006640 1 -- start start 2023-11-20T07:01:20.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f492affd640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f491c0664f0 0x7f491c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f15effff640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] conn(0x7f15d406fb30 0x7f15d4071f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fd1873a3640 1 -- 172.21.15.88:0/3780493493 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd18015ccf0 con 0x7fd1800cefe0 2023-11-20T07:01:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fc0caffd640 1 --2- 172.21.15.88:0/3354643699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40047d0 0x7fc0b4004c50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c4e0 tx=0x7fc0c401cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f63f3ac1896cbc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f7184594640 1 -- start start 2023-11-20T07:01:20.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f492affd640 1 -- 172.21.15.88:0/2231567004 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f492c083e70 con 0x7f493c164520 2023-11-20T07:01:20.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f492affd640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] conn(0x7f491c06fb30 0x7f491c071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f492affd640 1 -- 172.21.15.88:0/2231567004 --> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f491c072640 con 0x7f491c06fb30 2023-11-20T07:01:20.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f492affd640 1 -- 172.21.15.88:0/2231567004 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f492c086580 con 0x7f493c164520 2023-11-20T07:01:20.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fd176ffd640 1 -- 172.21.15.88:0/3780493493 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd1700b3040 con 0x7fd1800cefe0 2023-11-20T07:01:20.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fcb90eb8640 1 --2- 172.21.15.88:0/26319583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c15ccd0 0x7fcb8c0cc980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0b1160 tx=0x7fcb7c01c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40632df4dd30aed1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f4939d9b640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] conn(0x7f491c06fb30 0x7f491c071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7f493a59c640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f491c0664f0 0x7f491c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fcb83fff640 1 -- 172.21.15.88:0/26319583 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c0ab680 con 0x7fcb8c15ccd0 2023-11-20T07:01:20.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fcb83fff640 1 -- 172.21.15.88:0/26319583 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c0ab7e0 con 0x7fcb8c15ccd0 2023-11-20T07:01:20.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fcb83fff640 1 -- 172.21.15.88:0/26319583 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c0abb70 con 0x7fcb8c15ccd0 2023-11-20T07:01:20.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fd176ffd640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd1640664a0 0x7fd164068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fd176ffd640 1 -- 172.21.15.88:0/3780493493 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd17011dc20 con 0x7fd1800cefe0 2023-11-20T07:01:20.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f4939d9b640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] conn(0x7f491c06fb30 0x7f491c071f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d95006640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d900c1920 0x7f3d90156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fd176ffd640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] conn(0x7fd16406f870 0x7fd164071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fd185ba0640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd1640664a0 0x7fd164068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fd176ffd640 1 -- 172.21.15.88:0/3780493493 --> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd164072380 con 0x7fd16406f870 2023-11-20T07:01:20.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fd176ffd640 1 -- 172.21.15.88:0/3780493493 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1701202e0 con 0x7fd1800cefe0 2023-11-20T07:01:20.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.326+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4003b80 con 0x7fc0b40047d0 2023-11-20T07:01:20.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7184594640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71680052b0 0x7f717c0c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d95006640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d90160b50 0x7f3d900b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d95006640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d90160f30 0x7f3d90201750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d95006640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d901614e0 con 0x7f3d90160f30 2023-11-20T07:01:20.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d95006640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d900c4cb0 con 0x7f3d90160b50 2023-11-20T07:01:20.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d95006640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d90156fc0 con 0x7f3d900c1920 2023-11-20T07:01:20.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f493a59c640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f491c0664f0 0x7f491c0689b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f493401aff0 tx=0x7f49340a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fd186ba2640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] conn(0x7fd16406f870 0x7fd164071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c4003d00 con 0x7fc0b40047d0 2023-11-20T07:01:20.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fc0ca7fc640 1 -- 172.21.15.88:0/3354643699 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40a5b50 con 0x7fc0b40047d0 2023-11-20T07:01:20.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fd185ba0640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd1640664a0 0x7fd164068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd180154890 tx=0x7fd1780077c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fcb9391d640 1 -- 172.21.15.88:0/26319583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c15ccd0 msgr2=0x7fcb8c0cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f15edffb640 1 -- 172.21.15.88:0/3062695573 <== osd.0 v2:172.21.15.88:6808/2669156900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f15d4072640 con 0x7f15d406fb30 2023-11-20T07:01:20.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7182330640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71680052b0 0x7f717c0c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7182330640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71680052b0 0x7f717c0c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54012/0 (socket says 172.21.15.88:54012) 2023-11-20T07:01:20.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7182330640 1 -- 172.21.15.88:0/2774499516 learned_addr learned my addr 172.21.15.88:0/2774499516 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fc0d210f640 1 -- 172.21.15.88:0/3354643699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40047d0 msgr2=0x7fc0b4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7184594640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f717c0c8fd0 0x7f717c0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fc0d210f640 1 --2- 172.21.15.88:0/3354643699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40047d0 0x7fc0b4004c50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c4e0 tx=0x7fc0c401cd60 comp rx=0 tx=0).stop 2023-11-20T07:01:20.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7184594640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717c0b3a70 0x7f717c0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7184594640 1 -- 172.21.15.88:0/2774499516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c150720 con 0x7f71680052b0 2023-11-20T07:01:20.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7184594640 1 -- 172.21.15.88:0/2774499516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c1589f0 con 0x7f717c0b3a70 2023-11-20T07:01:20.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7184594640 1 -- 172.21.15.88:0/2774499516 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c1f6580 con 0x7f717c0c8fd0 2023-11-20T07:01:20.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d94805640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d90160f30 0x7f3d90201750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fd186ba2640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] conn(0x7fd16406f870 0x7fd164071cb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d8ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d900c1920 0x7f3d90156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fcb9391d640 1 --2- 172.21.15.88:0/26319583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c15ccd0 0x7fcb8c0cc980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0b1160 tx=0x7fcb7c01c4c0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fcb9391d640 1 -- 172.21.15.88:0/26319583 shutdown_connections 2023-11-20T07:01:20.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fcb9391d640 1 --2- 172.21.15.88:0/26319583 >> v2:172.21.15.88:3300/0 conn(0x7fcb8c0ccec0 0x7fcb8c0712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fcb9391d640 1 --2- 172.21.15.88:0/26319583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c15ccd0 0x7fcb8c0cc980 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fcb9391d640 1 --2- 172.21.15.88:0/26319583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c06ccb0 0x7fcb8c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d8f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d90160b50 0x7f3d900b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7181b2f640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f717c0c8fd0 0x7f717c0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fc0d210f640 1 -- 172.21.15.88:0/3354643699 shutdown_connections 2023-11-20T07:01:20.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fc0d210f640 1 --2- 172.21.15.88:0/3354643699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40047d0 0x7fc0b4004c50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fc0d210f640 1 -- 172.21.15.88:0/3354643699 >> 172.21.15.88:0/3354643699 conn(0x7fc0cc06c190 msgr2=0x7fc0cc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d8f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d90160b50 0x7f3d900b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36092/0 (socket says 172.21.15.88:36092) 2023-11-20T07:01:20.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fc0d210f640 1 -- 172.21.15.88:0/3354643699 shutdown_connections 2023-11-20T07:01:20.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f492affd640 1 -- 172.21.15.88:0/2231567004 <== osd.2 v2:172.21.15.88:6800/1256076870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f491c072640 con 0x7f491c06fb30 2023-11-20T07:01:20.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fc0d210f640 1 -- 172.21.15.88:0/3354643699 wait complete. 2023-11-20T07:01:20.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fcb9391d640 1 -- 172.21.15.88:0/26319583 >> 172.21.15.88:0/26319583 conn(0x7fcb8c06c190 msgr2=0x7fcb8c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d94805640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d90160f30 0x7f3d90201750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54000/0 (socket says 172.21.15.88:54000) 2023-11-20T07:01:20.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d94805640 1 -- 172.21.15.88:0/1845870427 learned_addr learned my addr 172.21.15.88:0/1845870427 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d8ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d900c1920 0x7f3d90156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38392/0 (socket says 172.21.15.88:38392) 2023-11-20T07:01:20.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7182330640 1 -- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f717c0c8fd0 msgr2=0x7f717c0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7182330640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f717c0c8fd0 0x7f717c0c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f7182330640 1 -- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717c0b3a70 msgr2=0x7f717c0c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d94805640 1 -- 172.21.15.88:0/1845870427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d900c1920 msgr2=0x7f3d90156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d94805640 1 --2- 172.21.15.88:0/1845870427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d900c1920 0x7f3d90156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d94805640 1 -- 172.21.15.88:0/1845870427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d90160b50 msgr2=0x7f3d900b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d94805640 1 --2- 172.21.15.88:0/1845870427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d90160b50 0x7f3d900b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d94805640 1 -- 172.21.15.88:0/1845870427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84009420 con 0x7f3d90160f30 2023-11-20T07:01:20.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fd176ffd640 1 -- 172.21.15.88:0/3780493493 <== osd.4 v2:172.21.15.175:6800/1731999626 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd164072380 con 0x7fd16406f870 2023-11-20T07:01:20.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d94805640 1 --2- 172.21.15.88:0/1845870427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d90160f30 0x7f3d90201750 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000b3c0 tx=0x7f3d8000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d8cff9640 1 -- 172.21.15.88:0/1845870427 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80011830 con 0x7f3d90160f30 2023-11-20T07:01:20.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d95006640 1 -- 172.21.15.88:0/1845870427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d900af3c0 con 0x7f3d90160f30 2023-11-20T07:01:20.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d95006640 1 -- 172.21.15.88:0/1845870427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d900c46d0 con 0x7f3d90160f30 2023-11-20T07:01:20.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fcb9391d640 1 -- 172.21.15.88:0/26319583 shutdown_connections 2023-11-20T07:01:20.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7fc0d210f640 1 Processor -- start 2023-11-20T07:01:20.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d8cff9640 1 -- 172.21.15.88:0/1845870427 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d80011990 con 0x7f3d90160f30 2023-11-20T07:01:20.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.330+0000 7f3d8cff9640 1 -- 172.21.15.88:0/1845870427 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80011830 con 0x7f3d90160f30 2023-11-20T07:01:20.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7fcb9391d640 1 -- 172.21.15.88:0/26319583 wait complete. 2023-11-20T07:01:20.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7fc0d210f640 1 -- start start 2023-11-20T07:01:20.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7f3d767fc640 1 -- 172.21.15.88:0/1845870427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d900cc3b0 con 0x7f3d90160f30 2023-11-20T07:01:20.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7f7182b31640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717c0b3a70 0x7f717c0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7fc0d210f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b40047d0 0x7fc0cc0c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7f3d8cff9640 1 -- 172.21.15.88:0/1845870427 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3d80011b00 con 0x7f3d90160f30 2023-11-20T07:01:20.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7fc0d210f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0cc15ac90 0x7fc0cc157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7f7182330640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717c0b3a70 0x7f717c0c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7f7182330640 1 -- 172.21.15.88:0/2774499516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c157de0 con 0x7f71680052b0 2023-11-20T07:01:20.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7f7182b31640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717c0b3a70 0x7f717c0c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:20.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7fc0d210f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0cc1599c0 0x7fc0cc159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7fc0d210f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc15bf60 con 0x7fc0b40047d0 2023-11-20T07:01:20.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7fc0d210f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc15a3b0 con 0x7fc0cc15ac90 2023-11-20T07:01:20.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7fc0d210f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc1581a0 con 0x7fc0cc1599c0 2023-11-20T07:01:20.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7f7182330640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71680052b0 0x7f717c0c7830 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f716c00c480 tx=0x7f716c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7fc0cbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0cc1599c0 0x7fc0cc159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7fc0cbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0cc1599c0 0x7fc0cc159e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38412/0 (socket says 172.21.15.88:38412) 2023-11-20T07:01:20.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7fc0cbfff640 1 -- 172.21.15.88:0/974868578 learned_addr learned my addr 172.21.15.88:0/974868578 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7fc0caffd640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0cc15ac90 0x7fc0cc157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.334+0000 7f3d8cff9640 1 --2- 172.21.15.88:0/1845870427 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3d7c066500 0x7f3d7c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f3d8ffff640 1 --2- 172.21.15.88:0/1845870427 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3d7c066500 0x7f3d7c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb9391d640 1 Processor -- start 2023-11-20T07:01:20.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0cb7fe640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b40047d0 0x7fc0cc0c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb9391d640 1 -- start start 2023-11-20T07:01:20.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f3d8cff9640 1 -- 172.21.15.88:0/1845870427 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d80054060 con 0x7f3d90160f30 2023-11-20T07:01:20.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f3d8ffff640 1 --2- 172.21.15.88:0/1845870427 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3d7c066500 0x7f3d7c0689c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3d840af000 tx=0x7f3d840a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f3d8cff9640 1 --2- 172.21.15.88:0/1845870427 >> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] conn(0x7f3d7c06fac0 0x7f3d7c071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f7172ffd640 1 -- 172.21.15.88:0/2774499516 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c005c30 con 0x7f71680052b0 2023-11-20T07:01:20.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0cbfff640 1 -- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0cc15ac90 msgr2=0x7fc0cc157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0cbfff640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0cc15ac90 0x7fc0cc157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0cbfff640 1 -- 172.21.15.88:0/974868578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b40047d0 msgr2=0x7fc0cc0c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0cbfff640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b40047d0 0x7fc0cc0c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0cbfff640 1 -- 172.21.15.88:0/974868578 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc0b18d0 con 0x7fc0cc1599c0 2023-11-20T07:01:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f3d8cff9640 1 -- 172.21.15.88:0/1845870427 --> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d7c0725d0 con 0x7f3d7c06fac0 2023-11-20T07:01:20.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f3d8cff9640 1 -- 172.21.15.88:0/1845870427 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d800503a0 con 0x7f3d90160f30 2023-11-20T07:01:20.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f3d8f7fe640 1 --2- 172.21.15.88:0/1845870427 >> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] conn(0x7f3d7c06fac0 0x7f3d7c071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb9391d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c06ccb0 0x7fcb8c157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb9391d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c0ccec0 0x7fcb8c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb9391d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb8c15ccd0 0x7fcb8c159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb9391d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c15a580 con 0x7fcb8c15ccd0 2023-11-20T07:01:20.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb9391d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c15aa10 con 0x7fcb8c0ccec0 2023-11-20T07:01:20.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb9391d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c159970 con 0x7fcb8c06ccb0 2023-11-20T07:01:20.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0cb7fe640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b40047d0 0x7fc0cc0c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:20.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0cbfff640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0cc1599c0 0x7fc0cc159e70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc004880 tx=0x7fc0bc008430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0b3fff640 1 -- 172.21.15.88:0/974868578 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc008760 con 0x7fc0cc1599c0 2023-11-20T07:01:20.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0b3fff640 1 -- 172.21.15.88:0/974868578 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0bc00e700 con 0x7fc0cc1599c0 2023-11-20T07:01:20.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0d210f640 1 -- 172.21.15.88:0/974868578 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0cc15b110 con 0x7fc0cc1599c0 2023-11-20T07:01:20.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0b3fff640 1 -- 172.21.15.88:0/974868578 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc00ea70 con 0x7fc0cc1599c0 2023-11-20T07:01:20.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fc0d210f640 1 -- 172.21.15.88:0/974868578 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc15b6c0 con 0x7fc0cc1599c0 2023-11-20T07:01:20.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f3d8f7fe640 1 --2- 172.21.15.88:0/1845870427 >> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] conn(0x7f3d7c06fac0 0x7f3d7c071f00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f7172ffd640 1 -- 172.21.15.88:0/2774499516 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c005d90 con 0x7f71680052b0 2023-11-20T07:01:20.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f7172ffd640 1 -- 172.21.15.88:0/2774499516 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c007290 con 0x7f71680052b0 2023-11-20T07:01:20.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f7184594640 1 -- 172.21.15.88:0/2774499516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c1580c0 con 0x7f71680052b0 2023-11-20T07:01:20.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f7184594640 1 -- 172.21.15.88:0/2774499516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717c158680 con 0x7f71680052b0 2023-11-20T07:01:20.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7f7170ff9640 1 -- 172.21.15.88:0/2774499516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7164000fd0 con 0x7f71680052b0 2023-11-20T07:01:20.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb916b9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c06ccb0 0x7fcb8c157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb916b9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c06ccb0 0x7fcb8c157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38424/0 (socket says 172.21.15.88:38424) 2023-11-20T07:01:20.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb916b9640 1 -- 172.21.15.88:0/937807620 learned_addr learned my addr 172.21.15.88:0/937807620 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb90eb8640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c0ccec0 0x7fcb8c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb90eb8640 1 -- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c06ccb0 msgr2=0x7fcb8c157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb90eb8640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb8c06ccb0 0x7fcb8c157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb90eb8640 1 -- 172.21.15.88:0/937807620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb8c15ccd0 msgr2=0x7fcb8c159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb90eb8640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb8c15ccd0 0x7fcb8c159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.338+0000 7fcb90eb8640 1 -- 172.21.15.88:0/937807620 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c0094d0 con 0x7fcb8c0ccec0 2023-11-20T07:01:20.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.342+0000 7fc0d210f640 1 -- 172.21.15.88:0/974868578 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc0cc0b0980 con 0x7fc0cc1599c0 2023-11-20T07:01:20.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.342+0000 7fcb90eb8640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c0ccec0 0x7fcb8c158e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0ac000 tx=0x7fcb7c01ad60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.342+0000 7fcb81ffb640 1 -- 172.21.15.88:0/937807620 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c0b4800 con 0x7fcb8c0ccec0 2023-11-20T07:01:20.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.342+0000 7fcb81ffb640 1 -- 172.21.15.88:0/937807620 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c0b4980 con 0x7fcb8c0ccec0 2023-11-20T07:01:20.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.342+0000 7fcb81ffb640 1 -- 172.21.15.88:0/937807620 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c0b4d30 con 0x7fcb8c0ccec0 2023-11-20T07:01:20.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.342+0000 7fcb9391d640 1 -- 172.21.15.88:0/937807620 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c159c50 con 0x7fcb8c0ccec0 2023-11-20T07:01:20.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.342+0000 7f3d8cff9640 1 -- 172.21.15.88:0/1845870427 <== osd.3 v2:172.21.15.88:6816/1570500 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f3d7c0725d0 con 0x7f3d7c06fac0 2023-11-20T07:01:20.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.342+0000 7fcb9391d640 1 -- 172.21.15.88:0/937807620 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c15a210 con 0x7fcb8c0ccec0 2023-11-20T07:01:20.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.342+0000 7fc0b3fff640 1 -- 172.21.15.88:0/974868578 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc0bc00ebd0 con 0x7fc0cc1599c0 2023-11-20T07:01:20.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7f7172ffd640 1 -- 172.21.15.88:0/2774499516 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f716c0073f0 con 0x7f71680052b0 2023-11-20T07:01:20.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7fcb9391d640 1 -- 172.21.15.88:0/937807620 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb6c000fd0 con 0x7fcb8c0ccec0 2023-11-20T07:01:20.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7fc0b3fff640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0b80664d0 0x7fc0b8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7fc0b3fff640 1 -- 172.21.15.88:0/974868578 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc0bc083de0 con 0x7fc0cc1599c0 2023-11-20T07:01:20.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7fc0b3fff640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] conn(0x7fc0b806fa10 0x7fc0b8071e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7fc0b3fff640 1 -- 172.21.15.88:0/974868578 --> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0b8072520 con 0x7fc0b806fa10 2023-11-20T07:01:20.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7fc0b3fff640 1 -- 172.21.15.88:0/974868578 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0bc051000 con 0x7fc0cc1599c0 2023-11-20T07:01:20.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7f7172ffd640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7160066570 0x7f7160068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7fc0caffd640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] conn(0x7fc0b806fa10 0x7fc0b8071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7fc0caffd640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] conn(0x7fc0b806fa10 0x7fc0b8071e50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7fc0cb7fe640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0b80664d0 0x7fc0b8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7f7172ffd640 1 -- 172.21.15.88:0/2774499516 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f716c083d30 con 0x7f71680052b0 2023-11-20T07:01:20.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7f7172ffd640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] conn(0x7f716006fbb0 0x7f7160071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7f7172ffd640 1 -- 172.21.15.88:0/2774499516 --> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71600726c0 con 0x7f716006fbb0 2023-11-20T07:01:20.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7f7172ffd640 1 -- 172.21.15.88:0/2774499516 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f716c0840e0 con 0x7f71680052b0 2023-11-20T07:01:20.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7f7182b31640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] conn(0x7f716006fbb0 0x7f7160071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7f7181b2f640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7160066570 0x7f7160068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.346+0000 7fcb81ffb640 1 -- 172.21.15.88:0/937807620 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcb7c0c83a0 con 0x7fcb8c0ccec0 2023-11-20T07:01:20.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.350+0000 7fc0b3fff640 1 -- 172.21.15.88:0/974868578 <== osd.7 v2:172.21.15.175:6808/205055633 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc0b8072520 con 0x7fc0b806fa10 2023-11-20T07:01:20.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.350+0000 7fc0cb7fe640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0b80664d0 0x7fc0b8068990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc063a60 tx=0x7fc0c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.350+0000 7f7182b31640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] conn(0x7f716006fbb0 0x7f7160071ff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.350+0000 7fcb81ffb640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcb700664a0 0x7fcb70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.350+0000 7fcb81ffb640 1 -- 172.21.15.88:0/937807620 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcb7c11f340 con 0x7fcb8c0ccec0 2023-11-20T07:01:20.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.350+0000 7fcb81ffb640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] conn(0x7fcb7006fae0 0x7fcb70071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.350+0000 7fcb81ffb640 1 -- 172.21.15.88:0/937807620 --> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb700725f0 con 0x7fcb7006fae0 2023-11-20T07:01:20.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.350+0000 7fcb81ffb640 1 -- 172.21.15.88:0/937807620 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb7c11f6f0 con 0x7fcb8c0ccec0 2023-11-20T07:01:20.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.350+0000 7f7172ffd640 1 -- 172.21.15.88:0/2774499516 <== osd.5 v2:172.21.15.175:6810/2498780564 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f71600726c0 con 0x7f716006fbb0 2023-11-20T07:01:20.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.350+0000 7fcb916b9640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcb700664a0 0x7fcb70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.350+0000 7fcb91eba640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] conn(0x7fcb7006fae0 0x7fcb70071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.350+0000 7f7181b2f640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7160066570 0x7f7160068a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f717c0ccac0 tx=0x7f7178001bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.354+0000 7fcb91eba640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] conn(0x7fcb7006fae0 0x7fcb70071f20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.354+0000 7fcb916b9640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcb700664a0 0x7fcb70068960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0ad6c0 tx=0x7fcb88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.354+0000 7fcb81ffb640 1 -- 172.21.15.88:0/937807620 <== osd.6 v2:172.21.15.175:6822/3652084907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fcb700725f0 con 0x7fcb7006fae0 2023-11-20T07:01:20.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7fd1873a3640 1 -- 172.21.15.88:0/3780493493 --> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1800cf870 con 0x7fd16406f870 2023-11-20T07:01:20.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7f15d37fe640 1 -- 172.21.15.88:0/3062695573 --> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f15cc002cc0 con 0x7f15d406fb30 2023-11-20T07:01:20.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 --> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6c01501a0 con 0x7fe6a406faa0 2023-11-20T07:01:20.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7f4940e6b640 1 -- 172.21.15.88:0/2231567004 --> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f493c161ce0 con 0x7f491c06fb30 2023-11-20T07:01:20.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7fe6b67fc640 1 -- 172.21.15.88:0/1268948149 <== osd.1 v2:172.21.15.88:6823/1785526127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe6b800f040 con 0x7fe6a406faa0 2023-11-20T07:01:20.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7fd176ffd640 1 -- 172.21.15.88:0/3780493493 <== osd.4 v2:172.21.15.175:6800/1731999626 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd164072380 con 0x7fd16406f870 2023-11-20T07:01:20.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7fd1873a3640 1 -- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] conn(0x7fd16406f870 msgr2=0x7fd164071cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7fd1873a3640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] conn(0x7fd16406f870 0x7fd164071cb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 >> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] conn(0x7fe6a406faa0 msgr2=0x7fe6a4071ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7fe6c6e88640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] conn(0x7fe6a406faa0 0x7fe6a4071ee0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7f15edffb640 1 -- 172.21.15.88:0/3062695573 <== osd.0 v2:172.21.15.88:6808/2669156900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f15cc002cc0 con 0x7f15d406fb30 2023-11-20T07:01:20.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7f492affd640 1 -- 172.21.15.88:0/2231567004 <== osd.2 v2:172.21.15.88:6800/1256076870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f493c161ce0 con 0x7f491c06fb30 2023-11-20T07:01:20.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.358+0000 7fd1873a3640 1 -- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd1640664a0 msgr2=0x7fd164068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fd1873a3640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd1640664a0 0x7fd164068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd180154890 tx=0x7fd1780077c0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fd1873a3640 1 -- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1800cefe0 msgr2=0x7fd180155ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fd1873a3640 1 --2- 172.21.15.88:0/3780493493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1800cefe0 0x7fd180155ea0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd170019fd0 tx=0x7fd170019140 comp rx=0 tx=0).stop 2023-11-20T07:01:20.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fd186ba2640 1 -- 172.21.15.88:0/3780493493 reap_dead start 2023-11-20T07:01:20.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fd1873a3640 1 -- 172.21.15.88:0/3780493493 shutdown_connections 2023-11-20T07:01:20.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fd1873a3640 1 -- 172.21.15.88:0/3780493493 >> 172.21.15.88:0/3780493493 conn(0x7fd18009bb50 msgr2=0x7fd18006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6a4066560 msgr2=0x7fe6a4068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fe6c6e88640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6a4066560 0x7fe6a4068a20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00b34c0 tx=0x7fe6bc009040 comp rx=0 tx=0).stop 2023-11-20T07:01:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6c00afd90 msgr2=0x7fe6c01545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fe6c6e88640 1 --2- 172.21.15.88:0/1268948149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6c00afd90 0x7fe6c01545f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe6b001a140 tx=0x7fe6b00192b0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fe6c6687640 1 -- 172.21.15.88:0/1268948149 reap_dead start 2023-11-20T07:01:20.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f4940e6b640 1 -- 172.21.15.88:0/2231567004 >> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] conn(0x7f491c06fb30 msgr2=0x7f491c071f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f15d37fe640 1 -- 172.21.15.88:0/3062695573 >> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] conn(0x7f15d406fb30 msgr2=0x7f15d4071f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f15d37fe640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] conn(0x7f15d406fb30 0x7f15d4071f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f4940e6b640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] conn(0x7f491c06fb30 0x7f491c071f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f15d37fe640 1 -- 172.21.15.88:0/3062695573 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f15d40664f0 msgr2=0x7f15d40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f15d37fe640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f15d40664f0 0x7f15d40689b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f15dc006fd0 tx=0x7f15dc008040 comp rx=0 tx=0).stop 2023-11-20T07:01:20.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f15d37fe640 1 -- 172.21.15.88:0/3062695573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e80e2d90 msgr2=0x7f15e804bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f15d37fe640 1 --2- 172.21.15.88:0/3062695573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15e80e2d90 0x7f15e804bdb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15f0063a60 tx=0x7f15f0095bb0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f15f5036640 1 -- 172.21.15.88:0/3062695573 reap_dead start 2023-11-20T07:01:20.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f15d37fe640 1 -- 172.21.15.88:0/3062695573 shutdown_connections 2023-11-20T07:01:20.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f15d37fe640 1 -- 172.21.15.88:0/3062695573 >> 172.21.15.88:0/3062695573 conn(0x7f15e8054ce0 msgr2=0x7f15e80e1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 shutdown_connections 2023-11-20T07:01:20.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 >> 172.21.15.88:0/1268948149 conn(0x7fe6c00cad90 msgr2=0x7fe6c01587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f15d37fe640 1 -- 172.21.15.88:0/3062695573 shutdown_connections 2023-11-20T07:01:20.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 shutdown_connections 2023-11-20T07:01:20.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f15d37fe640 1 -- 172.21.15.88:0/3062695573 wait complete. 2023-11-20T07:01:20.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fe6c6e88640 1 -- 172.21.15.88:0/1268948149 wait complete. 2023-11-20T07:01:20.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f4940e6b640 1 -- 172.21.15.88:0/2231567004 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f491c0664f0 msgr2=0x7f491c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f4940e6b640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f491c0664f0 0x7f491c0689b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f493401aff0 tx=0x7f49340a7070 comp rx=0 tx=0).stop 2023-11-20T07:01:20.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f4940e6b640 1 -- 172.21.15.88:0/2231567004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f493c164520 msgr2=0x7f493c161fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f4940e6b640 1 --2- 172.21.15.88:0/2231567004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f493c164520 0x7f493c161fc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f492c00e590 tx=0x7f492c00ea50 comp rx=0 tx=0).stop 2023-11-20T07:01:20.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f493ad9d640 1 -- 172.21.15.88:0/2231567004 reap_dead start 2023-11-20T07:01:20.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f4940e6b640 1 -- 172.21.15.88:0/2231567004 shutdown_connections 2023-11-20T07:01:20.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f4940e6b640 1 -- 172.21.15.88:0/2231567004 >> 172.21.15.88:0/2231567004 conn(0x7f493c06c190 msgr2=0x7f493c0af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fd1873a3640 1 -- 172.21.15.88:0/3780493493 shutdown_connections 2023-11-20T07:01:20.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7fd1873a3640 1 -- 172.21.15.88:0/3780493493 wait complete. 2023-11-20T07:01:20.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f4940e6b640 1 -- 172.21.15.88:0/2231567004 shutdown_connections 2023-11-20T07:01:20.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.362+0000 7f4940e6b640 1 -- 172.21.15.88:0/2231567004 wait complete. 2023-11-20T07:01:20.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.366+0000 7f3d767fc640 1 -- 172.21.15.88:0/1845870427 --> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d9004e9c0 con 0x7f3d7c06fac0 2023-11-20T07:01:20.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.374+0000 7f3d8cff9640 1 -- 172.21.15.88:0/1845870427 <== osd.3 v2:172.21.15.88:6816/1570500 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d9004e9c0 con 0x7f3d7c06fac0 2023-11-20T07:01:20.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.374+0000 7f3d767fc640 1 -- 172.21.15.88:0/1845870427 >> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] conn(0x7f3d7c06fac0 msgr2=0x7f3d7c071f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.374+0000 7f3d767fc640 1 --2- 172.21.15.88:0/1845870427 >> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] conn(0x7f3d7c06fac0 0x7f3d7c071f00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.374+0000 7f3d767fc640 1 -- 172.21.15.88:0/1845870427 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3d7c066500 msgr2=0x7f3d7c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.374+0000 7f3d767fc640 1 --2- 172.21.15.88:0/1845870427 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3d7c066500 0x7f3d7c0689c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3d840af000 tx=0x7f3d840a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:20.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.374+0000 7f3d767fc640 1 -- 172.21.15.88:0/1845870427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d90160f30 msgr2=0x7f3d90201750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.374+0000 7f3d767fc640 1 --2- 172.21.15.88:0/1845870427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d90160f30 0x7f3d90201750 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000b3c0 tx=0x7f3d8000b880 comp rx=0 tx=0).stop 2023-11-20T07:01:20.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.374+0000 7f3d94805640 1 -- 172.21.15.88:0/1845870427 reap_dead start 2023-11-20T07:01:20.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.374+0000 7f3d767fc640 1 -- 172.21.15.88:0/1845870427 shutdown_connections 2023-11-20T07:01:20.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.374+0000 7f3d767fc640 1 -- 172.21.15.88:0/1845870427 >> 172.21.15.88:0/1845870427 conn(0x7f3d900cad90 msgr2=0x7f3d900ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.374+0000 7fc0d210f640 1 -- 172.21.15.88:0/974868578 --> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc0cc0cbd50 con 0x7fc0b806fa10 2023-11-20T07:01:20.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.374+0000 7fc0b3fff640 1 -- 172.21.15.88:0/974868578 <== osd.7 v2:172.21.15.175:6808/205055633 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc0c40b5040 con 0x7fc0b806fa10 2023-11-20T07:01:20.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7f3d767fc640 1 -- 172.21.15.88:0/1845870427 shutdown_connections 2023-11-20T07:01:20.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7f3d767fc640 1 -- 172.21.15.88:0/1845870427 wait complete. 2023-11-20T07:01:20.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7f7170ff9640 1 -- 172.21.15.88:0/2774499516 --> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7164002cc0 con 0x7f716006fbb0 2023-11-20T07:01:20.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7fc0d210f640 1 -- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] conn(0x7fc0b806fa10 msgr2=0x7fc0b8071e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7fc0d210f640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] conn(0x7fc0b806fa10 0x7fc0b8071e50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7f7172ffd640 1 -- 172.21.15.88:0/2774499516 <== osd.5 v2:172.21.15.175:6810/2498780564 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7164002cc0 con 0x7f716006fbb0 2023-11-20T07:01:20.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7fc0d210f640 1 -- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0b80664d0 msgr2=0x7fc0b8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7fc0d210f640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0b80664d0 0x7fc0b8068990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc063a60 tx=0x7fc0c0008040 comp rx=0 tx=0).stop 2023-11-20T07:01:20.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7fc0d210f640 1 -- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0cc1599c0 msgr2=0x7fc0cc159e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7fc0d210f640 1 --2- 172.21.15.88:0/974868578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0cc1599c0 0x7fc0cc159e70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc004880 tx=0x7fc0bc008430 comp rx=0 tx=0).stop 2023-11-20T07:01:20.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7fc0cbfff640 1 -- 172.21.15.88:0/974868578 reap_dead start 2023-11-20T07:01:20.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7f7184594640 1 -- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] conn(0x7f716006fbb0 msgr2=0x7f7160071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7f7184594640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] conn(0x7f716006fbb0 0x7f7160071ff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7f7184594640 1 -- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7160066570 msgr2=0x7f7160068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7f7184594640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7160066570 0x7f7160068a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f717c0ccac0 tx=0x7f7178001bf0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7f7184594640 1 -- 172.21.15.88:0/2774499516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71680052b0 msgr2=0x7f717c0c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7f7184594640 1 --2- 172.21.15.88:0/2774499516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71680052b0 0x7f717c0c7830 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f716c00c480 tx=0x7f716c00c940 comp rx=0 tx=0).stop 2023-11-20T07:01:20.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7f7182b31640 1 -- 172.21.15.88:0/2774499516 reap_dead start 2023-11-20T07:01:20.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7fc0d210f640 1 -- 172.21.15.88:0/974868578 shutdown_connections 2023-11-20T07:01:20.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7fc0d210f640 1 -- 172.21.15.88:0/974868578 >> 172.21.15.88:0/974868578 conn(0x7fc0cc06c190 msgr2=0x7fc0cc15df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7fc0d210f640 1 -- 172.21.15.88:0/974868578 shutdown_connections 2023-11-20T07:01:20.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7fc0d210f640 1 -- 172.21.15.88:0/974868578 wait complete. 2023-11-20T07:01:20.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.378+0000 7f7184594640 1 -- 172.21.15.88:0/2774499516 shutdown_connections 2023-11-20T07:01:20.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.382+0000 7f7184594640 1 -- 172.21.15.88:0/2774499516 >> 172.21.15.88:0/2774499516 conn(0x7f717c0b4470 msgr2=0x7f717c159820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb9391d640 1 -- 172.21.15.88:0/937807620 --> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb6c002cc0 con 0x7fcb7006fae0 2023-11-20T07:01:20.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7f7184594640 1 -- 172.21.15.88:0/2774499516 shutdown_connections 2023-11-20T07:01:20.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7f7184594640 1 -- 172.21.15.88:0/2774499516 wait complete. 2023-11-20T07:01:20.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb81ffb640 1 -- 172.21.15.88:0/937807620 <== osd.6 v2:172.21.15.175:6822/3652084907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb6c002cc0 con 0x7fcb7006fae0 2023-11-20T07:01:20.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb9391d640 1 -- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] conn(0x7fcb7006fae0 msgr2=0x7fcb70071f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb9391d640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] conn(0x7fcb7006fae0 0x7fcb70071f20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb9391d640 1 -- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcb700664a0 msgr2=0x7fcb70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb9391d640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcb700664a0 0x7fcb70068960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0ad6c0 tx=0x7fcb88008040 comp rx=0 tx=0).stop 2023-11-20T07:01:20.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb9391d640 1 -- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c0ccec0 msgr2=0x7fcb8c158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb9391d640 1 --2- 172.21.15.88:0/937807620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb8c0ccec0 0x7fcb8c158e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0ac000 tx=0x7fcb7c01ad60 comp rx=0 tx=0).stop 2023-11-20T07:01:20.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb91eba640 1 -- 172.21.15.88:0/937807620 reap_dead start 2023-11-20T07:01:20.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb9391d640 1 -- 172.21.15.88:0/937807620 shutdown_connections 2023-11-20T07:01:20.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb9391d640 1 -- 172.21.15.88:0/937807620 >> 172.21.15.88:0/937807620 conn(0x7fcb8c06c190 msgr2=0x7fcb8c0ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb9391d640 1 -- 172.21.15.88:0/937807620 shutdown_connections 2023-11-20T07:01:20.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.386+0000 7fcb9391d640 1 -- 172.21.15.88:0/937807620 wait complete. 2023-11-20T07:01:20.419 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-11-20T07:01:20.420 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-20T07:01:20.421 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-11-20T07:01:20.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-20T07:01:20.422 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-11-20T07:01:20.422 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-20T07:01:20.423 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-11-20T07:01:20.423 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-20T07:01:20.424 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-11-20T07:01:20.424 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-20T07:01:20.425 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-11-20T07:01:20.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-20T07:01:20.426 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-11-20T07:01:20.426 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-20T07:01:20.427 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2023-11-20T07:01:20.428 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-20T07:01:20.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.710+0000 7f1201eea640 1 Processor -- start 2023-11-20T07:01:20.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.710+0000 7f1201eea640 1 -- start start 2023-11-20T07:01:20.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7fbce3e9e640 1 Processor -- start 2023-11-20T07:01:20.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7fbce3e9e640 1 -- start start 2023-11-20T07:01:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7f1201eea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f11fc0c1540 0x7f11fc0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7f1201eea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11fc0b0620 0x7f11fc0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7f1201eea640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc0ad9b0 con 0x7f11fc160ec0 2023-11-20T07:01:20.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7f1201eea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc0b0ad0 con 0x7f11fc0c1540 2023-11-20T07:01:20.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7f1201eea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0adc90 con 0x7f11fc0b0620 2023-11-20T07:01:20.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7f11fb7fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f11fc160ec0 0x7f11fc0cb8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:49128/0 (socket says 172.21.15.88:49128) 2023-11-20T07:01:20.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7f11fb7fe640 1 -- 172.21.15.88:0/3006662087 learned_addr learned my addr 172.21.15.88:0/3006662087 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:20.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7f11faffd640 1 --2- 172.21.15.88:0/3006662087 >> v2:172.21.15.88:3300/0 conn(0x7f11fc0c1540 0x7f11fc0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7f11fa7fc640 1 -- 172.21.15.88:0/3006662087 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963817271 0 0) 0x7f11fc0ad9b0 con 0x7f11fc160ec0 2023-11-20T07:01:20.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7f11fa7fc640 1 -- 172.21.15.88:0/3006662087 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11e4003530 con 0x7f11fc160ec0 2023-11-20T07:01:20.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7fbce3e9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcdc15cb90 0x7fbcdc0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7fbce3e9e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbcdc0d3010 0x7fbcdc0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7fbce3e9e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcdc0ce770 con 0x7fbcdc0d1400 2023-11-20T07:01:20.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7fbce3e9e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcdc0d1890 con 0x7fbcdc0d3010 2023-11-20T07:01:20.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.714+0000 7fbce3e9e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc0d0600 con 0x7fbcdc15cb90 2023-11-20T07:01:20.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7f11fbfff640 1 --2- 172.21.15.88:0/3006662087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11fc0b0620 0x7f11fc0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7fa61e29e640 1 Processor -- start 2023-11-20T07:01:20.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7f11faffd640 1 -- 172.21.15.88:0/3006662087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11fc0b0620 msgr2=0x7f11fc0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7f11fa7fc640 1 -- 172.21.15.88:0/3006662087 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3253373773 0 0) 0x7f11e4003530 con 0x7f11fc160ec0 2023-11-20T07:01:20.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7fbce1439640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbcdc0d3010 0x7fbcdc0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7fbce1439640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbcdc0d3010 0x7fbcdc0d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36130/0 (socket says 172.21.15.88:36130) 2023-11-20T07:01:20.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7fbce1439640 1 -- 172.21.15.88:0/825773357 learned_addr learned my addr 172.21.15.88:0/825773357 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7fa61e29e640 1 -- start start 2023-11-20T07:01:20.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7f11faffd640 1 --2- 172.21.15.88:0/3006662087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11fc0b0620 0x7f11fc0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7f11faffd640 1 -- 172.21.15.88:0/3006662087 >> v1:172.21.15.175:6789/0 conn(0x7f11fc160ec0 legacy=0x7f11fc0cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7f11faffd640 1 -- 172.21.15.88:0/3006662087 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0c97f0 con 0x7f11fc0c1540 2023-11-20T07:01:20.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7f11fbfff640 1 --2- 172.21.15.88:0/3006662087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11fc0b0620 0x7f11fc0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:20.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7fa61e29e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa618158940 0x7fa61815d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7fa61e29e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa6180cb2b0 0x7fa6180c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7fa61e29e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa618070e70 con 0x7fa6180705b0 2023-11-20T07:01:20.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7fbce1439640 1 -- 172.21.15.88:0/825773357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcdc15cb90 msgr2=0x7fbcdc0cfb10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-20T07:01:20.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa61e29e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa618071150 con 0x7fa618158940 2023-11-20T07:01:20.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa61e29e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa618071430 con 0x7fa6180cb2b0 2023-11-20T07:01:20.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa61c83b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa6180cb2b0 0x7fa6180c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7fbce1439640 1 --2- 172.21.15.88:0/825773357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcdc15cb90 0x7fbcdc0cfb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7fbce1439640 1 -- 172.21.15.88:0/825773357 >> v1:172.21.15.175:6789/0 conn(0x7fbcdc0d1400 legacy=0x7fbcdc0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.718+0000 7fbce1439640 1 -- 172.21.15.88:0/825773357 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc0c6450 con 0x7fbcdc0d3010 2023-11-20T07:01:20.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa61c83b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa6180cb2b0 0x7fa6180c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36138/0 (socket says 172.21.15.88:36138) 2023-11-20T07:01:20.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa61c83b640 1 -- 172.21.15.88:0/2002379216 learned_addr learned my addr 172.21.15.88:0/2002379216 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa617fff640 1 --2- 172.21.15.88:0/2002379216 >> v2:172.21.15.88:3300/0 conn(0x7fa618158940 0x7fa61815d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa616ffd640 1 -- 172.21.15.88:0/2002379216 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963936250 0 0) 0x7fa618070e70 con 0x7fa6180705b0 2023-11-20T07:01:20.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7f11faffd640 1 --2- 172.21.15.88:0/3006662087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11fc0c1540 0x7f11fc0b00e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009a20 tx=0x7f11f001cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c3321d59156134 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa616ffd640 1 -- 172.21.15.88:0/2002379216 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa600003530 con 0x7fa6180705b0 2023-11-20T07:01:20.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7f11fa7fc640 1 -- 172.21.15.88:0/3006662087 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec001680 con 0x7f11fc0c1540 2023-11-20T07:01:20.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7f11fa7fc640 1 -- 172.21.15.88:0/3006662087 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f00ac420 con 0x7f11fc0c1540 2023-11-20T07:01:20.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7f11fa7fc640 1 -- 172.21.15.88:0/3006662087 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00ac7b0 con 0x7f11fc0c1540 2023-11-20T07:01:20.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa61c83b640 1 -- 172.21.15.88:0/2002379216 >> v2:172.21.15.88:3300/0 conn(0x7fa618158940 msgr2=0x7fa61815d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa61c83b640 1 --2- 172.21.15.88:0/2002379216 >> v2:172.21.15.88:3300/0 conn(0x7fa618158940 0x7fa61815d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa61c83b640 1 -- 172.21.15.88:0/2002379216 >> v1:172.21.15.175:6789/0 conn(0x7fa6180705b0 legacy=0x7fa6180caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa61c83b640 1 -- 172.21.15.88:0/2002379216 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618071710 con 0x7fa6180cb2b0 2023-11-20T07:01:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.722+0000 7fa617fff640 1 --2- 172.21.15.88:0/2002379216 >> v2:172.21.15.88:3300/0 conn(0x7fa618158940 0x7fa61815d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7fbce1439640 1 --2- 172.21.15.88:0/825773357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcdc0d3010 0x7fbcdc0d0ec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009e50 tx=0x7fbcd401c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47d7f49346953bc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed2f3f640 1 Processor -- start 2023-11-20T07:01:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7fbce0c38640 1 -- 172.21.15.88:0/825773357 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40a57b0 con 0x7fbcdc0d3010 2023-11-20T07:01:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7fbce0c38640 1 -- 172.21.15.88:0/825773357 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd40a5910 con 0x7fbcdc0d3010 2023-11-20T07:01:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7fbce0c38640 1 -- 172.21.15.88:0/825773357 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40a5ca0 con 0x7fbcdc0d3010 2023-11-20T07:01:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f1201eea640 1 -- 172.21.15.88:0/3006662087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11fc0c1540 msgr2=0x7f11fc0b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f1201eea640 1 --2- 172.21.15.88:0/3006662087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11fc0c1540 0x7f11fc0b00e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009a20 tx=0x7f11f001cfd0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed2f3f640 1 -- start start 2023-11-20T07:01:20.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f1201eea640 1 -- 172.21.15.88:0/3006662087 shutdown_connections 2023-11-20T07:01:20.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f1201eea640 1 --2- 172.21.15.88:0/3006662087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11fc0b0620 0x7f11fc0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f1201eea640 1 --2- 172.21.15.88:0/3006662087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11fc0c1540 0x7f11fc0b00e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f1201eea640 1 -- 172.21.15.88:0/3006662087 >> 172.21.15.88:0/3006662087 conn(0x7f11fc06c190 msgr2=0x7f11fc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f8359565640 1 Processor -- start 2023-11-20T07:01:20.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f8359565640 1 -- start start 2023-11-20T07:01:20.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7fbce3e9e640 1 -- 172.21.15.88:0/825773357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcdc0d3010 msgr2=0x7fbcdc0d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7fbce3e9e640 1 --2- 172.21.15.88:0/825773357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcdc0d3010 0x7fbcdc0d0ec0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009e50 tx=0x7fbcd401c930 comp rx=0 tx=0).stop 2023-11-20T07:01:20.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed2f3f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ec40e3200 0x7f0ec4006b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed2f3f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ec4054470 0x7f0ec4057df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed2f3f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec40075d0 con 0x7f0ec403c080 2023-11-20T07:01:20.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed2f3f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec40e35e0 con 0x7f0ec40e3200 2023-11-20T07:01:20.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed2f3f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40078b0 con 0x7f0ec4054470 2023-11-20T07:01:20.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed273e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ec4054470 0x7f0ec4057df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed173c640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0ec403c080 0x7f0ec4053d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:49152/0 (socket says 172.21.15.88:49152) 2023-11-20T07:01:20.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed173c640 1 -- 172.21.15.88:0/4075852569 learned_addr learned my addr 172.21.15.88:0/4075852569 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:20.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7fa61c83b640 1 --2- 172.21.15.88:0/2002379216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6180cb2b0 0x7fa6180c8db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa61806d080 tx=0x7fa61001e9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7741eb6f34b4f44 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f1201eea640 1 -- 172.21.15.88:0/3006662087 shutdown_connections 2023-11-20T07:01:20.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed0f3b640 1 -- 172.21.15.88:0/4075852569 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395161936 0 0) 0x7f0ec40075d0 con 0x7f0ec403c080 2023-11-20T07:01:20.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed0f3b640 1 -- 172.21.15.88:0/4075852569 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb8003530 con 0x7f0ec403c080 2023-11-20T07:01:20.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.726+0000 7f0ed1f3d640 1 --2- 172.21.15.88:0/4075852569 >> v2:172.21.15.88:3300/0 conn(0x7f0ec40e3200 0x7f0ec4006b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fa616ffd640 1 -- 172.21.15.88:0/2002379216 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6100a7ac0 con 0x7fa6180cb2b0 2023-11-20T07:01:20.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fa616ffd640 1 -- 172.21.15.88:0/2002379216 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6100ab070 con 0x7fa6180cb2b0 2023-11-20T07:01:20.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fa616ffd640 1 -- 172.21.15.88:0/2002379216 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6100a7e40 con 0x7fa6180cb2b0 2023-11-20T07:01:20.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f8359565640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f83540cdd90 0x7f83540d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f8359565640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 0x7f83540cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f8359565640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83540ce730 con 0x7f835415cae0 2023-11-20T07:01:20.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f8352ffd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f835415cae0 0x7f83540d3190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:49158/0 (socket says 172.21.15.88:49158) 2023-11-20T07:01:20.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f8352ffd640 1 -- 172.21.15.88:0/343296127 learned_addr learned my addr 172.21.15.88:0/343296127 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:20.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f1201eea640 1 -- 172.21.15.88:0/3006662087 wait complete. 2023-11-20T07:01:20.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f0ed273e640 1 -- 172.21.15.88:0/4075852569 >> v2:172.21.15.88:3300/0 conn(0x7f0ec40e3200 msgr2=0x7f0ec4006b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f0ed273e640 1 --2- 172.21.15.88:0/4075852569 >> v2:172.21.15.88:3300/0 conn(0x7f0ec40e3200 0x7f0ec4006b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f0ed273e640 1 -- 172.21.15.88:0/4075852569 >> v1:172.21.15.175:6789/0 conn(0x7f0ec403c080 legacy=0x7f0ec4053d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f0ed0f3b640 1 -- 172.21.15.88:0/4075852569 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 301141743 0 0) 0x7f0eb8003530 con 0x7f0ec403c080 2023-11-20T07:01:20.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f0ed273e640 1 -- 172.21.15.88:0/4075852569 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec40575f0 con 0x7f0ec4054470 2023-11-20T07:01:20.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f83537fe640 1 --2- 172.21.15.88:0/343296127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 0x7f83540cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fa61e29e640 1 -- 172.21.15.88:0/2002379216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6180cb2b0 msgr2=0x7fa6180c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fa61e29e640 1 --2- 172.21.15.88:0/2002379216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6180cb2b0 0x7fa6180c8db0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa61806d080 tx=0x7fa61001e9d0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fa61e29e640 1 -- 172.21.15.88:0/2002379216 shutdown_connections 2023-11-20T07:01:20.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fa61e29e640 1 --2- 172.21.15.88:0/2002379216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6180cb2b0 0x7fa6180c8db0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fa61e29e640 1 --2- 172.21.15.88:0/2002379216 >> v2:172.21.15.88:3300/0 conn(0x7fa618158940 0x7fa61815d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fa61e29e640 1 -- 172.21.15.88:0/2002379216 >> 172.21.15.88:0/2002379216 conn(0x7fa61806a570 msgr2=0x7fa6180afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f8359565640 1 -- 172.21.15.88:0/343296127 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83540d0ba0 con 0x7f83540cdd90 2023-11-20T07:01:20.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f8359565640 1 -- 172.21.15.88:0/343296127 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83540ce200 con 0x7f83540d1570 2023-11-20T07:01:20.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f8351ffb640 1 -- 172.21.15.88:0/343296127 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254181552 0 0) 0x7f83540ce730 con 0x7f835415cae0 2023-11-20T07:01:20.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f8351ffb640 1 -- 172.21.15.88:0/343296127 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f833c003530 con 0x7f835415cae0 2023-11-20T07:01:20.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fbce3e9e640 1 -- 172.21.15.88:0/825773357 shutdown_connections 2023-11-20T07:01:20.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fbce3e9e640 1 --2- 172.21.15.88:0/825773357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcdc0d3010 0x7fbcdc0d0ec0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fbce3e9e640 1 --2- 172.21.15.88:0/825773357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcdc15cb90 0x7fbcdc0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fbce3e9e640 1 -- 172.21.15.88:0/825773357 >> 172.21.15.88:0/825773357 conn(0x7fbcdc09bc50 msgr2=0x7fbcdc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f83527fc640 1 --2- 172.21.15.88:0/343296127 >> v2:172.21.15.88:3300/0 conn(0x7f83540cdd90 0x7f83540d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f83537fe640 1 -- 172.21.15.88:0/343296127 >> v2:172.21.15.88:3300/0 conn(0x7f83540cdd90 msgr2=0x7f83540d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f83537fe640 1 --2- 172.21.15.88:0/343296127 >> v2:172.21.15.88:3300/0 conn(0x7f83540cdd90 0x7f83540d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f83537fe640 1 -- 172.21.15.88:0/343296127 >> v1:172.21.15.175:6789/0 conn(0x7f835415cae0 legacy=0x7f83540d3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f83537fe640 1 -- 172.21.15.88:0/343296127 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83540ce450 con 0x7f83540d1570 2023-11-20T07:01:20.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fbce3e9e640 1 -- 172.21.15.88:0/825773357 shutdown_connections 2023-11-20T07:01:20.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7fbce3e9e640 1 -- 172.21.15.88:0/825773357 wait complete. 2023-11-20T07:01:20.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f1201eea640 1 Processor -- start 2023-11-20T07:01:20.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.730+0000 7f9f494ea640 1 Processor -- start 2023-11-20T07:01:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f1201eea640 1 -- start start 2023-11-20T07:01:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f9f494ea640 1 -- start start 2023-11-20T07:01:20.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7fa61e29e640 1 -- 172.21.15.88:0/2002379216 shutdown_connections 2023-11-20T07:01:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7fa61e29e640 1 -- 172.21.15.88:0/2002379216 wait complete. 2023-11-20T07:01:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f1201eea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11fc0b0620 0x7f11fc156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f1201eea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11fc0c1540 0x7f11fc0c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f0ed273e640 1 --2- 172.21.15.88:0/4075852569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ec4054470 0x7f0ec4057df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000b70 tx=0x7f0ecc098cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daf659abdb1c60cf server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f1201eea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11fc160ec0 0x7f11fc0c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7fbce3e9e640 1 Processor -- start 2023-11-20T07:01:20.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f1201eea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0b2df0 con 0x7f11fc0c1540 2023-11-20T07:01:20.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f1201eea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0b21e0 con 0x7f11fc160ec0 2023-11-20T07:01:20.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f1201eea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0b24c0 con 0x7f11fc0b0620 2023-11-20T07:01:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f9f494ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f440c9d00 0x7f9f440712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f9f494ea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4415d210 con 0x7f9f440c9920 2023-11-20T07:01:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f9f494ea640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4415d4f0 con 0x7f9f4406ccb0 2023-11-20T07:01:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f9f494ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44070af0 con 0x7f9f440c9d00 2023-11-20T07:01:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f11fbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11fc160ec0 0x7f11fc0c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f11fbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11fc160ec0 0x7f11fc0c6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36140/0 (socket says 172.21.15.88:36140) 2023-11-20T07:01:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f11fbfff640 1 -- 172.21.15.88:0/956906024 learned_addr learned my addr 172.21.15.88:0/956906024 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f11faffd640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11fc0c1540 0x7f11fc0c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f9f42ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9f440c9920 0x7f9f4415c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52514/0 (socket says 172.21.15.88:52514) 2023-11-20T07:01:20.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f9f42ffd640 1 -- 172.21.15.88:0/96825098 learned_addr learned my addr 172.21.15.88:0/96825098 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:20.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f9f437fe640 1 --2- 172.21.15.88:0/96825098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f440c9d00 0x7f9f440712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f0ed0f3b640 1 -- 172.21.15.88:0/4075852569 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0016a0 con 0x7f0ec4054470 2023-11-20T07:01:20.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f0ed0f3b640 1 -- 172.21.15.88:0/4075852569 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc122780 con 0x7f0ec4054470 2023-11-20T07:01:20.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f0ed0f3b640 1 -- 172.21.15.88:0/4075852569 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc072040 con 0x7f0ec4054470 2023-11-20T07:01:20.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f11faffd640 1 -- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11fc0b0620 msgr2=0x7f11fc156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f11fb7fe640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11fc0b0620 0x7f11fc156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f2a1b246640 1 Processor -- start 2023-11-20T07:01:20.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7fbce3e9e640 1 -- start start 2023-11-20T07:01:20.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7fbce3e9e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcdc0d1400 0x7fbcdc153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7fbce3e9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcdc0d3010 0x7fbcdc0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7fa61e29e640 1 Processor -- start 2023-11-20T07:01:20.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f11faffd640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11fc0b0620 0x7f11fc156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f11faffd640 1 -- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11fc160ec0 msgr2=0x7f11fc0c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f11faffd640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11fc160ec0 0x7f11fc0c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f11faffd640 1 -- 172.21.15.88:0/956906024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f0009420 con 0x7f11fc0c1540 2023-11-20T07:01:20.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f83537fe640 1 --2- 172.21.15.88:0/343296127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 0x7f83540cf020 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f834c009d90 tx=0x7f834c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26222770000e60ca server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7fbce3e9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcdc15cb90 0x7fbcdc14b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7fbce3e9e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc0c9f10 con 0x7fbcdc0d3010 2023-11-20T07:01:20.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7fbce3e9e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc159ea0 con 0x7fbcdc0d1400 2023-11-20T07:01:20.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7fbce3e9e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc0ca120 con 0x7fbcdc15cb90 2023-11-20T07:01:20.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f11fb7fe640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11fc0b0620 0x7f11fc156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:20.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f9f427fc640 1 -- 172.21.15.88:0/96825098 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770204534 0 0) 0x7f9f4415d210 con 0x7f9f440c9920 2023-11-20T07:01:20.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f9f427fc640 1 -- 172.21.15.88:0/96825098 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f30003530 con 0x7f9f440c9920 2023-11-20T07:01:20.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.734+0000 7f2a1b246640 1 -- start start 2023-11-20T07:01:20.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f8351ffb640 1 -- 172.21.15.88:0/343296127 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0a58f0 con 0x7f83540d1570 2023-11-20T07:01:20.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f8351ffb640 1 -- 172.21.15.88:0/343296127 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c0a5a50 con 0x7f83540d1570 2023-11-20T07:01:20.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f8351ffb640 1 -- 172.21.15.88:0/343296127 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0a5de0 con 0x7f83540d1570 2023-11-20T07:01:20.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa61e29e640 1 -- start start 2023-11-20T07:01:20.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f9f437fe640 1 -- 172.21.15.88:0/96825098 >> v1:172.21.15.175:6789/0 conn(0x7f9f4406ccb0 legacy=0x7f9f440cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f9f437fe640 1 -- 172.21.15.88:0/96825098 >> v1:172.21.15.88:6789/0 conn(0x7f9f440c9920 legacy=0x7f9f4415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f9f437fe640 1 -- 172.21.15.88:0/96825098 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f44070dd0 con 0x7f9f440c9d00 2023-11-20T07:01:20.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f7ab949c640 1 Processor -- start 2023-11-20T07:01:20.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f8359565640 1 -- 172.21.15.88:0/343296127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 msgr2=0x7f83540cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f8359565640 1 --2- 172.21.15.88:0/343296127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 0x7f83540cf020 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f834c009d90 tx=0x7f834c01c920 comp rx=0 tx=0).stop 2023-11-20T07:01:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fbce1c3a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcdc0d1400 0x7fbcdc153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fbce243b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcdc15cb90 0x7fbcdc14b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fbce243b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcdc15cb90 0x7fbcdc14b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38482/0 (socket says 172.21.15.88:38482) 2023-11-20T07:01:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fbce243b640 1 -- 172.21.15.88:0/3410676 learned_addr learned my addr 172.21.15.88:0/3410676 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f11faffd640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11fc0c1540 0x7f11fc0c1dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f11f00ac000 tx=0x7f11f0019310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f7ab949c640 1 -- start start 2023-11-20T07:01:20.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a1b246640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2a140ad960 0x7f2a140ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a1b246640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a140b07f0 0x7f2a140cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a1b246640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a140c96f0 con 0x7f2a14164520 2023-11-20T07:01:20.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a1b246640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a14164900 con 0x7f2a140ad960 2023-11-20T07:01:20.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a1b246640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a140cb950 con 0x7f2a140b07f0 2023-11-20T07:01:20.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a18fe2640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2a14164520 0x7f2a140b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52530/0 (socket says 172.21.15.88:52530) 2023-11-20T07:01:20.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a18fe2640 1 -- 172.21.15.88:0/3912853220 learned_addr learned my addr 172.21.15.88:0/3912853220 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a13fff640 1 --2- 172.21.15.88:0/3912853220 >> v2:172.21.15.88:3300/0 conn(0x7f2a140ad960 0x7f2a140ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fbce1439640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcdc0d3010 0x7fbcdc0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a197e3640 1 --2- 172.21.15.88:0/3912853220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a140b07f0 0x7f2a140cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/4075852569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ec4054470 msgr2=0x7f0ec4057df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f0ed2f3f640 1 --2- 172.21.15.88:0/4075852569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ec4054470 0x7f0ec4057df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000b70 tx=0x7f0ecc098cd0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa61e29e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6180705b0 0x7fa618151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a13fff640 1 -- 172.21.15.88:0/3912853220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a140b07f0 msgr2=0x7f2a140cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fbce243b640 1 -- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcdc0d1400 msgr2=0x7fbcdc153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fbce243b640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcdc0d1400 0x7fbcdc153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fbce243b640 1 -- 172.21.15.88:0/3410676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcdc0d3010 msgr2=0x7fbcdc0c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fbce243b640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcdc0d3010 0x7fbcdc0c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fbce243b640 1 -- 172.21.15.88:0/3410676 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd4009b30 con 0x7fbcdc15cb90 2023-11-20T07:01:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa61e29e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6180cb2b0 0x7fa61814fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa61e29e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa618158940 0x7fa6180af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa61e29e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180afd20 con 0x7fa618158940 2023-11-20T07:01:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa61e29e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61814f840 con 0x7fa6180cb2b0 2023-11-20T07:01:20.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa61e29e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61814bc00 con 0x7fa6180705b0 2023-11-20T07:01:20.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa61c83b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa618158940 0x7fa6180af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa6177fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6180cb2b0 0x7fa61814fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa61c83b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa618158940 0x7fa6180af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54106/0 (socket says 172.21.15.88:54106) 2023-11-20T07:01:20.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa61c83b640 1 -- 172.21.15.88:0/704886168 learned_addr learned my addr 172.21.15.88:0/704886168 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f11e3fff640 1 -- 172.21.15.88:0/956906024 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00b5400 con 0x7f11fc0c1540 2023-11-20T07:01:20.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f1201eea640 1 -- 172.21.15.88:0/956906024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11fc0b27a0 con 0x7f11fc0c1540 2023-11-20T07:01:20.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f1201eea640 1 -- 172.21.15.88:0/956906024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc156780 con 0x7f11fc0c1540 2023-11-20T07:01:20.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f11e3fff640 1 -- 172.21.15.88:0/956906024 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f00b5560 con 0x7f11fc0c1540 2023-11-20T07:01:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a13fff640 1 --2- 172.21.15.88:0/3912853220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a140b07f0 0x7f2a140cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a13fff640 1 -- 172.21.15.88:0/3912853220 >> v1:172.21.15.88:6789/0 conn(0x7f2a14164520 legacy=0x7f2a140b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a13fff640 1 -- 172.21.15.88:0/3912853220 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a140cbed0 con 0x7f2a140ad960 2023-11-20T07:01:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f2a197e3640 1 --2- 172.21.15.88:0/3912853220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a140b07f0 0x7f2a140cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/4075852569 shutdown_connections 2023-11-20T07:01:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f0ed2f3f640 1 --2- 172.21.15.88:0/4075852569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ec4054470 0x7f0ec4057df0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f0ed2f3f640 1 --2- 172.21.15.88:0/4075852569 >> v2:172.21.15.88:3300/0 conn(0x7f0ec40e3200 0x7f0ec4006b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/4075852569 >> 172.21.15.88:0/4075852569 conn(0x7f0ec4055aa0 msgr2=0x7f0ec4055eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa6177fe640 1 -- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6180705b0 msgr2=0x7fa618151620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-20T07:01:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa6177fe640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6180705b0 0x7fa618151620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa6177fe640 1 -- 172.21.15.88:0/704886168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa618158940 msgr2=0x7fa6180af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f7ab949c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40cc660 0x7f7ab40cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f7ab949c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7ab40cb2d0 0x7f7ab40707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f7ab949c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40c8f30 con 0x7f7ab40c1510 2023-11-20T07:01:20.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f7ab949c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab40cb740 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f7ab949c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40c18f0 con 0x7f7ab40cc660 2023-11-20T07:01:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa6177fe640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa618158940 0x7fa6180af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa6177fe640 1 -- 172.21.15.88:0/704886168 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa608009a70 con 0x7fa6180cb2b0 2023-11-20T07:01:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7fa61c83b640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa618158940 0x7fa6180af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:20.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.738+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/4075852569 shutdown_connections 2023-11-20T07:01:20.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f7ab2ffd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7ab40c1510 0x7f7ab40cbf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:49174/0 (socket says 172.21.15.88:49174) 2023-11-20T07:01:20.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f7ab2ffd640 1 -- 172.21.15.88:0/3344975388 learned_addr learned my addr 172.21.15.88:0/3344975388 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:20.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f7ab37fe640 1 --2- 172.21.15.88:0/3344975388 >> v2:172.21.15.175:3300/0 conn(0x7f7ab40cb2d0 0x7f7ab40707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f11e3fff640 1 -- 172.21.15.88:0/956906024 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00b5400 con 0x7f11fc0c1540 2023-11-20T07:01:20.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f7ab27fc640 1 --2- 172.21.15.88:0/3344975388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40cc660 0x7f7ab40cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7fbce1c3a640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcdc0d1400 0x7fbcdc153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:20.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f8359565640 1 -- 172.21.15.88:0/343296127 shutdown_connections 2023-11-20T07:01:20.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f8359565640 1 --2- 172.21.15.88:0/343296127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 0x7f83540cf020 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f8359565640 1 --2- 172.21.15.88:0/343296127 >> v2:172.21.15.88:3300/0 conn(0x7f83540cdd90 0x7f83540d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f8359565640 1 -- 172.21.15.88:0/343296127 >> 172.21.15.88:0/343296127 conn(0x7f835409bb50 msgr2=0x7f83540d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7fa6177fe640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6180cb2b0 0x7fa61814fc60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa60c00c4c0 tx=0x7fa60c00c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7fbce1439640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcdc0d3010 0x7fbcdc0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:20.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7fa614ff9640 1 -- 172.21.15.88:0/704886168 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c005480 con 0x7fa6180cb2b0 2023-11-20T07:01:20.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f1201eea640 1 -- 172.21.15.88:0/956906024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc005260 con 0x7f11fc0c1540 2023-11-20T07:01:20.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7fa614ff9640 1 -- 172.21.15.88:0/704886168 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c003600 con 0x7fa6180cb2b0 2023-11-20T07:01:20.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7fa614ff9640 1 -- 172.21.15.88:0/704886168 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0039b0 con 0x7fa6180cb2b0 2023-11-20T07:01:20.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f7ab1ffb640 1 -- 172.21.15.88:0/3344975388 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831331928 0 0) 0x7f7ab40c8f30 con 0x7f7ab40c1510 2023-11-20T07:01:20.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f7ab1ffb640 1 -- 172.21.15.88:0/3344975388 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a9c003530 con 0x7f7ab40c1510 2023-11-20T07:01:20.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/4075852569 wait complete. 2023-11-20T07:01:20.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f8359565640 1 -- 172.21.15.88:0/343296127 shutdown_connections 2023-11-20T07:01:20.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f7ab37fe640 1 -- 172.21.15.88:0/3344975388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40cc660 msgr2=0x7f7ab40cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:20.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f7ab37fe640 1 --2- 172.21.15.88:0/3344975388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40cc660 0x7f7ab40cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f7ab37fe640 1 -- 172.21.15.88:0/3344975388 >> v1:172.21.15.175:6789/0 conn(0x7f7ab40c1510 legacy=0x7f7ab40cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f7ab37fe640 1 -- 172.21.15.88:0/3344975388 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab4070360 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f8359565640 1 -- 172.21.15.88:0/343296127 wait complete. 2023-11-20T07:01:20.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7fbce243b640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcdc15cb90 0x7fbcdc14b960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800b410 tx=0x7fbcd800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7fbcd27fc640 1 -- 172.21.15.88:0/3410676 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8004020 con 0x7fbcdc15cb90 2023-11-20T07:01:20.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7fbcd27fc640 1 -- 172.21.15.88:0/3410676 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd80041a0 con 0x7fbcdc15cb90 2023-11-20T07:01:20.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7fbcd27fc640 1 -- 172.21.15.88:0/3410676 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8011630 con 0x7fbcdc15cb90 2023-11-20T07:01:20.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7fa61e29e640 1 -- 172.21.15.88:0/704886168 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa610008550 con 0x7fa6180cb2b0 2023-11-20T07:01:20.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f8359565640 1 Processor -- start 2023-11-20T07:01:20.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7fbce3e9e640 1 -- 172.21.15.88:0/3410676 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcdc15a0f0 con 0x7fbcdc15cb90 2023-11-20T07:01:20.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7fa61e29e640 1 -- 172.21.15.88:0/704886168 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6180afaf0 con 0x7fa6180cb2b0 2023-11-20T07:01:20.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f11e3fff640 1 -- 172.21.15.88:0/956906024 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f11f00b3040 con 0x7f11fc0c1540 2023-11-20T07:01:20.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f0ed2f3f640 1 Processor -- start 2023-11-20T07:01:20.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7fbce3e9e640 1 -- 172.21.15.88:0/3410676 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcdc15a6b0 con 0x7fbcdc15cb90 2023-11-20T07:01:20.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f11e3fff640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f11e8066560 0x7f11e8068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f11e3fff640 1 -- 172.21.15.88:0/956906024 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f11f011da60 con 0x7f11fc0c1540 2023-11-20T07:01:20.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.742+0000 7f8359565640 1 -- start start 2023-11-20T07:01:20.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f2a13fff640 1 --2- 172.21.15.88:0/3912853220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a140ad960 0x7f2a140ce010 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2a080097c0 tx=0x7f2a0801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe626f8fe7cea2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f2a137fe640 1 -- 172.21.15.88:0/3912853220 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080ab600 con 0x7f2a140ad960 2023-11-20T07:01:20.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f7ab37fe640 1 --2- 172.21.15.88:0/3344975388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab40cb2d0 0x7f7ab40707f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009d90 tx=0x7f7aac01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd8aabba3ff9e99e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f8359565640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83540cdd90 0x7f83540b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f2a137fe640 1 -- 172.21.15.88:0/3912853220 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a080a7050 con 0x7f2a140ad960 2023-11-20T07:01:20.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f2a137fe640 1 -- 172.21.15.88:0/3912853220 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080ab980 con 0x7f2a140ad960 2023-11-20T07:01:20.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f7ab1ffb640 1 -- 172.21.15.88:0/3344975388 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0a5950 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f7ab1ffb640 1 -- 172.21.15.88:0/3344975388 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac0a5ab0 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f7ab1ffb640 1 -- 172.21.15.88:0/3344975388 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0a5e40 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed2f3f640 1 -- start start 2023-11-20T07:01:20.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed2f3f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec403c080 0x7f0ec4050060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed2f3f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ec4054470 0x7f0ec4005eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed2f3f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ec40e3200 0x7f0ec40dc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed2f3f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40e4e50 con 0x7f0ec40e3200 2023-11-20T07:01:20.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed2f3f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40dbb40 con 0x7f0ec403c080 2023-11-20T07:01:20.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed2f3f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40dbe20 con 0x7f0ec4054470 2023-11-20T07:01:20.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f8359565640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 0x7f83540b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f8359565640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f835415cae0 0x7f83540c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f8359565640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83540ca490 con 0x7f83540cdd90 2023-11-20T07:01:20.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f8359565640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83540b6a70 con 0x7f835415cae0 2023-11-20T07:01:20.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f8359565640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83540b6d10 con 0x7f83540d1570 2023-11-20T07:01:20.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f83527fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 0x7f83540b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f83527fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 0x7f83540b77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38516/0 (socket says 172.21.15.88:38516) 2023-11-20T07:01:20.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f83527fc640 1 -- 172.21.15.88:0/2349537864 learned_addr learned my addr 172.21.15.88:0/2349537864 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f83537fe640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f835415cae0 0x7f83540c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f9f437fe640 1 --2- 172.21.15.88:0/96825098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f440c9d00 0x7f9f440712f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009dc0 tx=0x7f9f3c01c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=231254f384c5d029 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f7ab949c640 1 -- 172.21.15.88:0/3344975388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab40cb2d0 msgr2=0x7f7ab40707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f7ab949c640 1 --2- 172.21.15.88:0/3344975388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab40cb2d0 0x7f7ab40707f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009d90 tx=0x7f7aac01c890 comp rx=0 tx=0).stop 2023-11-20T07:01:20.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f8352ffd640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83540cdd90 0x7f83540b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f83527fc640 1 -- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f835415cae0 msgr2=0x7f83540c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f83527fc640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f835415cae0 0x7f83540c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f83527fc640 1 -- 172.21.15.88:0/2349537864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83540cdd90 msgr2=0x7f83540b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f83527fc640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83540cdd90 0x7f83540b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f83527fc640 1 -- 172.21.15.88:0/2349537864 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c009a70 con 0x7f83540d1570 2023-11-20T07:01:20.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f8352ffd640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83540cdd90 0x7f83540b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:20.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f7ab949c640 1 -- 172.21.15.88:0/3344975388 shutdown_connections 2023-11-20T07:01:20.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f7ab949c640 1 --2- 172.21.15.88:0/3344975388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab40cb2d0 0x7f7ab40707f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f7ab949c640 1 --2- 172.21.15.88:0/3344975388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40cc660 0x7f7ab40cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f7ab949c640 1 -- 172.21.15.88:0/3344975388 >> 172.21.15.88:0/3344975388 conn(0x7f7ab406a570 msgr2=0x7f7ab40afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f2a1b246640 1 -- 172.21.15.88:0/3912853220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a140ad960 msgr2=0x7f2a140ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f2a1b246640 1 --2- 172.21.15.88:0/3912853220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a140ad960 0x7f2a140ce010 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2a080097c0 tx=0x7f2a0801c2e0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f11fb7fe640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f11e8066560 0x7f11e8068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f7ab949c640 1 -- 172.21.15.88:0/3344975388 shutdown_connections 2023-11-20T07:01:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f7ab949c640 1 -- 172.21.15.88:0/3344975388 wait complete. 2023-11-20T07:01:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f2a1b246640 1 -- 172.21.15.88:0/3912853220 shutdown_connections 2023-11-20T07:01:20.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f2a1b246640 1 --2- 172.21.15.88:0/3912853220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a140b07f0 0x7f2a140cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f2a1b246640 1 --2- 172.21.15.88:0/3912853220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a140ad960 0x7f2a140ce010 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2a080097c0 tx=0x7f2a0801c2e0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f2a1b246640 1 -- 172.21.15.88:0/3912853220 >> 172.21.15.88:0/3912853220 conn(0x7f2a1406c190 msgr2=0x7f2a1406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f83527fc640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 0x7f83540b77f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f834800d830 tx=0x7f834800dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f833b7fe640 1 -- 172.21.15.88:0/2349537864 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834800b6c0 con 0x7f83540d1570 2023-11-20T07:01:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f833b7fe640 1 -- 172.21.15.88:0/2349537864 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834800b820 con 0x7f83540d1570 2023-11-20T07:01:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f833b7fe640 1 -- 172.21.15.88:0/2349537864 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834800bb90 con 0x7f83540d1570 2023-11-20T07:01:20.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f8359565640 1 -- 172.21.15.88:0/2349537864 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83540b6ff0 con 0x7f83540d1570 2023-11-20T07:01:20.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7fbce3e9e640 1 -- 172.21.15.88:0/3410676 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcdc15a8a0 con 0x7fbcdc15cb90 2023-11-20T07:01:20.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed273e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ec40e3200 0x7f0ec40dc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed273e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ec40e3200 0x7f0ec40dc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54124/0 (socket says 172.21.15.88:54124) 2023-11-20T07:01:20.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed273e640 1 -- 172.21.15.88:0/1136048377 learned_addr learned my addr 172.21.15.88:0/1136048377 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed173c640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ec4054470 0x7f0ec4005eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed273e640 1 -- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ec4054470 msgr2=0x7f0ec4005eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed273e640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ec4054470 0x7f0ec4005eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f8359565640 1 -- 172.21.15.88:0/2349537864 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83540cb260 con 0x7f83540d1570 2023-11-20T07:01:20.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed273e640 1 -- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec403c080 msgr2=0x7f0ec4050060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-20T07:01:20.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed273e640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec403c080 0x7f0ec4050060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7f0ed273e640 1 -- 172.21.15.88:0/1136048377 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc04f100 con 0x7f0ec40e3200 2023-11-20T07:01:20.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.746+0000 7fa61e29e640 1 -- 172.21.15.88:0/704886168 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa618073fa0 con 0x7fa6180cb2b0 2023-11-20T07:01:20.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7fa614ff9640 1 -- 172.21.15.88:0/704886168 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa60c003b10 con 0x7fa6180cb2b0 2023-11-20T07:01:20.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f2a1b246640 1 -- 172.21.15.88:0/3912853220 shutdown_connections 2023-11-20T07:01:20.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7fbcd27fc640 1 -- 172.21.15.88:0/3410676 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbcd8011790 con 0x7fbcdc15cb90 2023-11-20T07:01:20.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f8359565640 1 -- 172.21.15.88:0/2349537864 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83540b7510 con 0x7f83540d1570 2023-11-20T07:01:20.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7fa614ff9640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa6040664f0 0x7fa6040689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7fa614ff9640 1 -- 172.21.15.88:0/704886168 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa60c083640 con 0x7fa6180cb2b0 2023-11-20T07:01:20.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7fbcd27fc640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbcc00664a0 0x7fbcc0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f11fb7fe640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f11e8066560 0x7f11e8068a20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f11ec001390 tx=0x7f11ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f9f427fc640 1 -- 172.21.15.88:0/96825098 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0a5990 con 0x7f9f440c9d00 2023-11-20T07:01:20.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f9f427fc640 1 -- 172.21.15.88:0/96825098 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c0a5af0 con 0x7f9f440c9d00 2023-11-20T07:01:20.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f9f427fc640 1 -- 172.21.15.88:0/96825098 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0a5e80 con 0x7f9f440c9d00 2023-11-20T07:01:20.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f7ab949c640 1 Processor -- start 2023-11-20T07:01:20.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f2a1b246640 1 -- 172.21.15.88:0/3912853220 wait complete. 2023-11-20T07:01:20.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f2a1b246640 1 Processor -- start 2023-11-20T07:01:20.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7fa617fff640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa6040664f0 0x7fa6040689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f7ab949c640 1 -- start start 2023-11-20T07:01:20.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f2a1b246640 1 -- start start 2023-11-20T07:01:20.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7fbce1c3a640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbcc00664a0 0x7fbcc0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7fbcd27fc640 1 -- 172.21.15.88:0/3410676 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbcd8083e50 con 0x7fbcdc15cb90 2023-11-20T07:01:20.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f833b7fe640 1 -- 172.21.15.88:0/2349537864 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f834801e460 con 0x7f83540d1570 2023-11-20T07:01:20.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7fa617fff640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa6040664f0 0x7fa6040689b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa60800e330 tx=0x7fa60800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f9f494ea640 1 -- 172.21.15.88:0/96825098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f440c9d00 msgr2=0x7f9f440712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f9f494ea640 1 --2- 172.21.15.88:0/96825098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f440c9d00 0x7f9f440712f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009dc0 tx=0x7f9f3c01c910 comp rx=0 tx=0).stop 2023-11-20T07:01:20.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f0ed273e640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ec40e3200 0x7f0ec40dc3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc073810 tx=0x7f0ecc095b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7fbce1c3a640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbcc00664a0 0x7fbcc0068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbccc006fd0 tx=0x7fbccc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f9f494ea640 1 -- 172.21.15.88:0/96825098 shutdown_connections 2023-11-20T07:01:20.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f9f494ea640 1 --2- 172.21.15.88:0/96825098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f440c9d00 0x7f9f440712f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f9f494ea640 1 -- 172.21.15.88:0/96825098 >> 172.21.15.88:0/96825098 conn(0x7f9f4406c190 msgr2=0x7f9f4406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:20.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.750+0000 7f9f494ea640 1 -- 172.21.15.88:0/96825098 shutdown_connections 2023-11-20T07:01:20.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f9f494ea640 1 -- 172.21.15.88:0/96825098 wait complete. 2023-11-20T07:01:20.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab949c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40c1510 0x7f7ab40c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab949c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab40cb2d0 0x7f7ab40c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab949c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab40cc660 0x7f7ab415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f833b7fe640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f83400664a0 0x7f8340068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a1b246640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a140b07f0 0x7f2a140c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a1b246640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a14164520 0x7f2a1415f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab2ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40c1510 0x7f7ab40c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a1b246640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a1415f970 0x7f2a1415bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab2ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40c1510 0x7f7ab40c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38528/0 (socket says 172.21.15.88:38528) 2023-11-20T07:01:20.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab40cc660 0x7f7ab415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab40cc660 0x7f7ab415a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54126/0 (socket says 172.21.15.88:54126) 2023-11-20T07:01:20.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a18fe2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a140b07f0 0x7f2a140c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f8352ffd640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f83400664a0 0x7f8340068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a1b246640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a141620b0 con 0x7f2a1415f970 2023-11-20T07:01:20.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a18fe2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a140b07f0 0x7f2a140c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36202/0 (socket says 172.21.15.88:36202) 2023-11-20T07:01:20.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a18fe2640 1 -- 172.21.15.88:0/3721926894 learned_addr learned my addr 172.21.15.88:0/3721926894 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab27fc640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab40cb2d0 0x7f7ab40c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab2ffd640 1 -- 172.21.15.88:0/3210400075 learned_addr learned my addr 172.21.15.88:0/3210400075 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab949c640 1 -- 172.21.15.88:0/3210400075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4159c90 con 0x7f7ab40cc660 2023-11-20T07:01:20.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a1b246640 1 -- 172.21.15.88:0/3721926894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1415cd40 con 0x7f2a140b07f0 2023-11-20T07:01:20.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a1b246640 1 -- 172.21.15.88:0/3721926894 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a14161190 con 0x7f2a14164520 2023-11-20T07:01:20.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab949c640 1 -- 172.21.15.88:0/3210400075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4159080 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab949c640 1 -- 172.21.15.88:0/3210400075 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4159360 con 0x7f7ab40c1510 2023-11-20T07:01:20.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a197e3640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a1415f970 0x7f2a1415bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a13fff640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a14164520 0x7f2a1415f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a18fe2640 1 -- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a14164520 msgr2=0x7f2a1415f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a18fe2640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a14164520 0x7f2a1415f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a18fe2640 1 -- 172.21.15.88:0/3721926894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a1415f970 msgr2=0x7f2a1415bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a18fe2640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a1415f970 0x7f2a1415bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a18fe2640 1 -- 172.21.15.88:0/3721926894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08009420 con 0x7f2a140b07f0 2023-11-20T07:01:20.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f8352ffd640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f83400664a0 0x7f8340068960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8344001370 tx=0x7f8344009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f9f494ea640 1 Processor -- start 2023-11-20T07:01:20.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab27fc640 1 -- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40c1510 msgr2=0x7f7ab40c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab27fc640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40c1510 0x7f7ab40c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab27fc640 1 -- 172.21.15.88:0/3210400075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab40cc660 msgr2=0x7f7ab415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab27fc640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab40cc660 0x7f7ab415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab27fc640 1 -- 172.21.15.88:0/3210400075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac009a70 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab37fe640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab40cc660 0x7f7ab415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:20.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f2a18fe2640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a140b07f0 0x7f2a140c3ed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400c780 tx=0x7f2a0400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab27fc640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab40cb2d0 0x7f7ab40c56b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800d5a0 tx=0x7f7aa800da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f833b7fe640 1 -- 172.21.15.88:0/2349537864 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8348055e00 con 0x7f83540d1570 2023-11-20T07:01:20.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f9f494ea640 1 -- start start 2023-11-20T07:01:20.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7a9b7fe640 1 -- 172.21.15.88:0/3210400075 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80125f0 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7a9b7fe640 1 -- 172.21.15.88:0/3210400075 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa8012750 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7a9b7fe640 1 -- 172.21.15.88:0/3210400075 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8012ae0 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab949c640 1 -- 172.21.15.88:0/3210400075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab4159640 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f7ab949c640 1 -- 172.21.15.88:0/3210400075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab4158cc0 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7fa614ff9640 1 -- 172.21.15.88:0/704886168 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa60c0508f0 con 0x7fa6180cb2b0 2023-11-20T07:01:20.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f0ec27fc640 1 -- 172.21.15.88:0/1136048377 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc12a640 con 0x7f0ec40e3200 2023-11-20T07:01:20.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f0ec27fc640 1 -- 172.21.15.88:0/1136048377 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc12a7a0 con 0x7f0ec40e3200 2023-11-20T07:01:20.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f0ec27fc640 1 -- 172.21.15.88:0/1136048377 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc12ab10 con 0x7f0ec40e3200 2023-11-20T07:01:20.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f9f494ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f4406ccb0 0x7f9f440c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f9f494ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f440c9920 0x7f9f440af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f9f494ea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f440c9d00 0x7f9f4414b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f9f494ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440c17b0 con 0x7f9f440c9920 2023-11-20T07:01:20.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f9f494ea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440c1ce0 con 0x7f9f440c9d00 2023-11-20T07:01:20.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.754+0000 7f9f494ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440c1a00 con 0x7f9f4406ccb0 2023-11-20T07:01:20.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f9f437fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f440c9d00 0x7f9f4414b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f9f437fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f440c9d00 0x7f9f4414b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36216/0 (socket says 172.21.15.88:36216) 2023-11-20T07:01:20.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f9f437fe640 1 -- 172.21.15.88:0/3420574357 learned_addr learned my addr 172.21.15.88:0/3420574357 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:20.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f9f3a7fc640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f440c9920 0x7f9f440af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f9f42ffd640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f4406ccb0 0x7f9f440c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/1136048377 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec40e4ae0 con 0x7f0ec40e3200 2023-11-20T07:01:20.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/1136048377 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec40505a0 con 0x7f0ec40e3200 2023-11-20T07:01:20.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f11e3fff640 1 -- 172.21.15.88:0/956906024 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f11f00eac00 con 0x7f11fc0c1540 2023-11-20T07:01:20.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f2a117fa640 1 -- 172.21.15.88:0/3721926894 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a040072d0 con 0x7f2a140b07f0 2023-11-20T07:01:20.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f2a117fa640 1 -- 172.21.15.88:0/3721926894 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a04007430 con 0x7f2a140b07f0 2023-11-20T07:01:20.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f2a117fa640 1 -- 172.21.15.88:0/3721926894 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a040047f0 con 0x7f2a140b07f0 2023-11-20T07:01:20.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f9f42ffd640 1 -- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f440c9d00 msgr2=0x7f9f4414b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f9f42ffd640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f440c9d00 0x7f9f4414b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f9f42ffd640 1 -- 172.21.15.88:0/3420574357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f440c9920 msgr2=0x7f9f440af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:20.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f9f42ffd640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f440c9920 0x7f9f440af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:20.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f9f42ffd640 1 -- 172.21.15.88:0/3420574357 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c009a70 con 0x7f9f4406ccb0 2023-11-20T07:01:20.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7fbcd27fc640 1 -- 172.21.15.88:0/3410676 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbcd8050fd0 con 0x7fbcdc15cb90 2023-11-20T07:01:20.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f7a997fa640 1 -- 172.21.15.88:0/3210400075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab40b4130 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f9f42ffd640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f4406ccb0 0x7f9f440c0110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00c420 tx=0x7f9f2c00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/1136048377 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec40d91a0 con 0x7f0ec40e3200 2023-11-20T07:01:20.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f833b7fe640 1 -- 172.21.15.88:0/2349537864 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f83540b7510 con 0x7f83540d1570 2023-11-20T07:01:20.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f0ec27fc640 1 -- 172.21.15.88:0/1136048377 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0ecc131070 con 0x7f0ec40e3200 2023-11-20T07:01:20.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f7a9b7fe640 1 -- 172.21.15.88:0/3210400075 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7aa8012c40 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f7a9b7fe640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7aa00664d0 0x7f7aa0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f7a9b7fe640 1 -- 172.21.15.88:0/3210400075 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7aa8084390 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f9f3bfff640 1 -- 172.21.15.88:0/3420574357 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c005cf0 con 0x7f9f4406ccb0 2023-11-20T07:01:20.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.758+0000 7f2a1b246640 1 -- 172.21.15.88:0/3721926894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a14161430 con 0x7f2a140b07f0 2023-11-20T07:01:20.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f2a1b246640 1 -- 172.21.15.88:0/3721926894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a141619f0 con 0x7f2a140b07f0 2023-11-20T07:01:20.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f7ab2ffd640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7aa00664d0 0x7f7aa0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f9f494ea640 1 -- 172.21.15.88:0/3420574357 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f440cd210 con 0x7f9f4406ccb0 2023-11-20T07:01:20.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f9f494ea640 1 -- 172.21.15.88:0/3420574357 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f440aed90 con 0x7f9f4406ccb0 2023-11-20T07:01:20.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f9f3bfff640 1 -- 172.21.15.88:0/3420574357 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c005e50 con 0x7f9f4406ccb0 2023-11-20T07:01:20.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f9f3bfff640 1 -- 172.21.15.88:0/3420574357 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0072d0 con 0x7f9f4406ccb0 2023-11-20T07:01:20.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f7ab2ffd640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7aa00664d0 0x7f7aa0068990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4007fd0 tx=0x7f7aa4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f0ec27fc640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0eb00664f0 0x7f0eb00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f0ec27fc640 1 -- 172.21.15.88:0/1136048377 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ecc19b090 con 0x7f0ec40e3200 2023-11-20T07:01:20.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f0ed1f3d640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0eb00664f0 0x7f0eb00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f2a1b246640 1 -- 172.21.15.88:0/3721926894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a141621f0 con 0x7f2a140b07f0 2023-11-20T07:01:20.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f0ed1f3d640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0eb00664f0 0x7f0eb00689b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4006860 tx=0x7f0ec8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f9f494ea640 1 -- 172.21.15.88:0/3420574357 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f28005260 con 0x7f9f4406ccb0 2023-11-20T07:01:20.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.762+0000 7f7a9b7fe640 1 -- 172.21.15.88:0/3210400075 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7aa80515e0 con 0x7f7ab40cb2d0 2023-11-20T07:01:20.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.766+0000 7f9f3bfff640 1 -- 172.21.15.88:0/3420574357 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9f2c007430 con 0x7f9f4406ccb0 2023-11-20T07:01:20.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.766+0000 7f2a117fa640 1 -- 172.21.15.88:0/3721926894 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2a04004950 con 0x7f2a140b07f0 2023-11-20T07:01:20.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.766+0000 7f2a117fa640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2a00066570 0x7f2a00068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.766+0000 7f2a117fa640 1 -- 172.21.15.88:0/3721926894 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a04083d40 con 0x7f2a140b07f0 2023-11-20T07:01:20.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.766+0000 7f9f3bfff640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9f240664f0 0x7f9f240689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:20.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.766+0000 7f9f3bfff640 1 -- 172.21.15.88:0/3420574357 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f2c0835f0 con 0x7f9f4406ccb0 2023-11-20T07:01:20.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.766+0000 7f9f3a7fc640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9f240664f0 0x7f9f240689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.770+0000 7f2a13fff640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2a00066570 0x7f2a00068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:20.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.770+0000 7f9f3a7fc640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9f240664f0 0x7f9f240689b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9f440c87c0 tx=0x7f9f34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:20.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.770+0000 7f2a117fa640 1 -- 172.21.15.88:0/3721926894 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2a04051000 con 0x7f2a140b07f0 2023-11-20T07:01:20.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.766+0000 7f0ec27fc640 1 -- 172.21.15.88:0/1136048377 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0ecc1684b0 con 0x7f0ec40e3200 2023-11-20T07:01:20.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.770+0000 7f9f3bfff640 1 -- 172.21.15.88:0/3420574357 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f2c054330 con 0x7f9f4406ccb0 2023-11-20T07:01:20.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:20.770+0000 7f2a13fff640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2a00066570 0x7f2a00068a30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2a080ad000 tx=0x7f2a080a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.082+0000 7f8359565640 1 -- 172.21.15.88:0/2349537864 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f83540b7510 con 0x7f83540d1570 2023-11-20T07:01:21.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.082+0000 7fa61e29e640 1 -- 172.21.15.88:0/704886168 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa6181573e0 con 0x7fa6180cb2b0 2023-11-20T07:01:21.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.082+0000 7fbce3e9e640 1 -- 172.21.15.88:0/3410676 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbcdc074010 con 0x7fbcdc15cb90 2023-11-20T07:01:21.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7fbcd27fc640 1 -- 172.21.15.88:0/3410676 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbcd80545f0 con 0x7fbcdc15cb90 2023-11-20T07:01:21.086 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-11-20T07:01:21.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.082+0000 7f833b7fe640 1 -- 172.21.15.88:0/2349537864 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f83540b7510 con 0x7f83540d1570 2023-11-20T07:01:21.087 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-11-20T07:01:21.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7fa614ff9640 1 -- 172.21.15.88:0/704886168 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa60c017090 con 0x7fa6180cb2b0 2023-11-20T07:01:21.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f1201eea640 1 -- 172.21.15.88:0/956906024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11dc0057e0 con 0x7f11fc0c1540 2023-11-20T07:01:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f8359565640 1 -- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f83400664a0 msgr2=0x7f8340068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f8359565640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f83400664a0 0x7f8340068960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8344001370 tx=0x7f8344009040 comp rx=0 tx=0).stop 2023-11-20T07:01:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f8359565640 1 -- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 msgr2=0x7f83540b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f8359565640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 0x7f83540b77f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f834800d830 tx=0x7f834800dcf0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.088 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2023-11-20T07:01:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f11e3fff640 1 -- 172.21.15.88:0/956906024 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f11f00ee220 con 0x7f11fc0c1540 2023-11-20T07:01:21.089 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-11-20T07:01:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f8359565640 1 -- 172.21.15.88:0/2349537864 shutdown_connections 2023-11-20T07:01:21.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f8359565640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f83400664a0 0x7f8340068960 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f8359565640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83540d1570 0x7f83540b77f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f8359565640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f835415cae0 0x7f83540c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f8359565640 1 --2- 172.21.15.88:0/2349537864 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83540cdd90 0x7f83540b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f8359565640 1 -- 172.21.15.88:0/2349537864 >> 172.21.15.88:0/2349537864 conn(0x7f835409bb50 msgr2=0x7f83540b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f8359565640 1 -- 172.21.15.88:0/2349537864 shutdown_connections 2023-11-20T07:01:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.086+0000 7f8359565640 1 -- 172.21.15.88:0/2349537864 wait complete. 2023-11-20T07:01:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fbce3e9e640 1 -- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbcc00664a0 msgr2=0x7fbcc0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fbce3e9e640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbcc00664a0 0x7fbcc0068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbccc006fd0 tx=0x7fbccc008040 comp rx=0 tx=0).stop 2023-11-20T07:01:21.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fbce3e9e640 1 -- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcdc15cb90 msgr2=0x7fbcdc14b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fbce3e9e640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcdc15cb90 0x7fbcdc14b960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800b410 tx=0x7fbcd800b8d0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fbce3e9e640 1 -- 172.21.15.88:0/3410676 shutdown_connections 2023-11-20T07:01:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fbce3e9e640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fbcc00664a0 0x7fbcc0068960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fbce3e9e640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcdc15cb90 0x7fbcdc14b960 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fbce3e9e640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcdc0d3010 0x7fbcdc0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fbce3e9e640 1 --2- 172.21.15.88:0/3410676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcdc0d1400 0x7fbcdc153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fbce3e9e640 1 -- 172.21.15.88:0/3410676 >> 172.21.15.88:0/3410676 conn(0x7fbcdc09bc50 msgr2=0x7fbcdc155e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fa61e29e640 1 -- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa6040664f0 msgr2=0x7fa6040689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fa61e29e640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa6040664f0 0x7fa6040689b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa60800e330 tx=0x7fa60800b040 comp rx=0 tx=0).stop 2023-11-20T07:01:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fa61e29e640 1 -- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6180cb2b0 msgr2=0x7fa61814fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fa61e29e640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6180cb2b0 0x7fa61814fc60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa60c00c4c0 tx=0x7fa60c00c980 comp rx=0 tx=0).stop 2023-11-20T07:01:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fa61e29e640 1 -- 172.21.15.88:0/704886168 shutdown_connections 2023-11-20T07:01:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fa61e29e640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa6040664f0 0x7fa6040689b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fa61e29e640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa618158940 0x7fa6180af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fa61e29e640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6180cb2b0 0x7fa61814fc60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fa61e29e640 1 --2- 172.21.15.88:0/704886168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6180705b0 0x7fa618151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fa61e29e640 1 -- 172.21.15.88:0/704886168 >> 172.21.15.88:0/704886168 conn(0x7fa61806a570 msgr2=0x7fa618157600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fa61e29e640 1 -- 172.21.15.88:0/704886168 shutdown_connections 2023-11-20T07:01:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7fa61e29e640 1 -- 172.21.15.88:0/704886168 wait complete. 2023-11-20T07:01:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7f1201eea640 1 -- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f11e8066560 msgr2=0x7f11e8068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7f1201eea640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f11e8066560 0x7f11e8068a20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f11ec001390 tx=0x7f11ec009040 comp rx=0 tx=0).stop 2023-11-20T07:01:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7f1201eea640 1 -- 172.21.15.88:0/956906024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11fc0c1540 msgr2=0x7f11fc0c1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7f1201eea640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11fc0c1540 0x7f11fc0c1dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f11f00ac000 tx=0x7f11f0019310 comp rx=0 tx=0).stop 2023-11-20T07:01:21.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.090+0000 7f2a1b246640 1 -- 172.21.15.88:0/3721926894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2a1415e440 con 0x7f2a140b07f0 2023-11-20T07:01:21.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7fbce3e9e640 1 -- 172.21.15.88:0/3410676 shutdown_connections 2023-11-20T07:01:21.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f1201eea640 1 -- 172.21.15.88:0/956906024 shutdown_connections 2023-11-20T07:01:21.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f1201eea640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f11e8066560 0x7f11e8068a20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f1201eea640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11fc160ec0 0x7f11fc0c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f1201eea640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f11fc0c1540 0x7f11fc0c1dd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f1201eea640 1 --2- 172.21.15.88:0/956906024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11fc0b0620 0x7f11fc156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f1201eea640 1 -- 172.21.15.88:0/956906024 >> 172.21.15.88:0/956906024 conn(0x7f11fc06c190 msgr2=0x7f11fc0afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:21.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f7a997fa640 1 -- 172.21.15.88:0/3210400075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7ab4073fa0 con 0x7f7ab40cb2d0 2023-11-20T07:01:21.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7fbce3e9e640 1 -- 172.21.15.88:0/3410676 wait complete. 2023-11-20T07:01:21.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f1201eea640 1 -- 172.21.15.88:0/956906024 shutdown_connections 2023-11-20T07:01:21.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f7a9b7fe640 1 -- 172.21.15.88:0/3210400075 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7aa8054c00 con 0x7f7ab40cb2d0 2023-11-20T07:01:21.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f2a117fa640 1 -- 172.21.15.88:0/3721926894 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a04018020 con 0x7f2a140b07f0 2023-11-20T07:01:21.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f1201eea640 1 -- 172.21.15.88:0/956906024 wait complete. 2023-11-20T07:01:21.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/1136048377 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0ec40dbf60 con 0x7f0ec40e3200 2023-11-20T07:01:21.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f0ec27fc640 1 -- 172.21.15.88:0/1136048377 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ec40dbf60 con 0x7f0ec40e3200 2023-11-20T07:01:21.098 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2023-11-20T07:01:21.098 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2023-11-20T07:01:21.099 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-11-20T07:01:21.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f9f494ea640 1 -- 172.21.15.88:0/3420574357 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9f28005510 con 0x7f9f4406ccb0 2023-11-20T07:01:21.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.094+0000 7f9f3bfff640 1 -- 172.21.15.88:0/3420574357 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f2c053ec0 con 0x7f9f4406ccb0 2023-11-20T07:01:21.100 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2023-11-20T07:01:21.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0eb00664f0 msgr2=0x7f0eb00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f0ed2f3f640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0eb00664f0 0x7f0eb00689b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4006860 tx=0x7f0ec8009190 comp rx=0 tx=0).stop 2023-11-20T07:01:21.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/1136048377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ec40e3200 msgr2=0x7f0ec40dc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f0ed2f3f640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ec40e3200 0x7f0ec40dc3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc073810 tx=0x7f0ecc095b10 comp rx=0 tx=0).stop 2023-11-20T07:01:21.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/1136048377 shutdown_connections 2023-11-20T07:01:21.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f0ed2f3f640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0eb00664f0 0x7f0eb00689b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f0ed2f3f640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ec4054470 0x7f0ec4005eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f0ed2f3f640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ec40e3200 0x7f0ec40dc3f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f0ed2f3f640 1 --2- 172.21.15.88:0/1136048377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec403c080 0x7f0ec4050060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/1136048377 >> 172.21.15.88:0/1136048377 conn(0x7f0ec4055aa0 msgr2=0x7f0ec40ee440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:21.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/1136048377 shutdown_connections 2023-11-20T07:01:21.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f0ed2f3f640 1 -- 172.21.15.88:0/1136048377 wait complete. 2023-11-20T07:01:21.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f2a1b246640 1 -- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2a00066570 msgr2=0x7f2a00068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f2a1b246640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2a00066570 0x7f2a00068a30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2a080ad000 tx=0x7f2a080a6000 comp rx=0 tx=0).stop 2023-11-20T07:01:21.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f2a1b246640 1 -- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a140b07f0 msgr2=0x7f2a140c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f2a1b246640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a140b07f0 0x7f2a140c3ed0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400c780 tx=0x7f2a0400cc40 comp rx=0 tx=0).stop 2023-11-20T07:01:21.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f2a1b246640 1 -- 172.21.15.88:0/3721926894 shutdown_connections 2023-11-20T07:01:21.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f2a1b246640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2a00066570 0x7f2a00068a30 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2a080ad000 tx=0x7f2a080a6000 comp rx=0 tx=0).stop 2023-11-20T07:01:21.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f2a1b246640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a14164520 0x7f2a1415f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f2a1b246640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a1415f970 0x7f2a1415bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f2a1b246640 1 --2- 172.21.15.88:0/3721926894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a140b07f0 0x7f2a140c3ed0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f2a1b246640 1 -- 172.21.15.88:0/3721926894 >> 172.21.15.88:0/3721926894 conn(0x7f2a1406c190 msgr2=0x7f2a1415d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:21.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f9f494ea640 1 -- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9f240664f0 msgr2=0x7f9f240689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f9f494ea640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9f240664f0 0x7f9f240689b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9f440c87c0 tx=0x7f9f34009040 comp rx=0 tx=0).stop 2023-11-20T07:01:21.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f9f494ea640 1 -- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f4406ccb0 msgr2=0x7f9f440c0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f9f494ea640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f4406ccb0 0x7f9f440c0110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00c420 tx=0x7f9f2c00c8e0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f2a1b246640 1 -- 172.21.15.88:0/3721926894 shutdown_connections 2023-11-20T07:01:21.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f9f494ea640 1 -- 172.21.15.88:0/3420574357 shutdown_connections 2023-11-20T07:01:21.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f9f494ea640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9f240664f0 0x7f9f240689b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f9f494ea640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f440c9d00 0x7f9f4414b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f9f494ea640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f440c9920 0x7f9f440af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f9f494ea640 1 --2- 172.21.15.88:0/3420574357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f4406ccb0 0x7f9f440c0110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f9f494ea640 1 -- 172.21.15.88:0/3420574357 >> 172.21.15.88:0/3420574357 conn(0x7f9f4406c190 msgr2=0x7f9f4406c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:21.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f2a1b246640 1 -- 172.21.15.88:0/3721926894 wait complete. 2023-11-20T07:01:21.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f7a997fa640 1 -- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7aa00664d0 msgr2=0x7f7aa0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f7a997fa640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7aa00664d0 0x7f7aa0068990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4007fd0 tx=0x7f7aa4009040 comp rx=0 tx=0).stop 2023-11-20T07:01:21.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f7a997fa640 1 -- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab40cb2d0 msgr2=0x7f7ab40c56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:21.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f7a997fa640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab40cb2d0 0x7f7ab40c56b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800d5a0 tx=0x7f7aa800da60 comp rx=0 tx=0).stop 2023-11-20T07:01:21.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f7a997fa640 1 -- 172.21.15.88:0/3210400075 shutdown_connections 2023-11-20T07:01:21.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f7a997fa640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7aa00664d0 0x7f7aa0068990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f7a997fa640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ab40cc660 0x7f7ab415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f7a997fa640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab40cb2d0 0x7f7ab40c56b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f7a997fa640 1 --2- 172.21.15.88:0/3210400075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40c1510 0x7f7ab40c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:21.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f7a997fa640 1 -- 172.21.15.88:0/3210400075 >> 172.21.15.88:0/3210400075 conn(0x7f7ab406a570 msgr2=0x7f7ab40ade40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:21.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f9f494ea640 1 -- 172.21.15.88:0/3420574357 shutdown_connections 2023-11-20T07:01:21.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f9f494ea640 1 -- 172.21.15.88:0/3420574357 wait complete. 2023-11-20T07:01:21.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.098+0000 7f7a997fa640 1 -- 172.21.15.88:0/3210400075 shutdown_connections 2023-11-20T07:01:21.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:21.102+0000 7f7a997fa640 1 -- 172.21.15.88:0/3210400075 wait complete. 2023-11-20T07:01:21.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2023-11-20T07:01:21.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2023-11-20T07:01:21.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2023-11-20T07:01:21.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-11-20T07:01:21.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.0 2023-11-20T07:01:21.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2023-11-20T07:01:21.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-11-20T07:01:21.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-11-20T07:01:22.132 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-20T07:01:22.138 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-20T07:01:22.139 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-20T07:01:22.144 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-20T07:01:22.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-20T07:01:22.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-20T07:01:22.148 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-20T07:01:22.148 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-20T07:01:22.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.350+0000 7faaec3b8640 1 Processor -- start 2023-11-20T07:01:22.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.350+0000 7faaec3b8640 1 -- start start 2023-11-20T07:01:22.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faaec3b8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae4158c10 0x7faae40705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faaec3b8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faae40ce950 0x7faae415cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faaec3b8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae415d510 con 0x7faae40ce570 2023-11-20T07:01:22.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faaec3b8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae4072120 con 0x7faae40ce950 2023-11-20T07:01:22.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faaec3b8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae4070c00 con 0x7faae4158c10 2023-11-20T07:01:22.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faaea154640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7faae40ce570 0x7faae4158500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:49180/0 (socket says 172.21.15.88:49180) 2023-11-20T07:01:22.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faae9953640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae4158c10 0x7faae40705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faae9953640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae4158c10 0x7faae40705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38566/0 (socket says 172.21.15.88:38566) 2023-11-20T07:01:22.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faae9953640 1 -- 172.21.15.88:0/2598826318 learned_addr learned my addr 172.21.15.88:0/2598826318 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:22.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faae9953640 1 -- 172.21.15.88:0/2598826318 >> v2:172.21.15.88:3300/0 conn(0x7faae40ce950 msgr2=0x7faae415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:22.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faae9953640 1 --2- 172.21.15.88:0/2598826318 >> v2:172.21.15.88:3300/0 conn(0x7faae40ce950 0x7faae415cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faae9953640 1 -- 172.21.15.88:0/2598826318 >> v1:172.21.15.175:6789/0 conn(0x7faae40ce570 legacy=0x7faae4158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.354+0000 7faae9953640 1 -- 172.21.15.88:0/2598826318 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae4070ee0 con 0x7faae4158c10 2023-11-20T07:01:22.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.362+0000 7faae9953640 1 --2- 172.21.15.88:0/2598826318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae4158c10 0x7faae40705b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faad4009870 tx=0x7faad401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6f8b437a8208fa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.362+0000 7faae9152640 1 -- 172.21.15.88:0/2598826318 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40ac620 con 0x7faae4158c10 2023-11-20T07:01:22.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.362+0000 7faae9152640 1 -- 172.21.15.88:0/2598826318 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad40ac780 con 0x7faae4158c10 2023-11-20T07:01:22.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.362+0000 7faaec3b8640 1 -- 172.21.15.88:0/2598826318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae4158c10 msgr2=0x7faae40705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.362+0000 7faae9152640 1 -- 172.21.15.88:0/2598826318 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40ac620 con 0x7faae4158c10 2023-11-20T07:01:22.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.362+0000 7faaec3b8640 1 --2- 172.21.15.88:0/2598826318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae4158c10 0x7faae40705b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faad4009870 tx=0x7faad401c480 comp rx=0 tx=0).stop 2023-11-20T07:01:22.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.362+0000 7faaec3b8640 1 -- 172.21.15.88:0/2598826318 shutdown_connections 2023-11-20T07:01:22.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.362+0000 7faaec3b8640 1 --2- 172.21.15.88:0/2598826318 >> v2:172.21.15.88:3300/0 conn(0x7faae40ce950 0x7faae415cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.362+0000 7faaec3b8640 1 --2- 172.21.15.88:0/2598826318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae4158c10 0x7faae40705b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.362+0000 7faaec3b8640 1 -- 172.21.15.88:0/2598826318 >> 172.21.15.88:0/2598826318 conn(0x7faae406a290 msgr2=0x7faae406a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.366+0000 7faaec3b8640 1 -- 172.21.15.88:0/2598826318 shutdown_connections 2023-11-20T07:01:22.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.366+0000 7faaec3b8640 1 -- 172.21.15.88:0/2598826318 wait complete. 2023-11-20T07:01:22.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.366+0000 7faaec3b8640 1 Processor -- start 2023-11-20T07:01:22.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.366+0000 7faaec3b8640 1 -- start start 2023-11-20T07:01:22.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faaec3b8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae40ce570 0x7faae4159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faaec3b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faae40ce950 0x7faae40b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faaea154640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae40ce570 0x7faae4159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faaea154640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae40ce570 0x7faae4159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36222/0 (socket says 172.21.15.88:36222) 2023-11-20T07:01:22.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faae9953640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faae40ce950 0x7faae40b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faaea154640 1 -- 172.21.15.88:0/1734500963 learned_addr learned my addr 172.21.15.88:0/1734500963 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:22.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faaec3b8640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae4158c10 0x7faae41feb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae40b3470 con 0x7faae40ce950 2023-11-20T07:01:22.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae40b1590 con 0x7faae40ce570 2023-11-20T07:01:22.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae415a100 con 0x7faae4158c10 2023-11-20T07:01:22.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faaea955640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae4158c10 0x7faae41feb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faae9953640 1 -- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae4158c10 msgr2=0x7faae41feb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faae9953640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae4158c10 0x7faae41feb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faae9953640 1 -- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae40ce570 msgr2=0x7faae4159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faae9953640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae40ce570 0x7faae4159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.370+0000 7faae9953640 1 -- 172.21.15.88:0/1734500963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad40094d0 con 0x7faae40ce950 2023-11-20T07:01:22.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.374+0000 7faae9953640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faae40ce950 0x7faae40b2f30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faad40ac000 tx=0x7faad4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.374+0000 7faadaffd640 1 -- 172.21.15.88:0/1734500963 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4003820 con 0x7faae40ce950 2023-11-20T07:01:22.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.374+0000 7faadaffd640 1 -- 172.21.15.88:0/1734500963 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad40039a0 con 0x7faae40ce950 2023-11-20T07:01:22.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.374+0000 7faadaffd640 1 -- 172.21.15.88:0/1734500963 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4003d50 con 0x7faae40ce950 2023-11-20T07:01:22.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.378+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae415a3e0 con 0x7faae40ce950 2023-11-20T07:01:22.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.378+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae40b1220 con 0x7faae40ce950 2023-11-20T07:01:22.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.378+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae4073fa0 con 0x7faae40ce950 2023-11-20T07:01:22.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.386+0000 7faadaffd640 1 -- 172.21.15.88:0/1734500963 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faad40b3040 con 0x7faae40ce950 2023-11-20T07:01:22.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.386+0000 7faadaffd640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faac8066570 0x7faac8068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.386+0000 7faadaffd640 1 -- 172.21.15.88:0/1734500963 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faad411f7a0 con 0x7faae40ce950 2023-11-20T07:01:22.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.390+0000 7faaea154640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faac8066570 0x7faac8068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.394+0000 7faaea154640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faac8066570 0x7faac8068a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faae0000c10 tx=0x7faae0005780 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.394+0000 7faadaffd640 1 -- 172.21.15.88:0/1734500963 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faad40ec9c0 con 0x7faae40ce950 2023-11-20T07:01:22.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.426+0000 7f5b3fbc4640 1 Processor -- start 2023-11-20T07:01:22.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.426+0000 7f5b3fbc4640 1 -- start start 2023-11-20T07:01:22.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.426+0000 7f5b3fbc4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b38161150 0x7f5b380cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.426+0000 7f5b3d15f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b38161150 0x7f5b380cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.426+0000 7f5b3d960640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5b3815ff70 0x7f5b380c93c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:49186/0 (socket says 172.21.15.88:49186) 2023-11-20T07:01:22.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.426+0000 7f5b3fbc4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b380cc5b0 con 0x7f5b380cdde0 2023-11-20T07:01:22.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.426+0000 7f5b3fbc4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b380cd410 con 0x7f5b3815ff70 2023-11-20T07:01:22.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.426+0000 7f5b3d15f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b38161150 0x7f5b380cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54160/0 (socket says 172.21.15.88:54160) 2023-11-20T07:01:22.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.426+0000 7f5b3fbc4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b38160350 con 0x7f5b38161150 2023-11-20T07:01:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.426+0000 7f5b3d15f640 1 -- 172.21.15.88:0/2936634057 learned_addr learned my addr 172.21.15.88:0/2936634057 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.426+0000 7f5b3c95e640 1 -- 172.21.15.88:0/2936634057 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509111390 0 0) 0x7f5b380cd410 con 0x7f5b3815ff70 2023-11-20T07:01:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.430+0000 7f5b3c95e640 1 -- 172.21.15.88:0/2936634057 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b2400bd40 con 0x7f5b3815ff70 2023-11-20T07:01:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.430+0000 7f5b3d15f640 1 -- 172.21.15.88:0/2936634057 >> v1:172.21.15.175:6789/0 conn(0x7f5b3815ff70 legacy=0x7f5b380c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.430+0000 7f5b3d15f640 1 -- 172.21.15.88:0/2936634057 >> v1:172.21.15.88:6789/0 conn(0x7f5b380cdde0 legacy=0x7f5b3806bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.430+0000 7f5b3d15f640 1 -- 172.21.15.88:0/2936634057 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b380cc800 con 0x7f5b38161150 2023-11-20T07:01:22.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.430+0000 7f352c994640 1 Processor -- start 2023-11-20T07:01:22.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.430+0000 7f352c994640 1 -- start start 2023-11-20T07:01:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f352c994640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35280ce570 0x7f35280705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f5b3d15f640 1 --2- 172.21.15.88:0/2936634057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b38161150 0x7f5b380cd8a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009870 tx=0x7f5b2801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd982739ca116825 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f352c994640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f35280ce950 0x7f352815cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f5b3c95e640 1 -- 172.21.15.88:0/2936634057 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b280a8a30 con 0x7f5b38161150 2023-11-20T07:01:22.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f5b3c95e640 1 -- 172.21.15.88:0/2936634057 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b280a8b90 con 0x7f5b38161150 2023-11-20T07:01:22.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f5b3c95e640 1 -- 172.21.15.88:0/2936634057 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b280b0440 con 0x7f5b38161150 2023-11-20T07:01:22.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f352659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35280ce570 0x7f35280705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f352659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35280ce570 0x7f35280705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54170/0 (socket says 172.21.15.88:54170) 2023-11-20T07:01:22.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f352659c640 1 -- 172.21.15.88:0/80308228 learned_addr learned my addr 172.21.15.88:0/80308228 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:22.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f3525d9b640 1 --2- 172.21.15.88:0/80308228 >> v2:172.21.15.175:3300/0 conn(0x7f35280ce950 0x7f352815cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/2936634057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b38161150 msgr2=0x7f5b380cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f5b3fbc4640 1 --2- 172.21.15.88:0/2936634057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b38161150 0x7f5b380cd8a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009870 tx=0x7f5b2801ed30 comp rx=0 tx=0).stop 2023-11-20T07:01:22.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f352c994640 1 -- 172.21.15.88:0/80308228 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352815d510 con 0x7f35280cae00 2023-11-20T07:01:22.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f352c994640 1 -- 172.21.15.88:0/80308228 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3528072120 con 0x7f35280ce570 2023-11-20T07:01:22.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f352c994640 1 -- 172.21.15.88:0/80308228 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3528070c00 con 0x7f35280ce950 2023-11-20T07:01:22.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/2936634057 shutdown_connections 2023-11-20T07:01:22.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f5b3fbc4640 1 --2- 172.21.15.88:0/2936634057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b38161150 0x7f5b380cd8a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.434+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/2936634057 >> 172.21.15.88:0/2936634057 conn(0x7f5b3806a290 msgr2=0x7f5b3806a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.438+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/2936634057 shutdown_connections 2023-11-20T07:01:22.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.438+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/2936634057 wait complete. 2023-11-20T07:01:22.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.438+0000 7f352659c640 1 -- 172.21.15.88:0/80308228 >> v2:172.21.15.175:3300/0 conn(0x7f35280ce950 msgr2=0x7f352815cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:22.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.438+0000 7f352659c640 1 --2- 172.21.15.88:0/80308228 >> v2:172.21.15.175:3300/0 conn(0x7f35280ce950 0x7f352815cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.438+0000 7f352659c640 1 -- 172.21.15.88:0/80308228 >> v1:172.21.15.88:6789/0 conn(0x7f35280cae00 legacy=0x7f352806bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:22.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.438+0000 7f352659c640 1 -- 172.21.15.88:0/80308228 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528070ee0 con 0x7f35280ce570 2023-11-20T07:01:22.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.438+0000 7f3525d9b640 1 --2- 172.21.15.88:0/80308228 >> v2:172.21.15.175:3300/0 conn(0x7f35280ce950 0x7f352815cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:22.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.438+0000 7f5b3fbc4640 1 Processor -- start 2023-11-20T07:01:22.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.438+0000 7f5b3fbc4640 1 -- start start 2023-11-20T07:01:22.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7fd13fb1d640 1 Processor -- start 2023-11-20T07:01:22.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7fd13fb1d640 1 -- start start 2023-11-20T07:01:22.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f5b3fbc4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b380cdde0 0x7f5b3814b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f5b3fbc4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3815ff70 0x7f5b3814ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f5b3fbc4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b38161150 0x7f5b3814bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f2983417640 1 Processor -- start 2023-11-20T07:01:22.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f5b3fbc4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380c5830 con 0x7f5b38161150 2023-11-20T07:01:22.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f5b3e161640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b38161150 0x7f5b3814bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f5b3e161640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b38161150 0x7f5b3814bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54186/0 (socket says 172.21.15.88:54186) 2023-11-20T07:01:22.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f5b3e161640 1 -- 172.21.15.88:0/1514466529 learned_addr learned my addr 172.21.15.88:0/1514466529 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:22.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/1514466529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b381f1580 con 0x7f5b3815ff70 2023-11-20T07:01:22.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f352659c640 1 --2- 172.21.15.88:0/80308228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35280ce570 0x7f35280705b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f35280cc070 tx=0x7f3518023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a491e1d938c009b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/1514466529 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3814c640 con 0x7f5b380cdde0 2023-11-20T07:01:22.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f5b3d960640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b380cdde0 0x7f5b3814b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7fd13fb1d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd138164520 0x7fd1380ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7fd13fb1d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1380b07f0 0x7fd1380cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7fd13fb1d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1380c96f0 con 0x7fd1380ad960 2023-11-20T07:01:22.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7fd13d8b9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd138164520 0x7fd1380ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7fd13fb1d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd138164900 con 0x7fd138164520 2023-11-20T07:01:22.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f352559a640 1 -- 172.21.15.88:0/80308228 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800d2d0 con 0x7f35280ce570 2023-11-20T07:01:22.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7fd13fb1d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380cb950 con 0x7fd1380b07f0 2023-11-20T07:01:22.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f352559a640 1 -- 172.21.15.88:0/80308228 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35180acc10 con 0x7f35280ce570 2023-11-20T07:01:22.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7fd13d0b8640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd1380ad960 0x7fd1380b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:49196/0 (socket says 172.21.15.88:49196) 2023-11-20T07:01:22.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f5b3e161640 1 -- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b380cdde0 msgr2=0x7f5b3814b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f5b3e161640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b380cdde0 0x7f5b3814b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f5b3e161640 1 -- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3815ff70 msgr2=0x7f5b3814ba30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-20T07:01:22.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f5b3e161640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3815ff70 0x7f5b3814ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f5b3e161640 1 -- 172.21.15.88:0/1514466529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b280094d0 con 0x7f5b38161150 2023-11-20T07:01:22.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7fd13d0b8640 1 -- 172.21.15.88:0/3841218956 learned_addr learned my addr 172.21.15.88:0/3841218956 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:22.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7f2983417640 1 -- start start 2023-11-20T07:01:22.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f2983417640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f297c0c9d00 0x7f297c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f2983417640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297c15d210 con 0x7f297c0ccec0 2023-11-20T07:01:22.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f2983417640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297c15d4f0 con 0x7f297c0c9920 2023-11-20T07:01:22.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f2983417640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297c070af0 con 0x7f297c0c9d00 2023-11-20T07:01:22.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7fd13d8b9640 1 --2- 172.21.15.88:0/3841218956 >> v2:172.21.15.175:3300/0 conn(0x7fd138164520 0x7fd1380ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36246/0 (socket says 172.21.15.88:36246) 2023-11-20T07:01:22.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.442+0000 7fd13e0ba640 1 --2- 172.21.15.88:0/3841218956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1380b07f0 0x7fd1380cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7fd13c8b7640 1 -- 172.21.15.88:0/3841218956 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094711686 0 0) 0x7fd1380c96f0 con 0x7fd1380ad960 2023-11-20T07:01:22.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7fd13d8b9640 1 -- 172.21.15.88:0/3841218956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1380b07f0 msgr2=0x7fd1380cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:22.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7fd13d8b9640 1 --2- 172.21.15.88:0/3841218956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1380b07f0 0x7fd1380cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7fd13d8b9640 1 -- 172.21.15.88:0/3841218956 >> v1:172.21.15.175:6789/0 conn(0x7fd1380ad960 legacy=0x7fd1380b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7fd13d8b9640 1 -- 172.21.15.88:0/3841218956 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380cbed0 con 0x7fd138164520 2023-11-20T07:01:22.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f352559a640 1 -- 172.21.15.88:0/80308228 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800b450 con 0x7f35280ce570 2023-11-20T07:01:22.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f5b3e161640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b38161150 0x7f5b3814bf70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5b3000c770 tx=0x7f5b3000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f29811b3640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f297c0c9920 0x7f297c15c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:49202/0 (socket says 172.21.15.88:49202) 2023-11-20T07:01:22.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f29811b3640 1 -- 172.21.15.88:0/1136539000 learned_addr learned my addr 172.21.15.88:0/1136539000 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:22.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f5b2e7fc640 1 -- 172.21.15.88:0/1514466529 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30003b80 con 0x7f5b38161150 2023-11-20T07:01:22.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f5b2e7fc640 1 -- 172.21.15.88:0/1514466529 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b30003ce0 con 0x7f5b38161150 2023-11-20T07:01:22.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f5b2e7fc640 1 -- 172.21.15.88:0/1514466529 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3000aa70 con 0x7f5b38161150 2023-11-20T07:01:22.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f2973fff640 1 -- 172.21.15.88:0/1136539000 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341027722 0 0) 0x7f297c15d4f0 con 0x7f297c0c9920 2023-11-20T07:01:22.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/1514466529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3814c920 con 0x7f5b38161150 2023-11-20T07:01:22.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f29809b2640 1 --2- 172.21.15.88:0/1136539000 >> v2:172.21.15.175:3300/0 conn(0x7f297c0c9d00 0x7f297c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/1514466529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b380c5450 con 0x7f5b38161150 2023-11-20T07:01:22.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f2973fff640 1 -- 172.21.15.88:0/1136539000 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2968004640 con 0x7f297c0c9920 2023-11-20T07:01:22.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f352c994640 1 -- 172.21.15.88:0/80308228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35280ce570 msgr2=0x7f35280705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f2973fff640 1 -- 172.21.15.88:0/1136539000 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696897432 0 0) 0x7f297c15d210 con 0x7f297c0ccec0 2023-11-20T07:01:22.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f2973fff640 1 -- 172.21.15.88:0/1136539000 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f297c15d4f0 con 0x7f297c0ccec0 2023-11-20T07:01:22.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f352c994640 1 --2- 172.21.15.88:0/80308228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35280ce570 0x7f35280705b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f35280cc070 tx=0x7f3518023000 comp rx=0 tx=0).stop 2023-11-20T07:01:22.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f29809b2640 1 -- 172.21.15.88:0/1136539000 >> v1:172.21.15.175:6789/0 conn(0x7f297c0c9920 legacy=0x7f297c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f29809b2640 1 -- 172.21.15.88:0/1136539000 >> v1:172.21.15.88:6789/0 conn(0x7f297c0ccec0 legacy=0x7f297c0712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f352c994640 1 -- 172.21.15.88:0/80308228 shutdown_connections 2023-11-20T07:01:22.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f352c994640 1 --2- 172.21.15.88:0/80308228 >> v2:172.21.15.175:3300/0 conn(0x7f35280ce950 0x7f352815cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f352c994640 1 --2- 172.21.15.88:0/80308228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35280ce570 0x7f35280705b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f352c994640 1 -- 172.21.15.88:0/80308228 >> 172.21.15.88:0/80308228 conn(0x7f352806a290 msgr2=0x7f352806a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f8889017640 1 Processor -- start 2023-11-20T07:01:22.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.446+0000 7f29809b2640 1 -- 172.21.15.88:0/1136539000 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c070dd0 con 0x7f297c0c9d00 2023-11-20T07:01:22.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/1514466529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b380c5970 con 0x7f5b38161150 2023-11-20T07:01:22.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fe326279640 1 Processor -- start 2023-11-20T07:01:22.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f352c994640 1 -- 172.21.15.88:0/80308228 shutdown_connections 2023-11-20T07:01:22.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f352c994640 1 -- 172.21.15.88:0/80308228 wait complete. 2023-11-20T07:01:22.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fe326279640 1 -- start start 2023-11-20T07:01:22.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fd13d8b9640 1 --2- 172.21.15.88:0/3841218956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd138164520 0x7fd1380ce010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1340097c0 tx=0x7fd13401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b33a64b7306d86ee server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fec9846b640 1 Processor -- start 2023-11-20T07:01:22.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f8889017640 1 -- start start 2023-11-20T07:01:22.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f8889017640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888415ca70 0x7f88840d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f8889017640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f88840d3550 0x7f88840cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f8889017640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88840c65f0 con 0x7f88840cf5d0 2023-11-20T07:01:22.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f8889017640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88840ce820 con 0x7f88840d3550 2023-11-20T07:01:22.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f8889017640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88840cfa40 con 0x7f888415ca70 2023-11-20T07:01:22.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fd13c8b7640 1 -- 172.21.15.88:0/3841218956 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340ab670 con 0x7fd138164520 2023-11-20T07:01:22.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fec9846b640 1 -- start start 2023-11-20T07:01:22.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fd13c8b7640 1 -- 172.21.15.88:0/3841218956 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1340ab7d0 con 0x7fd138164520 2023-11-20T07:01:22.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fd13c8b7640 1 -- 172.21.15.88:0/3841218956 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340abb60 con 0x7fd138164520 2023-11-20T07:01:22.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f5b2e7fc640 1 -- 172.21.15.88:0/1514466529 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b3000abd0 con 0x7f5b38161150 2023-11-20T07:01:22.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fe326279640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3200ad960 0x7fe3200ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fe326279640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe3200b07f0 0x7fe3200cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fe326279640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3200c96f0 con 0x7fe320164520 2023-11-20T07:01:22.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fe326279640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe320164900 con 0x7fe3200b07f0 2023-11-20T07:01:22.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fe326279640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200cb950 con 0x7fe3200ad960 2023-11-20T07:01:22.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fe31ffff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe320164520 0x7fe3200b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:49218/0 (socket says 172.21.15.88:49218) 2023-11-20T07:01:22.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7fe31ffff640 1 -- 172.21.15.88:0/2557342715 learned_addr learned my addr 172.21.15.88:0/2557342715 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:22.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f29809b2640 1 --2- 172.21.15.88:0/1136539000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f297c0c9d00 0x7f297c0cc980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2974009d90 tx=0x7f2974020a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73ee1aca5a8b1d32 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fe31f7fe640 1 --2- 172.21.15.88:0/2557342715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3200ad960 0x7fe3200ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fe31effd640 1 -- 172.21.15.88:0/2557342715 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544556276 0 0) 0x7fe3200c96f0 con 0x7fe320164520 2023-11-20T07:01:22.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fe31effd640 1 -- 172.21.15.88:0/2557342715 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe308003530 con 0x7fe320164520 2023-11-20T07:01:22.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f352c994640 1 Processor -- start 2023-11-20T07:01:22.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f2973fff640 1 -- 172.21.15.88:0/1136539000 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978004ce0 con 0x7f297c0c9d00 2023-11-20T07:01:22.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f2973fff640 1 -- 172.21.15.88:0/1136539000 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29740a9930 con 0x7f297c0c9d00 2023-11-20T07:01:22.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f2973fff640 1 -- 172.21.15.88:0/1136539000 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29740a9cc0 con 0x7f297c0c9d00 2023-11-20T07:01:22.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fd13fb1d640 1 -- 172.21.15.88:0/3841218956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd138164520 msgr2=0x7fd1380ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fd13fb1d640 1 --2- 172.21.15.88:0/3841218956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd138164520 0x7fd1380ce010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1340097c0 tx=0x7fd13401c450 comp rx=0 tx=0).stop 2023-11-20T07:01:22.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fe31effd640 1 -- 172.21.15.88:0/2557342715 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3843266494 0 0) 0x7fe308003530 con 0x7fe320164520 2023-11-20T07:01:22.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f5b2e7fc640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5b1c066570 0x7f5b1c068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f5b2e7fc640 1 -- 172.21.15.88:0/1514466529 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b30083fd0 con 0x7f5b38161150 2023-11-20T07:01:22.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fe31f7fe640 1 -- 172.21.15.88:0/2557342715 >> v2:172.21.15.88:3300/0 conn(0x7fe3200b07f0 msgr2=0x7fe3200cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:22.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fe31f7fe640 1 --2- 172.21.15.88:0/2557342715 >> v2:172.21.15.88:3300/0 conn(0x7fe3200b07f0 0x7fe3200cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fec9846b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fec90164520 0x7fec900ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fec9846b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec900c96f0 con 0x7fec900ad960 2023-11-20T07:01:22.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fec9846b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec900cb950 con 0x7fec900b07f0 2023-11-20T07:01:22.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fec9846b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec90164900 con 0x7fec90164520 2023-11-20T07:01:22.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f352c994640 1 -- start start 2023-11-20T07:01:22.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fd13fb1d640 1 -- 172.21.15.88:0/3841218956 shutdown_connections 2023-11-20T07:01:22.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fd13fb1d640 1 --2- 172.21.15.88:0/3841218956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1380b07f0 0x7fd1380cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fd13fb1d640 1 --2- 172.21.15.88:0/3841218956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd138164520 0x7fd1380ce010 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fd13fb1d640 1 -- 172.21.15.88:0/3841218956 >> 172.21.15.88:0/3841218956 conn(0x7fd13806c190 msgr2=0x7fd13806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fe31f7fe640 1 -- 172.21.15.88:0/2557342715 >> v1:172.21.15.175:6789/0 conn(0x7fe320164520 legacy=0x7fe3200b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fe31f7fe640 1 -- 172.21.15.88:0/2557342715 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3200cbed0 con 0x7fe3200ad960 2023-11-20T07:01:22.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fec96207640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fec90164520 0x7fec900ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fec96207640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fec90164520 0x7fec900ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36270/0 (socket says 172.21.15.88:36270) 2023-11-20T07:01:22.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fec96207640 1 -- 172.21.15.88:0/3691612759 learned_addr learned my addr 172.21.15.88:0/3691612759 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:22.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f2983417640 1 -- 172.21.15.88:0/1136539000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f297c0c9d00 msgr2=0x7f297c0cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f2983417640 1 --2- 172.21.15.88:0/1136539000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f297c0c9d00 0x7f297c0cc980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2974009d90 tx=0x7f2974020a60 comp rx=0 tx=0).stop 2023-11-20T07:01:22.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f888259c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f88840d3550 0x7f88840cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.450+0000 7f8882d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888415ca70 0x7f88840d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f888359e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f88840cf5d0 0x7f88840d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52582/0 (socket says 172.21.15.88:52582) 2023-11-20T07:01:22.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f888359e640 1 -- 172.21.15.88:0/1449942013 learned_addr learned my addr 172.21.15.88:0/1449942013 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:22.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f2983417640 1 -- 172.21.15.88:0/1136539000 shutdown_connections 2023-11-20T07:01:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f2983417640 1 --2- 172.21.15.88:0/1136539000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f297c0c9d00 0x7f297c0cc980 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f2983417640 1 -- 172.21.15.88:0/1136539000 >> 172.21.15.88:0/1136539000 conn(0x7f297c06c190 msgr2=0x7f297c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fd13fb1d640 1 -- 172.21.15.88:0/3841218956 shutdown_connections 2023-11-20T07:01:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fec96207640 1 -- 172.21.15.88:0/3691612759 >> v1:172.21.15.175:6789/0 conn(0x7fec900b07f0 legacy=0x7fec900cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fec96207640 1 -- 172.21.15.88:0/3691612759 >> v1:172.21.15.88:6789/0 conn(0x7fec900ad960 legacy=0x7fec900b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fec96207640 1 -- 172.21.15.88:0/3691612759 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec900cbed0 con 0x7fec90164520 2023-11-20T07:01:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7fd13fb1d640 1 -- 172.21.15.88:0/3841218956 wait complete. 2023-11-20T07:01:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f352c994640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35280cae00 0x7f35281582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f352c994640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35280ce570 0x7f35281f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f888259c640 1 -- 172.21.15.88:0/1449942013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888415ca70 msgr2=0x7f88840d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f888259c640 1 --2- 172.21.15.88:0/1449942013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888415ca70 0x7f88840d3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f2983417640 1 -- 172.21.15.88:0/1136539000 shutdown_connections 2023-11-20T07:01:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f888259c640 1 -- 172.21.15.88:0/1449942013 >> v1:172.21.15.88:6789/0 conn(0x7f88840cf5d0 legacy=0x7f88840d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f888259c640 1 -- 172.21.15.88:0/1449942013 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88840cdf80 con 0x7f88840d3550 2023-11-20T07:01:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.454+0000 7f2983417640 1 -- 172.21.15.88:0/1136539000 wait complete. 2023-11-20T07:01:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f5b3d960640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5b1c066570 0x7f5b1c068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f352659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35280cae00 0x7f35281582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3525d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35280ce570 0x7f35281f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3525d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35280ce570 0x7f35281f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54208/0 (socket says 172.21.15.88:54208) 2023-11-20T07:01:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f352659c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35280cae00 0x7f35281582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36282/0 (socket says 172.21.15.88:36282) 2023-11-20T07:01:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3525d9b640 1 -- 172.21.15.88:0/1438777543 learned_addr learned my addr 172.21.15.88:0/1438777543 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f352c994640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35280ce950 0x7f35280b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7fd13fb1d640 1 Processor -- start 2023-11-20T07:01:22.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7fd13fb1d640 1 -- start start 2023-11-20T07:01:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352815b630 con 0x7f35280ce570 2023-11-20T07:01:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3528141260 con 0x7f35280cae00 2023-11-20T07:01:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35280b2bd0 con 0x7f35280ce950 2023-11-20T07:01:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3526d9d640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35280ce950 0x7f35280b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3526d9d640 1 -- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35280cae00 msgr2=0x7f35281582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3526d9d640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35280cae00 0x7f35281582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3526d9d640 1 -- 172.21.15.88:0/1438777543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35280ce570 msgr2=0x7f35281f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3526d9d640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35280ce570 0x7f35281f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3526d9d640 1 -- 172.21.15.88:0/1438777543 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351800d970 con 0x7f35280ce950 2023-11-20T07:01:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f2983417640 1 Processor -- start 2023-11-20T07:01:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f2983417640 1 -- start start 2023-11-20T07:01:22.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3526d9d640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35280ce950 0x7f35280b3060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f352000c730 tx=0x7f352000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7fd13fb1d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1380ad960 0x7fd1380c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7fd13fb1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1380b07f0 0x7fd13814fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7fe31f7fe640 1 --2- 172.21.15.88:0/2557342715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3200ad960 0x7fe3200ce010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3140097c0 tx=0x7fe31401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f8524e37e5edf4f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3516ffd640 1 -- 172.21.15.88:0/1438777543 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520006d60 con 0x7f35280ce950 2023-11-20T07:01:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3516ffd640 1 -- 172.21.15.88:0/1438777543 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3520003980 con 0x7f35280ce950 2023-11-20T07:01:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7fd13fb1d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd138164520 0x7fd1380c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f3516ffd640 1 -- 172.21.15.88:0/1438777543 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520003d50 con 0x7f35280ce950 2023-11-20T07:01:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.458+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352815b070 con 0x7f35280ce950 2023-11-20T07:01:22.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13d0b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1380b07f0 0x7fd13814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13fb1d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd138159ad0 con 0x7fd1380b07f0 2023-11-20T07:01:22.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f5b3d960640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5b1c066570 0x7f5b1c068a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b340010f0 tx=0x7f5b34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13fb1d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1381591a0 con 0x7fd138164520 2023-11-20T07:01:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13fb1d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd138159480 con 0x7fd1380ad960 2023-11-20T07:01:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fe31effd640 1 -- 172.21.15.88:0/2557342715 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310001680 con 0x7fe3200ad960 2023-11-20T07:01:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fe31effd640 1 -- 172.21.15.88:0/2557342715 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3140a7050 con 0x7fe3200ad960 2023-11-20T07:01:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fe31effd640 1 -- 172.21.15.88:0/2557342715 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140ab620 con 0x7fe3200ad960 2023-11-20T07:01:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13d0b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1380b07f0 0x7fd13814fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54220/0 (socket says 172.21.15.88:54220) 2023-11-20T07:01:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13d0b8640 1 -- 172.21.15.88:0/4207137368 learned_addr learned my addr 172.21.15.88:0/4207137368 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:22.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13e0ba640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd138164520 0x7fd1380c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13d8b9640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1380ad960 0x7fd1380c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f888259c640 1 --2- 172.21.15.88:0/1449942013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88840d3550 0x7f88840cf090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88780097f0 tx=0x7f887801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f978b303e0829d30 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13e0ba640 1 -- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1380ad960 msgr2=0x7fd1380c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13e0ba640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1380ad960 0x7fd1380c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13e0ba640 1 -- 172.21.15.88:0/4207137368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1380b07f0 msgr2=0x7fd13814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13e0ba640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1380b07f0 0x7fd13814fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13e0ba640 1 -- 172.21.15.88:0/4207137368 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134009420 con 0x7fd138164520 2023-11-20T07:01:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f8881d9b640 1 -- 172.21.15.88:0/1449942013 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88780ab650 con 0x7f88840d3550 2023-11-20T07:01:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f2983417640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f297c0c9920 0x7f297c159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f8881d9b640 1 -- 172.21.15.88:0/1449942013 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88780ab7b0 con 0x7f88840d3550 2023-11-20T07:01:22.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f8881d9b640 1 -- 172.21.15.88:0/1449942013 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88780abb40 con 0x7f88840d3550 2023-11-20T07:01:22.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f2983417640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f297c0c9d00 0x7f297c156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f2983417640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f297c0ccec0 0x7f297c202370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35281f5f50 con 0x7f35280ce950 2023-11-20T07:01:22.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13e0ba640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd138164520 0x7fd1380c5730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd13000eb50 tx=0x7fd13000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd12e7fc640 1 -- 172.21.15.88:0/4207137368 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13000cd20 con 0x7fd138164520 2023-11-20T07:01:22.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd12e7fc640 1 -- 172.21.15.88:0/4207137368 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13000f040 con 0x7fd138164520 2023-11-20T07:01:22.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd12e7fc640 1 -- 172.21.15.88:0/4207137368 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13000cea0 con 0x7fd138164520 2023-11-20T07:01:22.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13fb1d640 1 -- 172.21.15.88:0/4207137368 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd138159760 con 0x7fd138164520 2023-11-20T07:01:22.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fd13fb1d640 1 -- 172.21.15.88:0/4207137368 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1380c4c20 con 0x7fd138164520 2023-11-20T07:01:22.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f2983417640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c1597d0 con 0x7f297c0c9920 2023-11-20T07:01:22.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fe326279640 1 -- 172.21.15.88:0/2557342715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3200ad960 msgr2=0x7fe3200ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7fe326279640 1 --2- 172.21.15.88:0/2557342715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3200ad960 0x7fe3200ce010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3140097c0 tx=0x7fe31401c370 comp rx=0 tx=0).stop 2023-11-20T07:01:22.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f5b2e7fc640 1 -- 172.21.15.88:0/1514466529 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b380c5970 con 0x7f5b38161150 2023-11-20T07:01:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f2983417640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c0c1f40 con 0x7f297c0c9d00 2023-11-20T07:01:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f2983417640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297c159a00 con 0x7f297c0ccec0 2023-11-20T07:01:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f29809b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f297c0c9d00 0x7f297c156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f29809b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f297c0c9d00 0x7f297c156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36300/0 (socket says 172.21.15.88:36300) 2023-11-20T07:01:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f8889017640 1 -- 172.21.15.88:0/1449942013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88840d3550 msgr2=0x7f88840cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f8889017640 1 --2- 172.21.15.88:0/1449942013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88840d3550 0x7f88840cf090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88780097f0 tx=0x7f887801c450 comp rx=0 tx=0).stop 2023-11-20T07:01:22.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f29809b2640 1 -- 172.21.15.88:0/3706916804 learned_addr learned my addr 172.21.15.88:0/3706916804 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:22.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35280b29a0 con 0x7f35280ce950 2023-11-20T07:01:22.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f29811b3640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f297c0c9920 0x7f297c159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.462+0000 7f29819b4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f297c0ccec0 0x7f297c202370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fe326279640 1 -- 172.21.15.88:0/2557342715 shutdown_connections 2023-11-20T07:01:22.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fe326279640 1 --2- 172.21.15.88:0/2557342715 >> v2:172.21.15.88:3300/0 conn(0x7fe3200b07f0 0x7fe3200cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f8889017640 1 -- 172.21.15.88:0/1449942013 shutdown_connections 2023-11-20T07:01:22.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f8889017640 1 --2- 172.21.15.88:0/1449942013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88840d3550 0x7f88840cf090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f8889017640 1 --2- 172.21.15.88:0/1449942013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888415ca70 0x7f88840d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fe326279640 1 --2- 172.21.15.88:0/2557342715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3200ad960 0x7fe3200ce010 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fe326279640 1 -- 172.21.15.88:0/2557342715 >> 172.21.15.88:0/2557342715 conn(0x7fe32006c190 msgr2=0x7fe32006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f8889017640 1 -- 172.21.15.88:0/1449942013 >> 172.21.15.88:0/1449942013 conn(0x7f888409bc50 msgr2=0x7f88840d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f3516ffd640 1 -- 172.21.15.88:0/1438777543 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f35200050d0 con 0x7f35280ce950 2023-11-20T07:01:22.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fe326279640 1 -- 172.21.15.88:0/2557342715 shutdown_connections 2023-11-20T07:01:22.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fe326279640 1 -- 172.21.15.88:0/2557342715 wait complete. 2023-11-20T07:01:22.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fd13fb1d640 1 -- 172.21.15.88:0/4207137368 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd138159c40 con 0x7fd138164520 2023-11-20T07:01:22.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f8889017640 1 -- 172.21.15.88:0/1449942013 shutdown_connections 2023-11-20T07:01:22.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fec96207640 1 --2- 172.21.15.88:0/3691612759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec90164520 0x7fec900ce010 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009870 tx=0x7fec8c01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6df084c35b782407 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fec95205640 1 -- 172.21.15.88:0/3691612759 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0aa610 con 0x7fec90164520 2023-11-20T07:01:22.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fec95205640 1 -- 172.21.15.88:0/3691612759 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c0a6040 con 0x7fec90164520 2023-11-20T07:01:22.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fec95205640 1 -- 172.21.15.88:0/3691612759 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0aa990 con 0x7fec90164520 2023-11-20T07:01:22.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f29819b4640 1 -- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f297c0c9d00 msgr2=0x7f297c156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f29819b4640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f297c0c9d00 0x7f297c156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f29819b4640 1 -- 172.21.15.88:0/3706916804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f297c0c9920 msgr2=0x7f297c159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f29819b4640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f297c0c9920 0x7f297c159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f29819b4640 1 -- 172.21.15.88:0/3706916804 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2974009a70 con 0x7f297c0ccec0 2023-11-20T07:01:22.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fd12e7fc640 1 -- 172.21.15.88:0/4207137368 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd1300146c0 con 0x7fd138164520 2023-11-20T07:01:22.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f3516ffd640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f35080664f0 0x7f35080689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f3516ffd640 1 -- 172.21.15.88:0/1438777543 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35200832f0 con 0x7f35280ce950 2023-11-20T07:01:22.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f8889017640 1 -- 172.21.15.88:0/1449942013 wait complete. 2023-11-20T07:01:22.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f352659c640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f35080664f0 0x7f35080689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fec9846b640 1 -- 172.21.15.88:0/3691612759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec90164520 msgr2=0x7fec900ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fec9846b640 1 --2- 172.21.15.88:0/3691612759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec90164520 0x7fec900ce010 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009870 tx=0x7fec8c01c490 comp rx=0 tx=0).stop 2023-11-20T07:01:22.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fec9846b640 1 -- 172.21.15.88:0/3691612759 shutdown_connections 2023-11-20T07:01:22.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fd12e7fc640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd11c0664a0 0x7fd11c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fec9846b640 1 --2- 172.21.15.88:0/3691612759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec90164520 0x7fec900ce010 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fec9846b640 1 -- 172.21.15.88:0/3691612759 >> 172.21.15.88:0/3691612759 conn(0x7fec9006c190 msgr2=0x7fec9006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fd12e7fc640 1 -- 172.21.15.88:0/4207137368 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd130084e90 con 0x7fd138164520 2023-11-20T07:01:22.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f29819b4640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f297c0ccec0 0x7f297c202370 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f296c00c3c0 tx=0x7f296c001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fec9846b640 1 -- 172.21.15.88:0/3691612759 shutdown_connections 2023-11-20T07:01:22.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fd13d8b9640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd11c0664a0 0x7fd11c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7fec9846b640 1 -- 172.21.15.88:0/3691612759 wait complete. 2023-11-20T07:01:22.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.466+0000 7f8889017640 1 Processor -- start 2023-11-20T07:01:22.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fe326279640 1 Processor -- start 2023-11-20T07:01:22.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fd13d8b9640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd11c0664a0 0x7fd11c068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd1340af000 tx=0x7fd1340a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f352659c640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f35080664f0 0x7f35080689b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f35180b5000 tx=0x7f3518008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f8889017640 1 -- start start 2023-11-20T07:01:22.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fe326279640 1 -- start start 2023-11-20T07:01:22.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fec9846b640 1 Processor -- start 2023-11-20T07:01:22.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f3516ffd640 1 -- 172.21.15.88:0/1438777543 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f35280b29a0 con 0x7f35280ce950 2023-11-20T07:01:22.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f8889017640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88840cf5d0 0x7f88840c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fec9846b640 1 -- start start 2023-11-20T07:01:22.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f2971ffb640 1 -- 172.21.15.88:0/3706916804 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c0052d0 con 0x7f297c0ccec0 2023-11-20T07:01:22.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f2971ffb640 1 -- 172.21.15.88:0/3706916804 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296c005450 con 0x7f297c0ccec0 2023-11-20T07:01:22.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f2971ffb640 1 -- 172.21.15.88:0/3706916804 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c003840 con 0x7f297c0ccec0 2023-11-20T07:01:22.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f2983417640 1 -- 172.21.15.88:0/3706916804 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c159ce0 con 0x7f297c0ccec0 2023-11-20T07:01:22.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fe326279640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3200ad960 0x7fe3200b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fe326279640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3200b07f0 0x7fe3200b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fe326279640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe320164520 0x7fe3200c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fe326279640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200b1a80 con 0x7fe3200b07f0 2023-11-20T07:01:22.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fe326279640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200b1d60 con 0x7fe3200ad960 2023-11-20T07:01:22.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fe326279640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200b2040 con 0x7fe320164520 2023-11-20T07:01:22.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f2983417640 1 -- 172.21.15.88:0/3706916804 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297c15a2a0 con 0x7f297c0ccec0 2023-11-20T07:01:22.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f8889017640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88840d3550 0x7f88841520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f8889017640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888415ca70 0x7f88840c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f8889017640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88840c5ad0 con 0x7f88840d3550 2023-11-20T07:01:22.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f8889017640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888415b580 con 0x7f88840cf5d0 2023-11-20T07:01:22.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f8889017640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888415c3e0 con 0x7f888415ca70 2023-11-20T07:01:22.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fec9846b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec900ad960 0x7fec900c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fec9846b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec900b07f0 0x7fec900b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fe31f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3200b07f0 0x7fe3200b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fe31f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3200b07f0 0x7fe3200b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54242/0 (socket says 172.21.15.88:54242) 2023-11-20T07:01:22.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fe31f7fe640 1 -- 172.21.15.88:0/3429669048 learned_addr learned my addr 172.21.15.88:0/3429669048 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:22.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fd12e7fc640 1 -- 172.21.15.88:0/4207137368 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd130051f80 con 0x7fd138164520 2023-11-20T07:01:22.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f888259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88840d3550 0x7f88841520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f888259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88840d3550 0x7f88841520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54254/0 (socket says 172.21.15.88:54254) 2023-11-20T07:01:22.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7f888259c640 1 -- 172.21.15.88:0/2927767805 learned_addr learned my addr 172.21.15.88:0/2927767805 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:22.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7f8882d9d640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88840cf5d0 0x7f88840c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fe31f7fe640 1 -- 172.21.15.88:0/3429669048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe320164520 msgr2=0x7fe3200c2170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-20T07:01:22.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fe31f7fe640 1 --2- 172.21.15.88:0/3429669048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe320164520 0x7fe3200c2170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fe31f7fe640 1 -- 172.21.15.88:0/3429669048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3200ad960 msgr2=0x7fe3200b13f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-20T07:01:22.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fe31f7fe640 1 --2- 172.21.15.88:0/3429669048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3200ad960 0x7fe3200b13f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fe31f7fe640 1 -- 172.21.15.88:0/3429669048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314009420 con 0x7fe3200b07f0 2023-11-20T07:01:22.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.470+0000 7fec96207640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec900ad960 0x7fec900c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7f2983417640 1 -- 172.21.15.88:0/3706916804 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297c074010 con 0x7f297c0ccec0 2023-11-20T07:01:22.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7f888259c640 1 -- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888415ca70 msgr2=0x7f88840c7fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-20T07:01:22.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fe31f7fe640 1 --2- 172.21.15.88:0/3429669048 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3200b07f0 0x7fe3200b2b20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe31401aa20 tx=0x7fe314019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fe31cff9640 1 -- 172.21.15.88:0/3429669048 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140b4610 con 0x7fe3200b07f0 2023-11-20T07:01:22.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fe31cff9640 1 -- 172.21.15.88:0/3429669048 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3140b4770 con 0x7fe3200b07f0 2023-11-20T07:01:22.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fe31cff9640 1 -- 172.21.15.88:0/3429669048 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140b4ae0 con 0x7fe3200b07f0 2023-11-20T07:01:22.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fe326279640 1 -- 172.21.15.88:0/3429669048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3200b2320 con 0x7fe3200b07f0 2023-11-20T07:01:22.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fe326279640 1 -- 172.21.15.88:0/3429669048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3200b3060 con 0x7fe3200b07f0 2023-11-20T07:01:22.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec95a06640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec900b07f0 0x7fec900b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec95a06640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec900b07f0 0x7fec900b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54268/0 (socket says 172.21.15.88:54268) 2023-11-20T07:01:22.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec96207640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec900ad960 0x7fec900c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36334/0 (socket says 172.21.15.88:36334) 2023-11-20T07:01:22.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec9846b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec90164520 0x7fec900c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec9846b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec900c3520 con 0x7fec900b07f0 2023-11-20T07:01:22.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec9846b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec900c57d0 con 0x7fec900ad960 2023-11-20T07:01:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec9846b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec900c5ab0 con 0x7fec90164520 2023-11-20T07:01:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec96207640 1 -- 172.21.15.88:0/1920394324 learned_addr learned my addr 172.21.15.88:0/1920394324 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec96207640 1 -- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec90164520 msgr2=0x7fec900c3b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-20T07:01:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec96207640 1 --2- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec90164520 0x7fec900c3b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec96207640 1 -- 172.21.15.88:0/1920394324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec900b07f0 msgr2=0x7fec900b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec96207640 1 --2- 172.21.15.88:0/1920394324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec900b07f0 0x7fec900b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec96207640 1 -- 172.21.15.88:0/1920394324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c0094d0 con 0x7fec900ad960 2023-11-20T07:01:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec96207640 1 --2- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec900ad960 0x7fec900c8190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0ac040 tx=0x7fec8c01acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec86ffd640 1 -- 172.21.15.88:0/1920394324 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0b3800 con 0x7fec900ad960 2023-11-20T07:01:22.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fe326279640 1 -- 172.21.15.88:0/3429669048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe320074010 con 0x7fe3200b07f0 2023-11-20T07:01:22.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7fec86ffd640 1 -- 172.21.15.88:0/1920394324 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c0aae90 con 0x7fec900ad960 2023-11-20T07:01:22.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7fec9846b640 1 -- 172.21.15.88:0/1920394324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec900c5d90 con 0x7fec900ad960 2023-11-20T07:01:22.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7fec86ffd640 1 -- 172.21.15.88:0/1920394324 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0b3be0 con 0x7fec900ad960 2023-11-20T07:01:22.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7fec9846b640 1 -- 172.21.15.88:0/1920394324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec900b1a80 con 0x7fec900ad960 2023-11-20T07:01:22.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7fe31cff9640 1 -- 172.21.15.88:0/3429669048 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe3140b2040 con 0x7fe3200b07f0 2023-11-20T07:01:22.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7fec9846b640 1 -- 172.21.15.88:0/1920394324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec900b1a80 con 0x7fec900ad960 2023-11-20T07:01:22.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7fe31cff9640 1 --2- 172.21.15.88:0/3429669048 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe30c0664f0 0x7fe30c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7f2971ffb640 1 -- 172.21.15.88:0/3706916804 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f296c0039a0 con 0x7f297c0ccec0 2023-11-20T07:01:22.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7f2971ffb640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2960066570 0x7f2960068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7f2971ffb640 1 -- 172.21.15.88:0/3706916804 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f296c0835f0 con 0x7f297c0ccec0 2023-11-20T07:01:22.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7f29811b3640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2960066570 0x7f2960068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7f29811b3640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2960066570 0x7f2960068a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2978004850 tx=0x7f2978001130 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7f888259c640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888415ca70 0x7f88840c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7f888259c640 1 -- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88840cf5d0 msgr2=0x7f88840c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7f888259c640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88840cf5d0 0x7f88840c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7f888259c640 1 -- 172.21.15.88:0/2927767805 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8878009420 con 0x7f88840d3550 2023-11-20T07:01:22.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7f8882d9d640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88840cf5d0 0x7f88840c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:22.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.474+0000 7f888259c640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88840d3550 0x7f88841520a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f88780ad040 tx=0x7f887801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7f886b7fe640 1 -- 172.21.15.88:0/2927767805 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88780aa980 con 0x7f88840d3550 2023-11-20T07:01:22.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7f886b7fe640 1 -- 172.21.15.88:0/2927767805 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88780aaae0 con 0x7f88840d3550 2023-11-20T07:01:22.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7f886b7fe640 1 -- 172.21.15.88:0/2927767805 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88780aae90 con 0x7f88840d3550 2023-11-20T07:01:22.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7f8889017640 1 -- 172.21.15.88:0/2927767805 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88841525e0 con 0x7f88840d3550 2023-11-20T07:01:22.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7f8889017640 1 -- 172.21.15.88:0/2927767805 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888415bab0 con 0x7f88840d3550 2023-11-20T07:01:22.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7fe31cff9640 1 -- 172.21.15.88:0/3429669048 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe31411e170 con 0x7fe3200b07f0 2023-11-20T07:01:22.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7fec86ffd640 1 -- 172.21.15.88:0/1920394324 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fec8c0b3d40 con 0x7fec900ad960 2023-11-20T07:01:22.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.482+0000 7f2971ffb640 1 -- 172.21.15.88:0/3706916804 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f296c050810 con 0x7f297c0ccec0 2023-11-20T07:01:22.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.478+0000 7f88697fa640 1 -- 172.21.15.88:0/2927767805 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88840b3820 con 0x7f88840d3550 2023-11-20T07:01:22.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.482+0000 7fe31ffff640 1 --2- 172.21.15.88:0/3429669048 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe30c0664f0 0x7fe30c0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.482+0000 7fec86ffd640 1 --2- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fec74066520 0x7fec740689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.482+0000 7fec86ffd640 1 -- 172.21.15.88:0/1920394324 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fec8c11ec40 con 0x7fec900ad960 2023-11-20T07:01:22.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.486+0000 7fe31ffff640 1 --2- 172.21.15.88:0/3429669048 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe30c0664f0 0x7fe30c0689b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe310001390 tx=0x7fe310000ff0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.486+0000 7fec95a06640 1 --2- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fec74066520 0x7fec740689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.486+0000 7fec95a06640 1 --2- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fec74066520 0x7fec740689e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fec900b02d0 tx=0x7fec80009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.486+0000 7fe31cff9640 1 -- 172.21.15.88:0/3429669048 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe3140eb500 con 0x7fe3200b07f0 2023-11-20T07:01:22.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.490+0000 7f886b7fe640 1 -- 172.21.15.88:0/2927767805 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f88780bf410 con 0x7f88840d3550 2023-11-20T07:01:22.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.494+0000 7fec86ffd640 1 -- 172.21.15.88:0/1920394324 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fec8c0ec0a0 con 0x7fec900ad960 2023-11-20T07:01:22.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.494+0000 7f886b7fe640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8870066570 0x7f8870068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:22.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.494+0000 7f886b7fe640 1 -- 172.21.15.88:0/2927767805 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f887811f6c0 con 0x7f88840d3550 2023-11-20T07:01:22.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.498+0000 7f8882d9d640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8870066570 0x7f8870068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:22.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.498+0000 7f8882d9d640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8870066570 0x7f8870068a30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f887400ae10 tx=0x7f8874008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:22.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.506+0000 7f886b7fe640 1 -- 172.21.15.88:0/2927767805 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f88780eca90 con 0x7f88840d3550 2023-11-20T07:01:22.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.714+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faae4073fa0 con 0x7faae40ce950 2023-11-20T07:01:22.715 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-11-20T07:01:22.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.714+0000 7faadaffd640 1 -- 172.21.15.88:0/1734500963 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faad40effe0 con 0x7faae40ce950 2023-11-20T07:01:22.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.718+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faac8066570 msgr2=0x7faac8068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.718+0000 7faaec3b8640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faac8066570 0x7faac8068a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faae0000c10 tx=0x7faae0005780 comp rx=0 tx=0).stop 2023-11-20T07:01:22.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.718+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faae40ce950 msgr2=0x7faae40b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.718+0000 7faaec3b8640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faae40ce950 0x7faae40b2f30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faad40ac000 tx=0x7faad4019220 comp rx=0 tx=0).stop 2023-11-20T07:01:22.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.718+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 shutdown_connections 2023-11-20T07:01:22.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.718+0000 7faaec3b8640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faac8066570 0x7faac8068a30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.718+0000 7faaec3b8640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faae4158c10 0x7faae41feb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.718+0000 7faaec3b8640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faae40ce950 0x7faae40b2f30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.718+0000 7faaec3b8640 1 --2- 172.21.15.88:0/1734500963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae40ce570 0x7faae4159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.718+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 >> 172.21.15.88:0/1734500963 conn(0x7faae406a290 msgr2=0x7faae40cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.718+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 shutdown_connections 2023-11-20T07:01:22.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.718+0000 7faaec3b8640 1 -- 172.21.15.88:0/1734500963 wait complete. 2023-11-20T07:01:22.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-11-20T07:01:22.756 DEBUG:teuthology.parallel:result is None 2023-11-20T07:01:22.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.778+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/1514466529 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5b380c5970 con 0x7f5b38161150 2023-11-20T07:01:22.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.778+0000 7f5b2e7fc640 1 -- 172.21.15.88:0/1514466529 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b380c5970 con 0x7f5b38161150 2023-11-20T07:01:22.780 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-11-20T07:01:22.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5b1c066570 msgr2=0x7f5b1c068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f5b3fbc4640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5b1c066570 0x7f5b1c068a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b340010f0 tx=0x7f5b34009040 comp rx=0 tx=0).stop 2023-11-20T07:01:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/1514466529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b38161150 msgr2=0x7f5b3814bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f5b3fbc4640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b38161150 0x7f5b3814bf70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5b3000c770 tx=0x7f5b3000cc30 comp rx=0 tx=0).stop 2023-11-20T07:01:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/1514466529 shutdown_connections 2023-11-20T07:01:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f5b3fbc4640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5b1c066570 0x7f5b1c068a30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f5b3fbc4640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b38161150 0x7f5b3814bf70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f5b3fbc4640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b3815ff70 0x7f5b3814ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f5b3fbc4640 1 --2- 172.21.15.88:0/1514466529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b380cdde0 0x7f5b3814b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/1514466529 >> 172.21.15.88:0/1514466529 conn(0x7f5b3806a290 msgr2=0x7f5b380c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/1514466529 shutdown_connections 2023-11-20T07:01:22.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f5b3fbc4640 1 -- 172.21.15.88:0/1514466529 wait complete. 2023-11-20T07:01:22.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.782+0000 7f2983417640 1 -- 172.21.15.88:0/3706916804 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f297c0cc760 con 0x7f297c0ccec0 2023-11-20T07:01:22.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2971ffb640 1 -- 172.21.15.88:0/3706916804 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f296c053e30 con 0x7f297c0ccec0 2023-11-20T07:01:22.786 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-11-20T07:01:22.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2983417640 1 -- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2960066570 msgr2=0x7f2960068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2983417640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2960066570 0x7f2960068a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2978004850 tx=0x7f2978001130 comp rx=0 tx=0).stop 2023-11-20T07:01:22.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2983417640 1 -- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f297c0ccec0 msgr2=0x7f297c202370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2983417640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f297c0ccec0 0x7f297c202370 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f296c00c3c0 tx=0x7f296c001e80 comp rx=0 tx=0).stop 2023-11-20T07:01:22.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2983417640 1 -- 172.21.15.88:0/3706916804 shutdown_connections 2023-11-20T07:01:22.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2983417640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2960066570 0x7f2960068a30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2983417640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f297c0ccec0 0x7f297c202370 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2983417640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f297c0c9d00 0x7f297c156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2983417640 1 --2- 172.21.15.88:0/3706916804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f297c0c9920 0x7f297c159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2983417640 1 -- 172.21.15.88:0/3706916804 >> 172.21.15.88:0/3706916804 conn(0x7f297c06c190 msgr2=0x7f297c0712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2983417640 1 -- 172.21.15.88:0/3706916804 shutdown_connections 2023-11-20T07:01:22.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.786+0000 7f2983417640 1 -- 172.21.15.88:0/3706916804 wait complete. 2023-11-20T07:01:22.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.798+0000 7fd13fb1d640 1 -- 172.21.15.88:0/4207137368 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd1381592e0 con 0x7fd138164520 2023-11-20T07:01:22.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.798+0000 7fd12e7fc640 1 -- 172.21.15.88:0/4207137368 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1381592e0 con 0x7fd138164520 2023-11-20T07:01:22.801 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-11-20T07:01:22.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.802+0000 7fd13fb1d640 1 -- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd11c0664a0 msgr2=0x7fd11c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.802+0000 7fd13fb1d640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd11c0664a0 0x7fd11c068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd1340af000 tx=0x7fd1340a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:22.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.802+0000 7fd13fb1d640 1 -- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd138164520 msgr2=0x7fd1380c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.802+0000 7fd13fb1d640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd138164520 0x7fd1380c5730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd13000eb50 tx=0x7fd13000c490 comp rx=0 tx=0).stop 2023-11-20T07:01:22.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.802+0000 7fd13fb1d640 1 -- 172.21.15.88:0/4207137368 shutdown_connections 2023-11-20T07:01:22.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.802+0000 7fd13fb1d640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd11c0664a0 0x7fd11c068960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.802+0000 7fd13fb1d640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd138164520 0x7fd1380c5730 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.802+0000 7fd13fb1d640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1380b07f0 0x7fd13814fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.802+0000 7fd13fb1d640 1 --2- 172.21.15.88:0/4207137368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd1380ad960 0x7fd1380c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.802+0000 7fd13fb1d640 1 -- 172.21.15.88:0/4207137368 >> 172.21.15.88:0/4207137368 conn(0x7fd13806c190 msgr2=0x7fd1380af710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.802+0000 7fd13fb1d640 1 -- 172.21.15.88:0/4207137368 shutdown_connections 2023-11-20T07:01:22.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.802+0000 7fd13fb1d640 1 -- 172.21.15.88:0/4207137368 wait complete. 2023-11-20T07:01:22.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.810+0000 7fe326279640 1 -- 172.21.15.88:0/3429669048 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe3200b27d0 con 0x7fe3200b07f0 2023-11-20T07:01:22.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.810+0000 7fe31cff9640 1 -- 172.21.15.88:0/3429669048 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe3140b0090 con 0x7fe3200b07f0 2023-11-20T07:01:22.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.810+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f352815d510 con 0x7f35280ce950 2023-11-20T07:01:22.810 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2023-11-20T07:01:22.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.810+0000 7f3516ffd640 1 -- 172.21.15.88:0/1438777543 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f352815d510 con 0x7f35280ce950 2023-11-20T07:01:22.811 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-11-20T07:01:22.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f35080664f0 msgr2=0x7f35080689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7f352c994640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f35080664f0 0x7f35080689b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f35180b5000 tx=0x7f3518008040 comp rx=0 tx=0).stop 2023-11-20T07:01:22.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35280ce950 msgr2=0x7f35280b3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7f352c994640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35280ce950 0x7f35280b3060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f352000c730 tx=0x7f352000cbf0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2023-11-20T07:01:22.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fe326279640 1 -- 172.21.15.88:0/3429669048 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe30c0664f0 msgr2=0x7fe30c0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fe326279640 1 --2- 172.21.15.88:0/3429669048 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe30c0664f0 0x7fe30c0689b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe310001390 tx=0x7fe310000ff0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fe326279640 1 -- 172.21.15.88:0/3429669048 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3200b07f0 msgr2=0x7fe3200b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fe326279640 1 --2- 172.21.15.88:0/3429669048 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3200b07f0 0x7fe3200b2b20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe31401aa20 tx=0x7fe314019110 comp rx=0 tx=0).stop 2023-11-20T07:01:22.815 DEBUG:teuthology.parallel:result is None 2023-11-20T07:01:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 shutdown_connections 2023-11-20T07:01:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7f352c994640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f35080664f0 0x7f35080689b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7f352c994640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35280ce950 0x7f35280b3060 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7f352c994640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35280ce570 0x7f35281f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7f352c994640 1 --2- 172.21.15.88:0/1438777543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35280cae00 0x7f35281582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 >> 172.21.15.88:0/1438777543 conn(0x7f352806a290 msgr2=0x7f3528155d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fe326279640 1 -- 172.21.15.88:0/3429669048 shutdown_connections 2023-11-20T07:01:22.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fe326279640 1 --2- 172.21.15.88:0/3429669048 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe30c0664f0 0x7fe30c0689b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fe326279640 1 --2- 172.21.15.88:0/3429669048 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe320164520 0x7fe3200c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fe326279640 1 --2- 172.21.15.88:0/3429669048 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3200b07f0 0x7fe3200b2b20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fe326279640 1 --2- 172.21.15.88:0/3429669048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3200ad960 0x7fe3200b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fe326279640 1 -- 172.21.15.88:0/3429669048 >> 172.21.15.88:0/3429669048 conn(0x7fe32006c190 msgr2=0x7fe32015bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 shutdown_connections 2023-11-20T07:01:22.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fe326279640 1 -- 172.21.15.88:0/3429669048 shutdown_connections 2023-11-20T07:01:22.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fe326279640 1 -- 172.21.15.88:0/3429669048 wait complete. 2023-11-20T07:01:22.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7f352c994640 1 -- 172.21.15.88:0/1438777543 wait complete. 2023-11-20T07:01:22.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.814+0000 7fec9846b640 1 -- 172.21.15.88:0/1920394324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fec900b1a80 con 0x7fec900ad960 2023-11-20T07:01:22.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec86ffd640 1 -- 172.21.15.88:0/1920394324 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec8c0ef6c0 con 0x7fec900ad960 2023-11-20T07:01:22.820 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-11-20T07:01:22.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-11-20T07:01:22.821 DEBUG:teuthology.parallel:result is None 2023-11-20T07:01:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec9846b640 1 -- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fec74066520 msgr2=0x7fec740689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec9846b640 1 --2- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fec74066520 0x7fec740689e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fec900b02d0 tx=0x7fec80009060 comp rx=0 tx=0).stop 2023-11-20T07:01:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec9846b640 1 -- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec900ad960 msgr2=0x7fec900c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec9846b640 1 --2- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec900ad960 0x7fec900c8190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0ac040 tx=0x7fec8c01acd0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec9846b640 1 -- 172.21.15.88:0/1920394324 shutdown_connections 2023-11-20T07:01:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec9846b640 1 --2- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fec74066520 0x7fec740689e0 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fec900b02d0 tx=0x7fec80009060 comp rx=0 tx=0).stop 2023-11-20T07:01:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec9846b640 1 --2- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec90164520 0x7fec900c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec9846b640 1 --2- 172.21.15.88:0/1920394324 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec900b07f0 0x7fec900b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec9846b640 1 --2- 172.21.15.88:0/1920394324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec900ad960 0x7fec900c8190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec9846b640 1 -- 172.21.15.88:0/1920394324 >> 172.21.15.88:0/1920394324 conn(0x7fec9006c190 msgr2=0x7fec900aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec9846b640 1 -- 172.21.15.88:0/1920394324 shutdown_connections 2023-11-20T07:01:22.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.818+0000 7fec9846b640 1 -- 172.21.15.88:0/1920394324 wait complete. 2023-11-20T07:01:22.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.830+0000 7f88697fa640 1 -- 172.21.15.88:0/2927767805 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8884074010 con 0x7f88840d3550 2023-11-20T07:01:22.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f886b7fe640 1 -- 172.21.15.88:0/2927767805 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88780f00b0 con 0x7f88840d3550 2023-11-20T07:01:22.833 INFO:teuthology.orchestra.run.smithi088.stdout:55834574860 2023-11-20T07:01:22.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f88697fa640 1 -- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8870066570 msgr2=0x7f8870068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f88697fa640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8870066570 0x7f8870068a30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f887400ae10 tx=0x7f8874008040 comp rx=0 tx=0).stop 2023-11-20T07:01:22.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f88697fa640 1 -- 172.21.15.88:0/2927767805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88840d3550 msgr2=0x7f88841520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:22.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f88697fa640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88840d3550 0x7f88841520a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f88780ad040 tx=0x7f887801ac90 comp rx=0 tx=0).stop 2023-11-20T07:01:22.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f88697fa640 1 -- 172.21.15.88:0/2927767805 shutdown_connections 2023-11-20T07:01:22.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f88697fa640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8870066570 0x7f8870068a30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f88697fa640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f888415ca70 0x7f88840c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f88697fa640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88840d3550 0x7f88841520a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f88697fa640 1 --2- 172.21.15.88:0/2927767805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88840cf5d0 0x7f88840c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:22.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f88697fa640 1 -- 172.21.15.88:0/2927767805 >> 172.21.15.88:0/2927767805 conn(0x7f888409bc50 msgr2=0x7f8884158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:22.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f88697fa640 1 -- 172.21.15.88:0/2927767805 shutdown_connections 2023-11-20T07:01:22.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:22.834+0000 7f88697fa640 1 -- 172.21.15.88:0/2927767805 wait complete. 2023-11-20T07:01:22.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-11-20T07:01:22.838 DEBUG:teuthology.parallel:result is None 2023-11-20T07:01:22.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2023-11-20T07:01:22.842 DEBUG:teuthology.parallel:result is None 2023-11-20T07:01:22.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-11-20T07:01:22.843 DEBUG:teuthology.parallel:result is None 2023-11-20T07:01:22.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-11-20T07:01:22.847 DEBUG:teuthology.parallel:result is None 2023-11-20T07:01:22.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.4 2023-11-20T07:01:22.858 DEBUG:teuthology.parallel:result is None 2023-11-20T07:01:22.858 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-20T07:01:22.858 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T07:01:23.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82dfa7640 1 Processor -- start 2023-11-20T07:01:23.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82dfa7640 1 -- start start 2023-11-20T07:01:23.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82dfa7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa82815c980 0x7fa82806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82dfa7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82815cd60 0x7fa8280b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82dfa7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8280d3510 con 0x7fa8280d0d80 2023-11-20T07:01:23.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82dfa7640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8280cd2b0 con 0x7fa82815c980 2023-11-20T07:01:23.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82dfa7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8280d2f50 con 0x7fa82815cd60 2023-11-20T07:01:23.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82cfa5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa82815c980 0x7fa82806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82cfa5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa82815c980 0x7fa82806af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54270/0 (socket says 172.21.15.88:54270) 2023-11-20T07:01:23.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82cfa5640 1 -- 172.21.15.88:0/2655851989 learned_addr learned my addr 172.21.15.88:0/2655851989 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:23.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82cfa5640 1 -- 172.21.15.88:0/2655851989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82815cd60 msgr2=0x7fa8280b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:23.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82cfa5640 1 --2- 172.21.15.88:0/2655851989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82815cd60 0x7fa8280b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82cfa5640 1 -- 172.21.15.88:0/2655851989 >> v1:172.21.15.175:6789/0 conn(0x7fa8280d0d80 legacy=0x7fa8280cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:23.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.042+0000 7fa82cfa5640 1 -- 172.21.15.88:0/2655851989 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8280d3230 con 0x7fa82815c980 2023-11-20T07:01:23.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.046+0000 7fa82cfa5640 1 --2- 172.21.15.88:0/2655851989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82815c980 0x7fa82806af90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa824006fd0 tx=0x7fa82401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c3ddfd11374a1e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:23.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.046+0000 7fa81f7fe640 1 -- 172.21.15.88:0/2655851989 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8240ac410 con 0x7fa82815c980 2023-11-20T07:01:23.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.046+0000 7fa81f7fe640 1 -- 172.21.15.88:0/2655851989 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8240ac570 con 0x7fa82815c980 2023-11-20T07:01:23.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.046+0000 7fa81f7fe640 1 -- 172.21.15.88:0/2655851989 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8240ac900 con 0x7fa82815c980 2023-11-20T07:01:23.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.046+0000 7fa82dfa7640 1 -- 172.21.15.88:0/2655851989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82815c980 msgr2=0x7fa82806af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.046+0000 7fa82dfa7640 1 --2- 172.21.15.88:0/2655851989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82815c980 0x7fa82806af90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa824006fd0 tx=0x7fa82401c4e0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.046+0000 7fa82dfa7640 1 -- 172.21.15.88:0/2655851989 shutdown_connections 2023-11-20T07:01:23.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.046+0000 7fa82dfa7640 1 --2- 172.21.15.88:0/2655851989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82815cd60 0x7fa8280b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.046+0000 7fa82dfa7640 1 --2- 172.21.15.88:0/2655851989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82815c980 0x7fa82806af90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.046+0000 7fa82dfa7640 1 -- 172.21.15.88:0/2655851989 >> 172.21.15.88:0/2655851989 conn(0x7fa82809ba80 msgr2=0x7fa8280d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:23.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.046+0000 7fa82dfa7640 1 -- 172.21.15.88:0/2655851989 shutdown_connections 2023-11-20T07:01:23.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.046+0000 7fa82dfa7640 1 -- 172.21.15.88:0/2655851989 wait complete. 2023-11-20T07:01:23.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82dfa7640 1 Processor -- start 2023-11-20T07:01:23.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82dfa7640 1 -- start start 2023-11-20T07:01:23.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82dfa7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8280d0d80 0x7fa8280b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82dfa7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82815c980 0x7fa8280b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82dfa7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82815cd60 0x7fa828156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82dfa7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa828153720 con 0x7fa82815cd60 2023-11-20T07:01:23.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82dfa7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82815ffd0 con 0x7fa8280d0d80 2023-11-20T07:01:23.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82dfa7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82815fcf0 con 0x7fa82815c980 2023-11-20T07:01:23.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82d7a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82815cd60 0x7fa828156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82d7a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82815cd60 0x7fa828156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54280/0 (socket says 172.21.15.88:54280) 2023-11-20T07:01:23.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82d7a6640 1 -- 172.21.15.88:0/1157507222 learned_addr learned my addr 172.21.15.88:0/1157507222 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:23.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82cfa5640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8280d0d80 0x7fa8280b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa81ffff640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82815c980 0x7fa8280b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82d7a6640 1 -- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82815c980 msgr2=0x7fa8280b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82d7a6640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82815c980 0x7fa8280b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82d7a6640 1 -- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8280d0d80 msgr2=0x7fa8280b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82d7a6640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8280d0d80 0x7fa8280b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82d7a6640 1 -- 172.21.15.88:0/1157507222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa824009480 con 0x7fa82815cd60 2023-11-20T07:01:23.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa81ffff640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82815c980 0x7fa8280b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:23.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82d7a6640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82815cd60 0x7fa828156520 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa82000c780 tx=0x7fa82000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:23.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa81d7fa640 1 -- 172.21.15.88:0/1157507222 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa820003d90 con 0x7fa82815cd60 2023-11-20T07:01:23.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa81d7fa640 1 -- 172.21.15.88:0/1157507222 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82000ce90 con 0x7fa82815cd60 2023-11-20T07:01:23.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82dfa7640 1 -- 172.21.15.88:0/1157507222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8281530d0 con 0x7fa82815cd60 2023-11-20T07:01:23.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa81d7fa640 1 -- 172.21.15.88:0/1157507222 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8200052b0 con 0x7fa82815cd60 2023-11-20T07:01:23.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.050+0000 7fa82dfa7640 1 -- 172.21.15.88:0/1157507222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa828157ae0 con 0x7fa82815cd60 2023-11-20T07:01:23.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.054+0000 7fa82dfa7640 1 -- 172.21.15.88:0/1157507222 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8281538d0 con 0x7fa82815cd60 2023-11-20T07:01:23.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.054+0000 7fa81d7fa640 1 -- 172.21.15.88:0/1157507222 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa820005410 con 0x7fa82815cd60 2023-11-20T07:01:23.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.054+0000 7fa81d7fa640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8140664a0 0x7fa814068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.054+0000 7fa81d7fa640 1 -- 172.21.15.88:0/1157507222 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa820083910 con 0x7fa82815cd60 2023-11-20T07:01:23.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.054+0000 7fa82cfa5640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8140664a0 0x7fa814068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.054+0000 7fa82cfa5640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8140664a0 0x7fa814068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8240ae000 tx=0x7fa8240a6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:23.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.058+0000 7fa81d7fa640 1 -- 172.21.15.88:0/1157507222 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8281538d0 con 0x7fa82815cd60 2023-11-20T07:01:23.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.202+0000 7fa82dfa7640 1 -- 172.21.15.88:0/1157507222 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8280cfc30 con 0x7fa8140664a0 2023-11-20T07:01:23.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.214+0000 7fa81d7fa640 1 -- 172.21.15.88:0/1157507222 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345280 (secure 0 0 0) 0x7fa8240041a0 con 0x7fa8140664a0 2023-11-20T07:01:23.217 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:23.219 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-20T07:01:23.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.218+0000 7fa82dfa7640 1 -- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8140664a0 msgr2=0x7fa814068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.218+0000 7fa82dfa7640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8140664a0 0x7fa814068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa8240ae000 tx=0x7fa8240a6040 comp rx=0 tx=0).stop 2023-11-20T07:01:23.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.218+0000 7fa82dfa7640 1 -- 172.21.15.88:0/1157507222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82815cd60 msgr2=0x7fa828156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.218+0000 7fa82dfa7640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82815cd60 0x7fa828156520 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa82000c780 tx=0x7fa82000cc40 comp rx=0 tx=0).stop 2023-11-20T07:01:23.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.218+0000 7fa82dfa7640 1 -- 172.21.15.88:0/1157507222 shutdown_connections 2023-11-20T07:01:23.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.218+0000 7fa82dfa7640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8140664a0 0x7fa814068960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.218+0000 7fa82dfa7640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa82815c980 0x7fa8280b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.218+0000 7fa82dfa7640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa82815cd60 0x7fa828156520 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.218+0000 7fa82dfa7640 1 --2- 172.21.15.88:0/1157507222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8280d0d80 0x7fa8280b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.218+0000 7fa82dfa7640 1 -- 172.21.15.88:0/1157507222 >> 172.21.15.88:0/1157507222 conn(0x7fa82809ba80 msgr2=0x7fa8281553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.218+0000 7fa82dfa7640 1 -- 172.21.15.88:0/1157507222 shutdown_connections 2023-11-20T07:01:23.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.218+0000 7fa82dfa7640 1 -- 172.21.15.88:0/1157507222 wait complete. 2023-11-20T07:01:23.237 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-11-20T07:01:21.537612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3284992,"data_stored":1988254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003334"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326844+0000","last_change":"2023-11-20T07:00:53.659408+0000","last_active":"2023-11-20T07:00:58.326844+0000","last_peered":"2023-11-20T07:00:58.326844+0000","last_clean":"2023-11-20T07:00:58.326844+0000","last_became_active":"2023-11-20T07:00:53.658981+0000","last_became_peered":"2023-11-20T07:00:53.658981+0000","last_unstale":"2023-11-20T07:00:58.326844+0000","last_undegraded":"2023-11-20T07:00:58.326844+0000","last_fullsized":"2023-11-20T07:00:58.326844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:10.249731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.304069+0000","last_change":"2023-11-20T07:00:54.314501+0000","last_active":"2023-11-20T07:00:58.304069+0000","last_peered":"2023-11-20T07:00:58.304069+0000","last_clean":"2023-11-20T07:00:58.304069+0000","last_became_active":"2023-11-20T07:00:54.314212+0000","last_became_peered":"2023-11-20T07:00:54.314212+0000","last_unstale":"2023-11-20T07:00:58.304069+0000","last_undegraded":"2023-11-20T07:00:58.304069+0000","last_fullsized":"2023-11-20T07:00:58.304069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:43.757635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805339+0000","last_change":"2023-11-20T07:00:58.500585+0000","last_active":"2023-11-20T07:00:59.805339+0000","last_peered":"2023-11-20T07:00:59.805339+0000","last_clean":"2023-11-20T07:00:59.805339+0000","last_became_active":"2023-11-20T07:00:58.500209+0000","last_became_peered":"2023-11-20T07:00:58.500209+0000","last_unstale":"2023-11-20T07:00:59.805339+0000","last_undegraded":"2023-11-20T07:00:59.805339+0000","last_fullsized":"2023-11-20T07:00:59.805339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:10:13.701470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.304262+0000","last_change":"2023-11-20T07:00:53.652110+0000","last_active":"2023-11-20T07:00:58.304262+0000","last_peered":"2023-11-20T07:00:58.304262+0000","last_clean":"2023-11-20T07:00:58.304262+0000","last_became_active":"2023-11-20T07:00:53.651824+0000","last_became_peered":"2023-11-20T07:00:53.651824+0000","last_unstale":"2023-11-20T07:00:58.304262+0000","last_undegraded":"2023-11-20T07:00:58.304262+0000","last_fullsized":"2023-11-20T07:00:58.304262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:16.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326690+0000","last_change":"2023-11-20T07:00:54.318618+0000","last_active":"2023-11-20T07:00:58.326690+0000","last_peered":"2023-11-20T07:00:58.326690+0000","last_clean":"2023-11-20T07:00:58.326690+0000","last_became_active":"2023-11-20T07:00:54.318411+0000","last_became_peered":"2023-11-20T07:00:54.318411+0000","last_unstale":"2023-11-20T07:00:58.326690+0000","last_undegraded":"2023-11-20T07:00:58.326690+0000","last_fullsized":"2023-11-20T07:00:58.326690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:16.073686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307275+0000","last_change":"2023-11-20T07:00:58.320861+0000","last_active":"2023-11-20T07:00:59.307275+0000","last_peered":"2023-11-20T07:00:59.307275+0000","last_clean":"2023-11-20T07:00:59.307275+0000","last_became_active":"2023-11-20T07:00:58.320417+0000","last_became_peered":"2023-11-20T07:00:58.320417+0000","last_unstale":"2023-11-20T07:00:59.307275+0000","last_undegraded":"2023-11-20T07:00:59.307275+0000","last_fullsized":"2023-11-20T07:00:59.307275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:22.712728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494050+0000","last_change":"2023-11-20T07:00:53.656292+0000","last_active":"2023-11-20T07:00:58.494050+0000","last_peered":"2023-11-20T07:00:58.494050+0000","last_clean":"2023-11-20T07:00:58.494050+0000","last_became_active":"2023-11-20T07:00:53.656026+0000","last_became_peered":"2023-11-20T07:00:53.656026+0000","last_unstale":"2023-11-20T07:00:58.494050+0000","last_undegraded":"2023-11-20T07:00:58.494050+0000","last_fullsized":"2023-11-20T07:00:58.494050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:38.340586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317862+0000","last_change":"2023-11-20T07:00:54.322765+0000","last_active":"2023-11-20T07:00:58.317862+0000","last_peered":"2023-11-20T07:00:58.317862+0000","last_clean":"2023-11-20T07:00:58.317862+0000","last_became_active":"2023-11-20T07:00:54.322547+0000","last_became_peered":"2023-11-20T07:00:54.322547+0000","last_unstale":"2023-11-20T07:00:58.317862+0000","last_undegraded":"2023-11-20T07:00:58.317862+0000","last_fullsized":"2023-11-20T07:00:58.317862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:41:56.805008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307365+0000","last_change":"2023-11-20T07:00:58.325322+0000","last_active":"2023-11-20T07:00:59.307365+0000","last_peered":"2023-11-20T07:00:59.307365+0000","last_clean":"2023-11-20T07:00:59.307365+0000","last_became_active":"2023-11-20T07:00:58.324869+0000","last_became_peered":"2023-11-20T07:00:58.324869+0000","last_unstale":"2023-11-20T07:00:59.307365+0000","last_undegraded":"2023-11-20T07:00:59.307365+0000","last_fullsized":"2023-11-20T07:00:59.307365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:43.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493286+0000","last_change":"2023-11-20T07:00:53.661990+0000","last_active":"2023-11-20T07:00:58.493286+0000","last_peered":"2023-11-20T07:00:58.493286+0000","last_clean":"2023-11-20T07:00:58.493286+0000","last_became_active":"2023-11-20T07:00:53.661634+0000","last_became_peered":"2023-11-20T07:00:53.661634+0000","last_unstale":"2023-11-20T07:00:58.493286+0000","last_undegraded":"2023-11-20T07:00:58.493286+0000","last_fullsized":"2023-11-20T07:00:58.493286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:44.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318481+0000","last_change":"2023-11-20T07:00:54.322610+0000","last_active":"2023-11-20T07:00:58.318481+0000","last_peered":"2023-11-20T07:00:58.318481+0000","last_clean":"2023-11-20T07:00:58.318481+0000","last_became_active":"2023-11-20T07:00:54.322196+0000","last_became_peered":"2023-11-20T07:00:54.322196+0000","last_unstale":"2023-11-20T07:00:58.318481+0000","last_undegraded":"2023-11-20T07:00:58.318481+0000","last_fullsized":"2023-11-20T07:00:58.318481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:34.029377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307622+0000","last_change":"2023-11-20T07:00:58.326848+0000","last_active":"2023-11-20T07:00:59.307622+0000","last_peered":"2023-11-20T07:00:59.307622+0000","last_clean":"2023-11-20T07:00:59.307622+0000","last_became_active":"2023-11-20T07:00:58.326426+0000","last_became_peered":"2023-11-20T07:00:58.326426+0000","last_unstale":"2023-11-20T07:00:59.307622+0000","last_undegraded":"2023-11-20T07:00:59.307622+0000","last_fullsized":"2023-11-20T07:00:59.307622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:21.571196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310719+0000","last_change":"2023-11-20T07:00:54.313413+0000","last_active":"2023-11-20T07:00:58.310719+0000","last_peered":"2023-11-20T07:00:58.310719+0000","last_clean":"2023-11-20T07:00:58.310719+0000","last_became_active":"2023-11-20T07:00:54.311349+0000","last_became_peered":"2023-11-20T07:00:54.311349+0000","last_unstale":"2023-11-20T07:00:58.310719+0000","last_undegraded":"2023-11-20T07:00:58.310719+0000","last_fullsized":"2023-11-20T07:00:58.310719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493287+0000","last_change":"2023-11-20T07:00:53.653466+0000","last_active":"2023-11-20T07:00:58.493287+0000","last_peered":"2023-11-20T07:00:58.493287+0000","last_clean":"2023-11-20T07:00:58.493287+0000","last_became_active":"2023-11-20T07:00:53.653211+0000","last_became_peered":"2023-11-20T07:00:53.653211+0000","last_unstale":"2023-11-20T07:00:58.493287+0000","last_undegraded":"2023-11-20T07:00:58.493287+0000","last_fullsized":"2023-11-20T07:00:58.493287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308698+0000","last_change":"2023-11-20T07:00:58.326758+0000","last_active":"2023-11-20T07:00:59.308698+0000","last_peered":"2023-11-20T07:00:59.308698+0000","last_clean":"2023-11-20T07:00:59.308698+0000","last_became_active":"2023-11-20T07:00:58.326338+0000","last_became_peered":"2023-11-20T07:00:58.326338+0000","last_unstale":"2023-11-20T07:00:59.308698+0000","last_undegraded":"2023-11-20T07:00:59.308698+0000","last_fullsized":"2023-11-20T07:00:59.308698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:37.701282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303367+0000","last_change":"2023-11-20T07:00:54.316618+0000","last_active":"2023-11-20T07:00:58.303367+0000","last_peered":"2023-11-20T07:00:58.303367+0000","last_clean":"2023-11-20T07:00:58.303367+0000","last_became_active":"2023-11-20T07:00:54.316344+0000","last_became_peered":"2023-11-20T07:00:54.316344+0000","last_unstale":"2023-11-20T07:00:58.303367+0000","last_undegraded":"2023-11-20T07:00:58.303367+0000","last_fullsized":"2023-11-20T07:00:58.303367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.319497+0000","last_change":"2023-11-20T07:00:53.648232+0000","last_active":"2023-11-20T07:00:58.319497+0000","last_peered":"2023-11-20T07:00:58.319497+0000","last_clean":"2023-11-20T07:00:58.319497+0000","last_became_active":"2023-11-20T07:00:53.647945+0000","last_became_peered":"2023-11-20T07:00:53.647945+0000","last_unstale":"2023-11-20T07:00:58.319497+0000","last_undegraded":"2023-11-20T07:00:58.319497+0000","last_fullsized":"2023-11-20T07:00:58.319497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:23:16.836796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308291+0000","last_change":"2023-11-20T07:00:58.328131+0000","last_active":"2023-11-20T07:00:59.308291+0000","last_peered":"2023-11-20T07:00:59.308291+0000","last_clean":"2023-11-20T07:00:59.308291+0000","last_became_active":"2023-11-20T07:00:58.327741+0000","last_became_peered":"2023-11-20T07:00:58.327741+0000","last_unstale":"2023-11-20T07:00:59.308291+0000","last_undegraded":"2023-11-20T07:00:59.308291+0000","last_fullsized":"2023-11-20T07:00:59.308291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:12.994548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303298+0000","last_change":"2023-11-20T07:00:54.310162+0000","last_active":"2023-11-20T07:00:58.303298+0000","last_peered":"2023-11-20T07:00:58.303298+0000","last_clean":"2023-11-20T07:00:58.303298+0000","last_became_active":"2023-11-20T07:00:54.309901+0000","last_became_peered":"2023-11-20T07:00:54.309901+0000","last_unstale":"2023-11-20T07:00:58.303298+0000","last_undegraded":"2023-11-20T07:00:58.303298+0000","last_fullsized":"2023-11-20T07:00:58.303298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316319+0000","last_change":"2023-11-20T07:00:53.647565+0000","last_active":"2023-11-20T07:00:58.316319+0000","last_peered":"2023-11-20T07:00:58.316319+0000","last_clean":"2023-11-20T07:00:58.316319+0000","last_became_active":"2023-11-20T07:00:53.647292+0000","last_became_peered":"2023-11-20T07:00:53.647292+0000","last_unstale":"2023-11-20T07:00:58.316319+0000","last_undegraded":"2023-11-20T07:00:58.316319+0000","last_fullsized":"2023-11-20T07:00:58.316319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:06.154369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.808266+0000","last_change":"2023-11-20T07:00:58.499121+0000","last_active":"2023-11-20T07:00:59.808266+0000","last_peered":"2023-11-20T07:00:59.808266+0000","last_clean":"2023-11-20T07:00:59.808266+0000","last_became_active":"2023-11-20T07:00:58.498681+0000","last_became_peered":"2023-11-20T07:00:58.498681+0000","last_unstale":"2023-11-20T07:00:59.808266+0000","last_undegraded":"2023-11-20T07:00:59.808266+0000","last_fullsized":"2023-11-20T07:00:59.808266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:19:25.697324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310377+0000","last_change":"2023-11-20T07:00:54.307003+0000","last_active":"2023-11-20T07:00:58.310377+0000","last_peered":"2023-11-20T07:00:58.310377+0000","last_clean":"2023-11-20T07:00:58.310377+0000","last_became_active":"2023-11-20T07:00:54.306416+0000","last_became_peered":"2023-11-20T07:00:54.306416+0000","last_unstale":"2023-11-20T07:00:58.310377+0000","last_undegraded":"2023-11-20T07:00:58.310377+0000","last_fullsized":"2023-11-20T07:00:58.310377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:00:19.316968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.492960+0000","last_change":"2023-11-20T07:00:53.658929+0000","last_active":"2023-11-20T07:00:58.492960+0000","last_peered":"2023-11-20T07:00:58.492960+0000","last_clean":"2023-11-20T07:00:58.492960+0000","last_became_active":"2023-11-20T07:00:53.656722+0000","last_became_peered":"2023-11-20T07:00:53.656722+0000","last_unstale":"2023-11-20T07:00:58.492960+0000","last_undegraded":"2023-11-20T07:00:58.492960+0000","last_fullsized":"2023-11-20T07:00:58.492960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:18.352244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308589+0000","last_change":"2023-11-20T07:00:58.328021+0000","last_active":"2023-11-20T07:00:59.308589+0000","last_peered":"2023-11-20T07:00:59.308589+0000","last_clean":"2023-11-20T07:00:59.308589+0000","last_became_active":"2023-11-20T07:00:58.327571+0000","last_became_peered":"2023-11-20T07:00:58.327571+0000","last_unstale":"2023-11-20T07:00:59.308589+0000","last_undegraded":"2023-11-20T07:00:59.308589+0000","last_fullsized":"2023-11-20T07:00:59.308589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:45.316086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326462+0000","last_change":"2023-11-20T07:00:54.307130+0000","last_active":"2023-11-20T07:00:58.326462+0000","last_peered":"2023-11-20T07:00:58.326462+0000","last_clean":"2023-11-20T07:00:58.326462+0000","last_became_active":"2023-11-20T07:00:54.306858+0000","last_became_peered":"2023-11-20T07:00:54.306858+0000","last_unstale":"2023-11-20T07:00:58.326462+0000","last_undegraded":"2023-11-20T07:00:58.326462+0000","last_fullsized":"2023-11-20T07:00:58.326462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:07.160493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311818+0000","last_change":"2023-11-20T07:00:53.658355+0000","last_active":"2023-11-20T07:00:58.311818+0000","last_peered":"2023-11-20T07:00:58.311818+0000","last_clean":"2023-11-20T07:00:58.311818+0000","last_became_active":"2023-11-20T07:00:53.657868+0000","last_became_peered":"2023-11-20T07:00:53.657868+0000","last_unstale":"2023-11-20T07:00:58.311818+0000","last_undegraded":"2023-11-20T07:00:58.311818+0000","last_fullsized":"2023-11-20T07:00:58.311818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308040+0000","last_change":"2023-11-20T07:00:58.500426+0000","last_active":"2023-11-20T07:00:59.308040+0000","last_peered":"2023-11-20T07:00:59.308040+0000","last_clean":"2023-11-20T07:00:59.308040+0000","last_became_active":"2023-11-20T07:00:58.498422+0000","last_became_peered":"2023-11-20T07:00:58.498422+0000","last_unstale":"2023-11-20T07:00:59.308040+0000","last_undegraded":"2023-11-20T07:00:59.308040+0000","last_fullsized":"2023-11-20T07:00:59.308040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:47.429541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.305106+0000","last_change":"2023-11-20T07:00:54.317201+0000","last_active":"2023-11-20T07:00:58.305106+0000","last_peered":"2023-11-20T07:00:58.305106+0000","last_clean":"2023-11-20T07:00:58.305106+0000","last_became_active":"2023-11-20T07:00:54.316914+0000","last_became_peered":"2023-11-20T07:00:54.316914+0000","last_unstale":"2023-11-20T07:00:58.305106+0000","last_undegraded":"2023-11-20T07:00:58.305106+0000","last_fullsized":"2023-11-20T07:00:58.305106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:09.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316138+0000","last_change":"2023-11-20T07:00:53.645493+0000","last_active":"2023-11-20T07:00:58.316138+0000","last_peered":"2023-11-20T07:00:58.316138+0000","last_clean":"2023-11-20T07:00:58.316138+0000","last_became_active":"2023-11-20T07:00:53.644350+0000","last_became_peered":"2023-11-20T07:00:53.644350+0000","last_unstale":"2023-11-20T07:00:58.316138+0000","last_undegraded":"2023-11-20T07:00:58.316138+0000","last_fullsized":"2023-11-20T07:00:58.316138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806145+0000","last_change":"2023-11-20T07:00:58.499371+0000","last_active":"2023-11-20T07:00:59.806145+0000","last_peered":"2023-11-20T07:00:59.806145+0000","last_clean":"2023-11-20T07:00:59.806145+0000","last_became_active":"2023-11-20T07:00:58.498953+0000","last_became_peered":"2023-11-20T07:00:58.498953+0000","last_unstale":"2023-11-20T07:00:59.806145+0000","last_undegraded":"2023-11-20T07:00:59.806145+0000","last_fullsized":"2023-11-20T07:00:59.806145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:03:22.099699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318416+0000","last_change":"2023-11-20T07:00:54.309275+0000","last_active":"2023-11-20T07:00:58.318416+0000","last_peered":"2023-11-20T07:00:58.318416+0000","last_clean":"2023-11-20T07:00:58.318416+0000","last_became_active":"2023-11-20T07:00:54.309012+0000","last_became_peered":"2023-11-20T07:00:54.309012+0000","last_unstale":"2023-11-20T07:00:58.318416+0000","last_undegraded":"2023-11-20T07:00:58.318416+0000","last_fullsized":"2023-11-20T07:00:58.318416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494554+0000","last_change":"2023-11-20T07:00:53.654465+0000","last_active":"2023-11-20T07:00:58.494554+0000","last_peered":"2023-11-20T07:00:58.494554+0000","last_clean":"2023-11-20T07:00:58.494554+0000","last_became_active":"2023-11-20T07:00:53.654148+0000","last_became_peered":"2023-11-20T07:00:53.654148+0000","last_unstale":"2023-11-20T07:00:58.494554+0000","last_undegraded":"2023-11-20T07:00:58.494554+0000","last_fullsized":"2023-11-20T07:00:58.494554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:38.670481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806267+0000","last_change":"2023-11-20T07:00:58.503543+0000","last_active":"2023-11-20T07:00:59.806267+0000","last_peered":"2023-11-20T07:00:59.806267+0000","last_clean":"2023-11-20T07:00:59.806267+0000","last_became_active":"2023-11-20T07:00:58.502762+0000","last_became_peered":"2023-11-20T07:00:58.502762+0000","last_unstale":"2023-11-20T07:00:59.806267+0000","last_undegraded":"2023-11-20T07:00:59.806267+0000","last_fullsized":"2023-11-20T07:00:59.806267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:45.316086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318563+0000","last_change":"2023-11-20T07:00:54.316224+0000","last_active":"2023-11-20T07:00:58.318563+0000","last_peered":"2023-11-20T07:00:58.318563+0000","last_clean":"2023-11-20T07:00:58.318563+0000","last_became_active":"2023-11-20T07:00:54.315909+0000","last_became_peered":"2023-11-20T07:00:54.315909+0000","last_unstale":"2023-11-20T07:00:58.318563+0000","last_undegraded":"2023-11-20T07:00:58.318563+0000","last_fullsized":"2023-11-20T07:00:58.318563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:04.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318503+0000","last_change":"2023-11-20T07:00:53.650522+0000","last_active":"2023-11-20T07:00:58.318503+0000","last_peered":"2023-11-20T07:00:58.318503+0000","last_clean":"2023-11-20T07:00:58.318503+0000","last_became_active":"2023-11-20T07:00:53.649787+0000","last_became_peered":"2023-11-20T07:00:53.649787+0000","last_unstale":"2023-11-20T07:00:58.318503+0000","last_undegraded":"2023-11-20T07:00:58.318503+0000","last_fullsized":"2023-11-20T07:00:58.318503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:18.352244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805309+0000","last_change":"2023-11-20T07:00:58.329318+0000","last_active":"2023-11-20T07:00:59.805309+0000","last_peered":"2023-11-20T07:00:59.805309+0000","last_clean":"2023-11-20T07:00:59.805309+0000","last_became_active":"2023-11-20T07:00:58.327572+0000","last_became_peered":"2023-11-20T07:00:58.327572+0000","last_unstale":"2023-11-20T07:00:59.805309+0000","last_undegraded":"2023-11-20T07:00:59.805309+0000","last_fullsized":"2023-11-20T07:00:59.805309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:34.090825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310713+0000","last_change":"2023-11-20T07:00:54.300938+0000","last_active":"2023-11-20T07:00:58.310713+0000","last_peered":"2023-11-20T07:00:58.310713+0000","last_clean":"2023-11-20T07:00:58.310713+0000","last_became_active":"2023-11-20T07:00:54.300489+0000","last_became_peered":"2023-11-20T07:00:54.300489+0000","last_unstale":"2023-11-20T07:00:58.310713+0000","last_undegraded":"2023-11-20T07:00:58.310713+0000","last_fullsized":"2023-11-20T07:00:58.310713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:19.358368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318471+0000","last_change":"2023-11-20T07:00:53.657372+0000","last_active":"2023-11-20T07:00:58.318471+0000","last_peered":"2023-11-20T07:00:58.318471+0000","last_clean":"2023-11-20T07:00:58.318471+0000","last_became_active":"2023-11-20T07:00:53.656783+0000","last_became_peered":"2023-11-20T07:00:53.656783+0000","last_unstale":"2023-11-20T07:00:58.318471+0000","last_undegraded":"2023-11-20T07:00:58.318471+0000","last_fullsized":"2023-11-20T07:00:58.318471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:06.245657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806936+0000","last_change":"2023-11-20T07:00:58.334074+0000","last_active":"2023-11-20T07:00:59.806936+0000","last_peered":"2023-11-20T07:00:59.806936+0000","last_clean":"2023-11-20T07:00:59.806936+0000","last_became_active":"2023-11-20T07:00:58.333819+0000","last_became_peered":"2023-11-20T07:00:58.333819+0000","last_unstale":"2023-11-20T07:00:59.806936+0000","last_undegraded":"2023-11-20T07:00:59.806936+0000","last_fullsized":"2023-11-20T07:00:59.806936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:08.554606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.315908+0000","last_change":"2023-11-20T07:00:54.308292+0000","last_active":"2023-11-20T07:00:58.315908+0000","last_peered":"2023-11-20T07:00:58.315908+0000","last_clean":"2023-11-20T07:00:58.315908+0000","last_became_active":"2023-11-20T07:00:54.306747+0000","last_became_peered":"2023-11-20T07:00:54.306747+0000","last_unstale":"2023-11-20T07:00:58.315908+0000","last_undegraded":"2023-11-20T07:00:58.315908+0000","last_fullsized":"2023-11-20T07:00:58.315908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.312862+0000","last_change":"2023-11-20T07:00:53.643036+0000","last_active":"2023-11-20T07:00:58.312862+0000","last_peered":"2023-11-20T07:00:58.312862+0000","last_clean":"2023-11-20T07:00:58.312862+0000","last_became_active":"2023-11-20T07:00:53.642571+0000","last_became_peered":"2023-11-20T07:00:53.642571+0000","last_unstale":"2023-11-20T07:00:58.312862+0000","last_undegraded":"2023-11-20T07:00:58.312862+0000","last_fullsized":"2023-11-20T07:00:58.312862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:44.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.808276+0000","last_change":"2023-11-20T07:00:58.333236+0000","last_active":"2023-11-20T07:00:59.808276+0000","last_peered":"2023-11-20T07:00:59.808276+0000","last_clean":"2023-11-20T07:00:59.808276+0000","last_became_active":"2023-11-20T07:00:58.332618+0000","last_became_peered":"2023-11-20T07:00:58.332618+0000","last_unstale":"2023-11-20T07:00:59.808276+0000","last_undegraded":"2023-11-20T07:00:59.808276+0000","last_fullsized":"2023-11-20T07:00:59.808276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:55:34.562598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318629+0000","last_change":"2023-11-20T07:00:54.297521+0000","last_active":"2023-11-20T07:00:58.318629+0000","last_peered":"2023-11-20T07:00:58.318629+0000","last_clean":"2023-11-20T07:00:58.318629+0000","last_became_active":"2023-11-20T07:00:54.297230+0000","last_became_peered":"2023-11-20T07:00:54.297230+0000","last_unstale":"2023-11-20T07:00:58.318629+0000","last_undegraded":"2023-11-20T07:00:58.318629+0000","last_fullsized":"2023-11-20T07:00:58.318629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:59:40.885687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.492983+0000","last_change":"2023-11-20T07:00:53.659113+0000","last_active":"2023-11-20T07:00:58.492983+0000","last_peered":"2023-11-20T07:00:58.492983+0000","last_clean":"2023-11-20T07:00:58.492983+0000","last_became_active":"2023-11-20T07:00:53.658547+0000","last_became_peered":"2023-11-20T07:00:53.658547+0000","last_unstale":"2023-11-20T07:00:58.492983+0000","last_undegraded":"2023-11-20T07:00:58.492983+0000","last_fullsized":"2023-11-20T07:00:58.492983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:38:48.212711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.807596+0000","last_change":"2023-11-20T07:00:58.503986+0000","last_active":"2023-11-20T07:00:59.807596+0000","last_peered":"2023-11-20T07:00:59.807596+0000","last_clean":"2023-11-20T07:00:59.807596+0000","last_became_active":"2023-11-20T07:00:58.503152+0000","last_became_peered":"2023-11-20T07:00:58.503152+0000","last_unstale":"2023-11-20T07:00:59.807596+0000","last_undegraded":"2023-11-20T07:00:59.807596+0000","last_fullsized":"2023-11-20T07:00:59.807596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:08.554606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.302885+0000","last_change":"2023-11-20T07:00:54.322661+0000","last_active":"2023-11-20T07:00:58.302885+0000","last_peered":"2023-11-20T07:00:58.302885+0000","last_clean":"2023-11-20T07:00:58.302885+0000","last_became_active":"2023-11-20T07:00:54.322420+0000","last_became_peered":"2023-11-20T07:00:54.322420+0000","last_unstale":"2023-11-20T07:00:58.302885+0000","last_undegraded":"2023-11-20T07:00:58.302885+0000","last_fullsized":"2023-11-20T07:00:58.302885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317887+0000","last_change":"2023-11-20T07:00:53.657962+0000","last_active":"2023-11-20T07:00:58.317887+0000","last_peered":"2023-11-20T07:00:58.317887+0000","last_clean":"2023-11-20T07:00:58.317887+0000","last_became_active":"2023-11-20T07:00:53.657573+0000","last_became_peered":"2023-11-20T07:00:53.657573+0000","last_unstale":"2023-11-20T07:00:58.317887+0000","last_undegraded":"2023-11-20T07:00:58.317887+0000","last_fullsized":"2023-11-20T07:00:58.317887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:20.103551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493065+0000","last_change":"2023-11-20T07:00:43.158695+0000","last_active":"2023-11-20T07:00:58.493065+0000","last_peered":"2023-11-20T07:00:58.493065+0000","last_clean":"2023-11-20T07:00:58.493065+0000","last_became_active":"2023-11-20T07:00:43.157454+0000","last_became_peered":"2023-11-20T07:00:43.157454+0000","last_unstale":"2023-11-20T07:00:58.493065+0000","last_undegraded":"2023-11-20T07:00:58.493065+0000","last_fullsized":"2023-11-20T07:00:58.493065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_clean_scrub_stamp":"2023-11-20T07:00:42.001721+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:44:20.907460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.306704+0000","last_change":"2023-11-20T07:00:58.498801+0000","last_active":"2023-11-20T07:00:59.306704+0000","last_peered":"2023-11-20T07:00:59.306704+0000","last_clean":"2023-11-20T07:00:59.306704+0000","last_became_active":"2023-11-20T07:00:58.498293+0000","last_became_peered":"2023-11-20T07:00:58.498293+0000","last_unstale":"2023-11-20T07:00:59.306704+0000","last_undegraded":"2023-11-20T07:00:59.306704+0000","last_fullsized":"2023-11-20T07:00:59.306704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:45.316086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493410+0000","last_change":"2023-11-20T07:00:54.327998+0000","last_active":"2023-11-20T07:00:58.493410+0000","last_peered":"2023-11-20T07:00:58.493410+0000","last_clean":"2023-11-20T07:00:58.493410+0000","last_became_active":"2023-11-20T07:00:54.327745+0000","last_became_peered":"2023-11-20T07:00:54.327745+0000","last_unstale":"2023-11-20T07:00:58.493410+0000","last_undegraded":"2023-11-20T07:00:58.493410+0000","last_fullsized":"2023-11-20T07:00:58.493410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:34.029377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.313957+0000","last_change":"2023-11-20T07:00:53.655190+0000","last_active":"2023-11-20T07:00:58.313957+0000","last_peered":"2023-11-20T07:00:58.313957+0000","last_clean":"2023-11-20T07:00:58.313957+0000","last_became_active":"2023-11-20T07:00:53.654911+0000","last_became_peered":"2023-11-20T07:00:53.654911+0000","last_unstale":"2023-11-20T07:00:58.313957+0000","last_undegraded":"2023-11-20T07:00:58.313957+0000","last_fullsized":"2023-11-20T07:00:58.313957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:00:18.310844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.306340+0000","last_change":"2023-11-20T07:00:58.494982+0000","last_active":"2023-11-20T07:00:59.306340+0000","last_peered":"2023-11-20T07:00:59.306340+0000","last_clean":"2023-11-20T07:00:59.306340+0000","last_became_active":"2023-11-20T07:00:58.494289+0000","last_became_peered":"2023-11-20T07:00:58.494289+0000","last_unstale":"2023-11-20T07:00:59.306340+0000","last_undegraded":"2023-11-20T07:00:59.306340+0000","last_fullsized":"2023-11-20T07:00:59.306340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:12.994548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317961+0000","last_change":"2023-11-20T07:00:54.313077+0000","last_active":"2023-11-20T07:00:58.317961+0000","last_peered":"2023-11-20T07:00:58.317961+0000","last_clean":"2023-11-20T07:00:58.317961+0000","last_became_active":"2023-11-20T07:00:54.312340+0000","last_became_peered":"2023-11-20T07:00:54.312340+0000","last_unstale":"2023-11-20T07:00:58.317961+0000","last_undegraded":"2023-11-20T07:00:58.317961+0000","last_fullsized":"2023-11-20T07:00:58.317961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:41.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317512+0000","last_change":"2023-11-20T07:00:53.645227+0000","last_active":"2023-11-20T07:00:58.317512+0000","last_peered":"2023-11-20T07:00:58.317512+0000","last_clean":"2023-11-20T07:00:58.317512+0000","last_became_active":"2023-11-20T07:00:53.644948+0000","last_became_peered":"2023-11-20T07:00:53.644948+0000","last_unstale":"2023-11-20T07:00:58.317512+0000","last_undegraded":"2023-11-20T07:00:58.317512+0000","last_fullsized":"2023-11-20T07:00:58.317512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:16.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806374+0000","last_change":"2023-11-20T07:00:58.328865+0000","last_active":"2023-11-20T07:00:59.806374+0000","last_peered":"2023-11-20T07:00:59.806374+0000","last_clean":"2023-11-20T07:00:59.806374+0000","last_became_active":"2023-11-20T07:00:58.326797+0000","last_became_peered":"2023-11-20T07:00:58.326797+0000","last_unstale":"2023-11-20T07:00:59.806374+0000","last_undegraded":"2023-11-20T07:00:59.806374+0000","last_fullsized":"2023-11-20T07:00:59.806374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:37.701282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494804+0000","last_change":"2023-11-20T07:00:54.322679+0000","last_active":"2023-11-20T07:00:58.494804+0000","last_peered":"2023-11-20T07:00:58.494804+0000","last_clean":"2023-11-20T07:00:58.494804+0000","last_became_active":"2023-11-20T07:00:54.322402+0000","last_became_peered":"2023-11-20T07:00:54.322402+0000","last_unstale":"2023-11-20T07:00:58.494804+0000","last_undegraded":"2023-11-20T07:00:58.494804+0000","last_fullsized":"2023-11-20T07:00:58.494804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:55:30.890692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.312002+0000","last_change":"2023-11-20T07:00:53.648554+0000","last_active":"2023-11-20T07:00:58.312002+0000","last_peered":"2023-11-20T07:00:58.312002+0000","last_clean":"2023-11-20T07:00:58.312002+0000","last_became_active":"2023-11-20T07:00:53.648235+0000","last_became_peered":"2023-11-20T07:00:53.648235+0000","last_unstale":"2023-11-20T07:00:58.312002+0000","last_undegraded":"2023-11-20T07:00:58.312002+0000","last_fullsized":"2023-11-20T07:00:58.312002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:18.352244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.804873+0000","last_change":"2023-11-20T07:00:58.495397+0000","last_active":"2023-11-20T07:00:59.804873+0000","last_peered":"2023-11-20T07:00:59.804873+0000","last_clean":"2023-11-20T07:00:59.804873+0000","last_became_active":"2023-11-20T07:00:58.494254+0000","last_became_peered":"2023-11-20T07:00:58.494254+0000","last_unstale":"2023-11-20T07:00:59.804873+0000","last_undegraded":"2023-11-20T07:00:59.804873+0000","last_fullsized":"2023-11-20T07:00:59.804873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:26.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494056+0000","last_change":"2023-11-20T07:00:54.323607+0000","last_active":"2023-11-20T07:00:58.494056+0000","last_peered":"2023-11-20T07:00:58.494056+0000","last_clean":"2023-11-20T07:00:58.494056+0000","last_became_active":"2023-11-20T07:00:54.322379+0000","last_became_peered":"2023-11-20T07:00:54.322379+0000","last_unstale":"2023-11-20T07:00:58.494056+0000","last_undegraded":"2023-11-20T07:00:58.494056+0000","last_fullsized":"2023-11-20T07:00:58.494056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:19.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310927+0000","last_change":"2023-11-20T07:00:53.649849+0000","last_active":"2023-11-20T07:00:58.310927+0000","last_peered":"2023-11-20T07:00:58.310927+0000","last_clean":"2023-11-20T07:00:58.310927+0000","last_became_active":"2023-11-20T07:00:53.649515+0000","last_became_peered":"2023-11-20T07:00:53.649515+0000","last_unstale":"2023-11-20T07:00:58.310927+0000","last_undegraded":"2023-11-20T07:00:58.310927+0000","last_fullsized":"2023-11-20T07:00:58.310927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307960+0000","last_change":"2023-11-20T07:00:58.323467+0000","last_active":"2023-11-20T07:00:59.307960+0000","last_peered":"2023-11-20T07:00:59.307960+0000","last_clean":"2023-11-20T07:00:59.307960+0000","last_became_active":"2023-11-20T07:00:58.323069+0000","last_became_peered":"2023-11-20T07:00:58.323069+0000","last_unstale":"2023-11-20T07:00:59.307960+0000","last_undegraded":"2023-11-20T07:00:59.307960+0000","last_fullsized":"2023-11-20T07:00:59.307960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:13.803757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493206+0000","last_change":"2023-11-20T07:00:54.319865+0000","last_active":"2023-11-20T07:00:58.493206+0000","last_peered":"2023-11-20T07:00:58.493206+0000","last_clean":"2023-11-20T07:00:58.493206+0000","last_became_active":"2023-11-20T07:00:54.319507+0000","last_became_peered":"2023-11-20T07:00:54.319507+0000","last_unstale":"2023-11-20T07:00:58.493206+0000","last_undegraded":"2023-11-20T07:00:58.493206+0000","last_fullsized":"2023-11-20T07:00:58.493206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:43.757635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.313020+0000","last_change":"2023-11-20T07:00:53.645113+0000","last_active":"2023-11-20T07:00:58.313020+0000","last_peered":"2023-11-20T07:00:58.313020+0000","last_clean":"2023-11-20T07:00:58.313020+0000","last_became_active":"2023-11-20T07:00:53.644649+0000","last_became_peered":"2023-11-20T07:00:53.644649+0000","last_unstale":"2023-11-20T07:00:58.313020+0000","last_undegraded":"2023-11-20T07:00:58.313020+0000","last_fullsized":"2023-11-20T07:00:58.313020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.807526+0000","last_change":"2023-11-20T07:00:58.331774+0000","last_active":"2023-11-20T07:00:59.807526+0000","last_peered":"2023-11-20T07:00:59.807526+0000","last_clean":"2023-11-20T07:00:59.807526+0000","last_became_active":"2023-11-20T07:00:58.331450+0000","last_became_peered":"2023-11-20T07:00:58.331450+0000","last_unstale":"2023-11-20T07:00:59.807526+0000","last_undegraded":"2023-11-20T07:00:59.807526+0000","last_fullsized":"2023-11-20T07:00:59.807526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:22.921101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.309552+0000","last_change":"2023-11-20T07:00:54.311720+0000","last_active":"2023-11-20T07:00:58.309552+0000","last_peered":"2023-11-20T07:00:58.309552+0000","last_clean":"2023-11-20T07:00:58.309552+0000","last_became_active":"2023-11-20T07:00:54.311043+0000","last_became_peered":"2023-11-20T07:00:54.311043+0000","last_unstale":"2023-11-20T07:00:58.309552+0000","last_undegraded":"2023-11-20T07:00:58.309552+0000","last_fullsized":"2023-11-20T07:00:58.309552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:16.073686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.309511+0000","last_change":"2023-11-20T07:00:53.641657+0000","last_active":"2023-11-20T07:00:58.309511+0000","last_peered":"2023-11-20T07:00:58.309511+0000","last_clean":"2023-11-20T07:00:58.309511+0000","last_became_active":"2023-11-20T07:00:53.641339+0000","last_became_peered":"2023-11-20T07:00:53.641339+0000","last_unstale":"2023-11-20T07:00:58.309511+0000","last_undegraded":"2023-11-20T07:00:58.309511+0000","last_fullsized":"2023-11-20T07:00:58.309511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:10.249731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806340+0000","last_change":"2023-11-20T07:00:58.499394+0000","last_active":"2023-11-20T07:00:59.806340+0000","last_peered":"2023-11-20T07:00:59.806340+0000","last_clean":"2023-11-20T07:00:59.806340+0000","last_became_active":"2023-11-20T07:00:58.498964+0000","last_became_peered":"2023-11-20T07:00:58.498964+0000","last_unstale":"2023-11-20T07:00:59.806340+0000","last_undegraded":"2023-11-20T07:00:59.806340+0000","last_fullsized":"2023-11-20T07:00:59.806340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:29:17.940481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493222+0000","last_change":"2023-11-20T07:00:54.322332+0000","last_active":"2023-11-20T07:00:58.493222+0000","last_peered":"2023-11-20T07:00:58.493222+0000","last_clean":"2023-11-20T07:00:58.493222+0000","last_became_active":"2023-11-20T07:00:54.322039+0000","last_became_peered":"2023-11-20T07:00:54.322039+0000","last_unstale":"2023-11-20T07:00:58.493222+0000","last_undegraded":"2023-11-20T07:00:58.493222+0000","last_fullsized":"2023-11-20T07:00:58.493222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:41.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318421+0000","last_change":"2023-11-20T07:00:53.658482+0000","last_active":"2023-11-20T07:00:58.318421+0000","last_peered":"2023-11-20T07:00:58.318421+0000","last_clean":"2023-11-20T07:00:58.318421+0000","last_became_active":"2023-11-20T07:00:53.657099+0000","last_became_peered":"2023-11-20T07:00:53.657099+0000","last_unstale":"2023-11-20T07:00:58.318421+0000","last_undegraded":"2023-11-20T07:00:58.318421+0000","last_fullsized":"2023-11-20T07:00:58.318421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:15.067561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805595+0000","last_change":"2023-11-20T07:00:58.495295+0000","last_active":"2023-11-20T07:00:59.805595+0000","last_peered":"2023-11-20T07:00:59.805595+0000","last_clean":"2023-11-20T07:00:59.805595+0000","last_became_active":"2023-11-20T07:00:58.494557+0000","last_became_peered":"2023-11-20T07:00:58.494557+0000","last_unstale":"2023-11-20T07:00:59.805595+0000","last_undegraded":"2023-11-20T07:00:59.805595+0000","last_fullsized":"2023-11-20T07:00:59.805595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:55:33.954628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.320074+0000","last_change":"2023-11-20T07:00:54.311785+0000","last_active":"2023-11-20T07:00:58.320074+0000","last_peered":"2023-11-20T07:00:58.320074+0000","last_clean":"2023-11-20T07:00:58.320074+0000","last_became_active":"2023-11-20T07:00:54.311435+0000","last_became_peered":"2023-11-20T07:00:54.311435+0000","last_unstale":"2023-11-20T07:00:58.320074+0000","last_undegraded":"2023-11-20T07:00:58.320074+0000","last_fullsized":"2023-11-20T07:00:58.320074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:27.408568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.319062+0000","last_change":"2023-11-20T07:00:53.651972+0000","last_active":"2023-11-20T07:00:58.319062+0000","last_peered":"2023-11-20T07:00:58.319062+0000","last_clean":"2023-11-20T07:00:58.319062+0000","last_became_active":"2023-11-20T07:00:53.651725+0000","last_became_peered":"2023-11-20T07:00:53.651725+0000","last_unstale":"2023-11-20T07:00:58.319062+0000","last_undegraded":"2023-11-20T07:00:58.319062+0000","last_fullsized":"2023-11-20T07:00:58.319062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:00:18.310844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806216+0000","last_change":"2023-11-20T07:00:58.498803+0000","last_active":"2023-11-20T07:00:59.806216+0000","last_peered":"2023-11-20T07:00:59.806216+0000","last_clean":"2023-11-20T07:00:59.806216+0000","last_became_active":"2023-11-20T07:00:58.498348+0000","last_became_peered":"2023-11-20T07:00:58.498348+0000","last_unstale":"2023-11-20T07:00:59.806216+0000","last_undegraded":"2023-11-20T07:00:59.806216+0000","last_fullsized":"2023-11-20T07:00:59.806216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:55:33.954628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493295+0000","last_change":"2023-11-20T07:00:54.320969+0000","last_active":"2023-11-20T07:00:58.493295+0000","last_peered":"2023-11-20T07:00:58.493295+0000","last_clean":"2023-11-20T07:00:58.493295+0000","last_became_active":"2023-11-20T07:00:54.320409+0000","last_became_peered":"2023-11-20T07:00:54.320409+0000","last_unstale":"2023-11-20T07:00:58.493295+0000","last_undegraded":"2023-11-20T07:00:58.493295+0000","last_fullsized":"2023-11-20T07:00:58.493295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:09.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:01:04.877592+0000","last_change":"2023-11-20T07:00:53.644264+0000","last_active":"2023-11-20T07:01:04.877592+0000","last_peered":"2023-11-20T07:01:04.877592+0000","last_clean":"2023-11-20T07:01:04.877592+0000","last_became_active":"2023-11-20T07:00:53.643140+0000","last_became_peered":"2023-11-20T07:00:53.643140+0000","last_unstale":"2023-11-20T07:01:04.877592+0000","last_undegraded":"2023-11-20T07:01:04.877592+0000","last_fullsized":"2023-11-20T07:01:04.877592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:34:36.600135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806734+0000","last_change":"2023-11-20T07:00:58.328933+0000","last_active":"2023-11-20T07:00:59.806734+0000","last_peered":"2023-11-20T07:00:59.806734+0000","last_clean":"2023-11-20T07:00:59.806734+0000","last_became_active":"2023-11-20T07:00:58.328561+0000","last_became_peered":"2023-11-20T07:00:58.328561+0000","last_unstale":"2023-11-20T07:00:59.806734+0000","last_undegraded":"2023-11-20T07:00:59.806734+0000","last_fullsized":"2023-11-20T07:00:59.806734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:22.921101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310790+0000","last_change":"2023-11-20T07:00:54.309203+0000","last_active":"2023-11-20T07:00:58.310790+0000","last_peered":"2023-11-20T07:00:58.310790+0000","last_clean":"2023-11-20T07:00:58.310790+0000","last_became_active":"2023-11-20T07:00:54.308899+0000","last_became_peered":"2023-11-20T07:00:54.308899+0000","last_unstale":"2023-11-20T07:00:58.310790+0000","last_undegraded":"2023-11-20T07:00:58.310790+0000","last_fullsized":"2023-11-20T07:00:58.310790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:34:37.606259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317463+0000","last_change":"2023-11-20T07:00:53.656825+0000","last_active":"2023-11-20T07:00:58.317463+0000","last_peered":"2023-11-20T07:00:58.317463+0000","last_clean":"2023-11-20T07:00:58.317463+0000","last_became_active":"2023-11-20T07:00:53.656508+0000","last_became_peered":"2023-11-20T07:00:53.656508+0000","last_unstale":"2023-11-20T07:00:58.317463+0000","last_undegraded":"2023-11-20T07:00:58.317463+0000","last_fullsized":"2023-11-20T07:00:58.317463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:10.249731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308277+0000","last_change":"2023-11-20T07:00:58.322540+0000","last_active":"2023-11-20T07:00:59.308277+0000","last_peered":"2023-11-20T07:00:59.308277+0000","last_clean":"2023-11-20T07:00:59.308277+0000","last_became_active":"2023-11-20T07:00:58.322104+0000","last_became_peered":"2023-11-20T07:00:58.322104+0000","last_unstale":"2023-11-20T07:00:59.308277+0000","last_undegraded":"2023-11-20T07:00:59.308277+0000","last_fullsized":"2023-11-20T07:00:59.308277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:42:00.476914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326762+0000","last_change":"2023-11-20T07:00:54.318615+0000","last_active":"2023-11-20T07:00:58.326762+0000","last_peered":"2023-11-20T07:00:58.326762+0000","last_clean":"2023-11-20T07:00:58.326762+0000","last_became_active":"2023-11-20T07:00:54.318374+0000","last_became_peered":"2023-11-20T07:00:54.318374+0000","last_unstale":"2023-11-20T07:00:58.326762+0000","last_undegraded":"2023-11-20T07:00:58.326762+0000","last_fullsized":"2023-11-20T07:00:58.326762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318588+0000","last_change":"2023-11-20T07:00:53.663688+0000","last_active":"2023-11-20T07:00:58.318588+0000","last_peered":"2023-11-20T07:00:58.318588+0000","last_clean":"2023-11-20T07:00:58.318588+0000","last_became_active":"2023-11-20T07:00:53.663314+0000","last_became_peered":"2023-11-20T07:00:53.663314+0000","last_unstale":"2023-11-20T07:00:58.318588+0000","last_undegraded":"2023-11-20T07:00:58.318588+0000","last_fullsized":"2023-11-20T07:00:58.318588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:38.340586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805253+0000","last_change":"2023-11-20T07:00:58.325558+0000","last_active":"2023-11-20T07:00:59.805253+0000","last_peered":"2023-11-20T07:00:59.805253+0000","last_clean":"2023-11-20T07:00:59.805253+0000","last_became_active":"2023-11-20T07:00:58.323820+0000","last_became_peered":"2023-11-20T07:00:58.323820+0000","last_unstale":"2023-11-20T07:00:59.805253+0000","last_undegraded":"2023-11-20T07:00:59.805253+0000","last_fullsized":"2023-11-20T07:00:59.805253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:56:08.258067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317817+0000","last_change":"2023-11-20T07:00:54.322025+0000","last_active":"2023-11-20T07:00:58.317817+0000","last_peered":"2023-11-20T07:00:58.317817+0000","last_clean":"2023-11-20T07:00:58.317817+0000","last_became_active":"2023-11-20T07:00:54.319123+0000","last_became_peered":"2023-11-20T07:00:54.319123+0000","last_unstale":"2023-11-20T07:00:58.317817+0000","last_undegraded":"2023-11-20T07:00:58.317817+0000","last_fullsized":"2023-11-20T07:00:58.317817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:30.418920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311738+0000","last_change":"2023-11-20T07:00:53.658099+0000","last_active":"2023-11-20T07:00:58.311738+0000","last_peered":"2023-11-20T07:00:58.311738+0000","last_clean":"2023-11-20T07:00:58.311738+0000","last_became_active":"2023-11-20T07:00:53.657497+0000","last_became_peered":"2023-11-20T07:00:53.657497+0000","last_unstale":"2023-11-20T07:00:58.311738+0000","last_undegraded":"2023-11-20T07:00:58.311738+0000","last_fullsized":"2023-11-20T07:00:58.311738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:59:39.879563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805495+0000","last_change":"2023-11-20T07:00:58.500441+0000","last_active":"2023-11-20T07:00:59.805495+0000","last_peered":"2023-11-20T07:00:59.805495+0000","last_clean":"2023-11-20T07:00:59.805495+0000","last_became_active":"2023-11-20T07:00:58.499609+0000","last_became_peered":"2023-11-20T07:00:58.499609+0000","last_unstale":"2023-11-20T07:00:59.805495+0000","last_undegraded":"2023-11-20T07:00:59.805495+0000","last_fullsized":"2023-11-20T07:00:59.805495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:26.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.807449+0000","last_change":"2023-11-20T07:00:58.503634+0000","last_active":"2023-11-20T07:00:59.807449+0000","last_peered":"2023-11-20T07:00:59.807449+0000","last_clean":"2023-11-20T07:00:59.807449+0000","last_became_active":"2023-11-20T07:00:58.503079+0000","last_became_peered":"2023-11-20T07:00:58.503079+0000","last_unstale":"2023-11-20T07:00:59.807449+0000","last_undegraded":"2023-11-20T07:00:59.807449+0000","last_fullsized":"2023-11-20T07:00:59.807449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:34.090825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316198+0000","last_change":"2023-11-20T07:00:54.313144+0000","last_active":"2023-11-20T07:00:58.316198+0000","last_peered":"2023-11-20T07:00:58.316198+0000","last_clean":"2023-11-20T07:00:58.316198+0000","last_became_active":"2023-11-20T07:00:54.312847+0000","last_became_peered":"2023-11-20T07:00:54.312847+0000","last_unstale":"2023-11-20T07:00:58.316198+0000","last_undegraded":"2023-11-20T07:00:58.316198+0000","last_fullsized":"2023-11-20T07:00:58.316198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318078+0000","last_change":"2023-11-20T07:00:53.653998+0000","last_active":"2023-11-20T07:00:58.318078+0000","last_peered":"2023-11-20T07:00:58.318078+0000","last_clean":"2023-11-20T07:00:58.318078+0000","last_became_active":"2023-11-20T07:00:53.653691+0000","last_became_peered":"2023-11-20T07:00:53.653691+0000","last_unstale":"2023-11-20T07:00:58.318078+0000","last_undegraded":"2023-11-20T07:00:58.318078+0000","last_fullsized":"2023-11-20T07:00:58.318078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:06.154369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307016+0000","last_change":"2023-11-20T07:00:58.328082+0000","last_active":"2023-11-20T07:00:59.307016+0000","last_peered":"2023-11-20T07:00:59.307016+0000","last_clean":"2023-11-20T07:00:59.307016+0000","last_became_active":"2023-11-20T07:00:58.327691+0000","last_became_peered":"2023-11-20T07:00:58.327691+0000","last_unstale":"2023-11-20T07:00:59.307016+0000","last_undegraded":"2023-11-20T07:00:59.307016+0000","last_fullsized":"2023-11-20T07:00:59.307016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:37.701282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303177+0000","last_change":"2023-11-20T07:00:54.313955+0000","last_active":"2023-11-20T07:00:58.303177+0000","last_peered":"2023-11-20T07:00:58.303177+0000","last_clean":"2023-11-20T07:00:58.303177+0000","last_became_active":"2023-11-20T07:00:54.313653+0000","last_became_peered":"2023-11-20T07:00:54.313653+0000","last_unstale":"2023-11-20T07:00:58.303177+0000","last_undegraded":"2023-11-20T07:00:58.303177+0000","last_fullsized":"2023-11-20T07:00:58.303177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303337+0000","last_change":"2023-11-20T07:00:53.649943+0000","last_active":"2023-11-20T07:00:58.303337+0000","last_peered":"2023-11-20T07:00:58.303337+0000","last_clean":"2023-11-20T07:00:58.303337+0000","last_became_active":"2023-11-20T07:00:53.649583+0000","last_became_peered":"2023-11-20T07:00:53.649583+0000","last_unstale":"2023-11-20T07:00:58.303337+0000","last_undegraded":"2023-11-20T07:00:58.303337+0000","last_fullsized":"2023-11-20T07:00:58.303337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:44.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310821+0000","last_change":"2023-11-20T07:00:53.641711+0000","last_active":"2023-11-20T07:00:58.310821+0000","last_peered":"2023-11-20T07:00:58.310821+0000","last_clean":"2023-11-20T07:00:58.310821+0000","last_became_active":"2023-11-20T07:00:53.641380+0000","last_became_peered":"2023-11-20T07:00:53.641380+0000","last_unstale":"2023-11-20T07:00:58.310821+0000","last_undegraded":"2023-11-20T07:00:58.310821+0000","last_fullsized":"2023-11-20T07:00:58.310821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:16.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318975+0000","last_change":"2023-11-20T07:00:54.299129+0000","last_active":"2023-11-20T07:00:58.318975+0000","last_peered":"2023-11-20T07:00:58.318975+0000","last_clean":"2023-11-20T07:00:58.318975+0000","last_became_active":"2023-11-20T07:00:54.298681+0000","last_became_peered":"2023-11-20T07:00:54.298681+0000","last_unstale":"2023-11-20T07:00:58.318975+0000","last_undegraded":"2023-11-20T07:00:58.318975+0000","last_fullsized":"2023-11-20T07:00:58.318975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.305689+0000","last_change":"2023-11-20T07:00:58.328570+0000","last_active":"2023-11-20T07:00:59.305689+0000","last_peered":"2023-11-20T07:00:59.305689+0000","last_clean":"2023-11-20T07:00:59.305689+0000","last_became_active":"2023-11-20T07:00:58.328166+0000","last_became_peered":"2023-11-20T07:00:58.328166+0000","last_unstale":"2023-11-20T07:00:59.305689+0000","last_undegraded":"2023-11-20T07:00:59.305689+0000","last_fullsized":"2023-11-20T07:00:59.305689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:10.832398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303452+0000","last_change":"2023-11-20T07:00:53.653770+0000","last_active":"2023-11-20T07:00:58.303452+0000","last_peered":"2023-11-20T07:00:58.303452+0000","last_clean":"2023-11-20T07:00:58.303452+0000","last_became_active":"2023-11-20T07:00:53.653466+0000","last_became_peered":"2023-11-20T07:00:53.653466+0000","last_unstale":"2023-11-20T07:00:58.303452+0000","last_undegraded":"2023-11-20T07:00:58.303452+0000","last_fullsized":"2023-11-20T07:00:58.303452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310410+0000","last_change":"2023-11-20T07:00:54.308587+0000","last_active":"2023-11-20T07:00:58.310410+0000","last_peered":"2023-11-20T07:00:58.310410+0000","last_clean":"2023-11-20T07:00:58.310410+0000","last_became_active":"2023-11-20T07:00:54.308181+0000","last_became_peered":"2023-11-20T07:00:54.308181+0000","last_unstale":"2023-11-20T07:00:58.310410+0000","last_undegraded":"2023-11-20T07:00:58.310410+0000","last_fullsized":"2023-11-20T07:00:58.310410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:45.559098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805869+0000","last_change":"2023-11-20T07:00:58.326468+0000","last_active":"2023-11-20T07:00:59.805869+0000","last_peered":"2023-11-20T07:00:59.805869+0000","last_clean":"2023-11-20T07:00:59.805869+0000","last_became_active":"2023-11-20T07:00:58.325258+0000","last_became_peered":"2023-11-20T07:00:58.325258+0000","last_unstale":"2023-11-20T07:00:59.805869+0000","last_undegraded":"2023-11-20T07:00:59.805869+0000","last_fullsized":"2023-11-20T07:00:59.805869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:58:39.439432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.309466+0000","last_change":"2023-11-20T07:00:54.304862+0000","last_active":"2023-11-20T07:00:58.309466+0000","last_peered":"2023-11-20T07:00:58.309466+0000","last_clean":"2023-11-20T07:00:58.309466+0000","last_became_active":"2023-11-20T07:00:54.303650+0000","last_became_peered":"2023-11-20T07:00:54.303650+0000","last_unstale":"2023-11-20T07:00:58.309466+0000","last_undegraded":"2023-11-20T07:00:58.309466+0000","last_fullsized":"2023-11-20T07:00:58.309466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.312778+0000","last_change":"2023-11-20T07:00:54.324075+0000","last_active":"2023-11-20T07:00:58.312778+0000","last_peered":"2023-11-20T07:00:58.312778+0000","last_clean":"2023-11-20T07:00:58.312778+0000","last_became_active":"2023-11-20T07:00:54.323676+0000","last_became_peered":"2023-11-20T07:00:54.323676+0000","last_unstale":"2023-11-20T07:00:58.312778+0000","last_undegraded":"2023-11-20T07:00:58.312778+0000","last_fullsized":"2023-11-20T07:00:58.312778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:34:37.606259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318377+0000","last_change":"2023-11-20T07:00:54.318169+0000","last_active":"2023-11-20T07:00:58.318377+0000","last_peered":"2023-11-20T07:00:58.318377+0000","last_clean":"2023-11-20T07:00:58.318377+0000","last_became_active":"2023-11-20T07:00:54.317900+0000","last_became_peered":"2023-11-20T07:00:54.317900+0000","last_unstale":"2023-11-20T07:00:58.318377+0000","last_undegraded":"2023-11-20T07:00:58.318377+0000","last_fullsized":"2023-11-20T07:00:58.318377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:09.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318884+0000","last_change":"2023-11-20T07:00:54.312618+0000","last_active":"2023-11-20T07:00:58.318884+0000","last_peered":"2023-11-20T07:00:58.318884+0000","last_clean":"2023-11-20T07:00:58.318884+0000","last_became_active":"2023-11-20T07:00:54.312347+0000","last_became_peered":"2023-11-20T07:00:54.312347+0000","last_unstale":"2023-11-20T07:00:58.318884+0000","last_undegraded":"2023-11-20T07:00:58.318884+0000","last_fullsized":"2023-11-20T07:00:58.318884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303777+0000","last_change":"2023-11-20T07:00:54.320244+0000","last_active":"2023-11-20T07:00:58.303777+0000","last_peered":"2023-11-20T07:00:58.303777+0000","last_clean":"2023-11-20T07:00:58.303777+0000","last_became_active":"2023-11-20T07:00:54.319980+0000","last_became_peered":"2023-11-20T07:00:54.319980+0000","last_unstale":"2023-11-20T07:00:58.303777+0000","last_undegraded":"2023-11-20T07:00:58.303777+0000","last_fullsized":"2023-11-20T07:00:58.303777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:10.131851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317033+0000","last_change":"2023-11-20T07:00:54.306675+0000","last_active":"2023-11-20T07:00:58.317033+0000","last_peered":"2023-11-20T07:00:58.317033+0000","last_clean":"2023-11-20T07:00:58.317033+0000","last_became_active":"2023-11-20T07:00:54.306368+0000","last_became_peered":"2023-11-20T07:00:54.306368+0000","last_unstale":"2023-11-20T07:00:58.317033+0000","last_undegraded":"2023-11-20T07:00:58.317033+0000","last_fullsized":"2023-11-20T07:00:58.317033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311347+0000","last_change":"2023-11-20T07:00:54.311331+0000","last_active":"2023-11-20T07:00:58.311347+0000","last_peered":"2023-11-20T07:00:58.311347+0000","last_clean":"2023-11-20T07:00:58.311347+0000","last_became_active":"2023-11-20T07:00:54.311018+0000","last_became_peered":"2023-11-20T07:00:54.311018+0000","last_unstale":"2023-11-20T07:00:58.311347+0000","last_undegraded":"2023-11-20T07:00:58.311347+0000","last_fullsized":"2023-11-20T07:00:58.311347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.305111+0000","last_change":"2023-11-20T07:00:54.319932+0000","last_active":"2023-11-20T07:00:58.305111+0000","last_peered":"2023-11-20T07:00:58.305111+0000","last_clean":"2023-11-20T07:00:58.305111+0000","last_became_active":"2023-11-20T07:00:54.319701+0000","last_became_peered":"2023-11-20T07:00:54.319701+0000","last_unstale":"2023-11-20T07:00:58.305111+0000","last_undegraded":"2023-11-20T07:00:58.305111+0000","last_fullsized":"2023-11-20T07:00:58.305111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:41:56.805008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318044+0000","last_change":"2023-11-20T07:00:54.318299+0000","last_active":"2023-11-20T07:00:58.318044+0000","last_peered":"2023-11-20T07:00:58.318044+0000","last_clean":"2023-11-20T07:00:58.318044+0000","last_became_active":"2023-11-20T07:00:54.312610+0000","last_became_peered":"2023-11-20T07:00:54.312610+0000","last_unstale":"2023-11-20T07:00:58.318044+0000","last_undegraded":"2023-11-20T07:00:58.318044+0000","last_fullsized":"2023-11-20T07:00:58.318044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303139+0000","last_change":"2023-11-20T07:00:54.316271+0000","last_active":"2023-11-20T07:00:58.303139+0000","last_peered":"2023-11-20T07:00:58.303139+0000","last_clean":"2023-11-20T07:00:58.303139+0000","last_became_active":"2023-11-20T07:00:54.315955+0000","last_became_peered":"2023-11-20T07:00:54.315955+0000","last_unstale":"2023-11-20T07:00:58.303139+0000","last_undegraded":"2023-11-20T07:00:58.303139+0000","last_fullsized":"2023-11-20T07:00:58.303139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318282+0000","last_change":"2023-11-20T07:00:54.317416+0000","last_active":"2023-11-20T07:00:58.318282+0000","last_peered":"2023-11-20T07:00:58.318282+0000","last_clean":"2023-11-20T07:00:58.318282+0000","last_became_active":"2023-11-20T07:00:54.316794+0000","last_became_peered":"2023-11-20T07:00:54.316794+0000","last_unstale":"2023-11-20T07:00:58.318282+0000","last_undegraded":"2023-11-20T07:00:58.318282+0000","last_fullsized":"2023-11-20T07:00:58.318282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:43.757635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318783+0000","last_change":"2023-11-20T07:00:54.308603+0000","last_active":"2023-11-20T07:00:58.318783+0000","last_peered":"2023-11-20T07:00:58.318783+0000","last_clean":"2023-11-20T07:00:58.318783+0000","last_became_active":"2023-11-20T07:00:54.308324+0000","last_became_peered":"2023-11-20T07:00:54.308324+0000","last_unstale":"2023-11-20T07:00:58.318783+0000","last_undegraded":"2023-11-20T07:00:58.318783+0000","last_fullsized":"2023-11-20T07:00:58.318783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310585+0000","last_change":"2023-11-20T07:00:54.315438+0000","last_active":"2023-11-20T07:00:58.310585+0000","last_peered":"2023-11-20T07:00:58.310585+0000","last_clean":"2023-11-20T07:00:58.310585+0000","last_became_active":"2023-11-20T07:00:54.315182+0000","last_became_peered":"2023-11-20T07:00:54.315182+0000","last_unstale":"2023-11-20T07:00:58.310585+0000","last_undegraded":"2023-11-20T07:00:58.310585+0000","last_fullsized":"2023-11-20T07:00:58.310585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493594+0000","last_change":"2023-11-20T07:00:54.320102+0000","last_active":"2023-11-20T07:00:58.493594+0000","last_peered":"2023-11-20T07:00:58.493594+0000","last_clean":"2023-11-20T07:00:58.493594+0000","last_became_active":"2023-11-20T07:00:54.313876+0000","last_became_peered":"2023-11-20T07:00:54.313876+0000","last_unstale":"2023-11-20T07:00:58.493594+0000","last_undegraded":"2023-11-20T07:00:58.493594+0000","last_fullsized":"2023-11-20T07:00:58.493594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:30.418920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.314165+0000","last_change":"2023-11-20T07:00:54.308769+0000","last_active":"2023-11-20T07:00:58.314165+0000","last_peered":"2023-11-20T07:00:58.314165+0000","last_clean":"2023-11-20T07:00:58.314165+0000","last_became_active":"2023-11-20T07:00:54.307885+0000","last_became_peered":"2023-11-20T07:00:54.307885+0000","last_unstale":"2023-11-20T07:00:58.314165+0000","last_undegraded":"2023-11-20T07:00:58.314165+0000","last_fullsized":"2023-11-20T07:00:58.314165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:11.255855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318308+0000","last_change":"2023-11-20T07:00:54.318879+0000","last_active":"2023-11-20T07:00:58.318308+0000","last_peered":"2023-11-20T07:00:58.318308+0000","last_clean":"2023-11-20T07:00:58.318308+0000","last_became_active":"2023-11-20T07:00:54.318590+0000","last_became_peered":"2023-11-20T07:00:54.318590+0000","last_unstale":"2023-11-20T07:00:58.318308+0000","last_undegraded":"2023-11-20T07:00:58.318308+0000","last_fullsized":"2023-11-20T07:00:58.318308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:19.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317955+0000","last_change":"2023-11-20T07:00:54.318760+0000","last_active":"2023-11-20T07:00:58.317955+0000","last_peered":"2023-11-20T07:00:58.317955+0000","last_clean":"2023-11-20T07:00:58.317955+0000","last_became_active":"2023-11-20T07:00:54.318437+0000","last_became_peered":"2023-11-20T07:00:54.318437+0000","last_unstale":"2023-11-20T07:00:58.317955+0000","last_undegraded":"2023-11-20T07:00:58.317955+0000","last_fullsized":"2023-11-20T07:00:58.317955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316266+0000","last_change":"2023-11-20T07:00:54.315538+0000","last_active":"2023-11-20T07:00:58.316266+0000","last_peered":"2023-11-20T07:00:58.316266+0000","last_clean":"2023-11-20T07:00:58.316266+0000","last_became_active":"2023-11-20T07:00:54.315233+0000","last_became_peered":"2023-11-20T07:00:54.315233+0000","last_unstale":"2023-11-20T07:00:58.316266+0000","last_undegraded":"2023-11-20T07:00:58.316266+0000","last_fullsized":"2023-11-20T07:00:58.316266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.319999+0000","last_change":"2023-11-20T07:00:54.307661+0000","last_active":"2023-11-20T07:00:58.319999+0000","last_peered":"2023-11-20T07:00:58.319999+0000","last_clean":"2023-11-20T07:00:58.319999+0000","last_became_active":"2023-11-20T07:00:54.306975+0000","last_became_peered":"2023-11-20T07:00:54.306975+0000","last_unstale":"2023-11-20T07:00:58.319999+0000","last_undegraded":"2023-11-20T07:00:58.319999+0000","last_fullsized":"2023-11-20T07:00:58.319999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:17.914788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303292+0000","last_change":"2023-11-20T07:00:54.307989+0000","last_active":"2023-11-20T07:00:58.303292+0000","last_peered":"2023-11-20T07:00:58.303292+0000","last_clean":"2023-11-20T07:00:58.303292+0000","last_became_active":"2023-11-20T07:00:54.307712+0000","last_became_peered":"2023-11-20T07:00:54.307712+0000","last_unstale":"2023-11-20T07:00:58.303292+0000","last_undegraded":"2023-11-20T07:00:58.303292+0000","last_fullsized":"2023-11-20T07:00:58.303292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310788+0000","last_change":"2023-11-20T07:00:54.307874+0000","last_active":"2023-11-20T07:00:58.310788+0000","last_peered":"2023-11-20T07:00:58.310788+0000","last_clean":"2023-11-20T07:00:58.310788+0000","last_became_active":"2023-11-20T07:00:54.307257+0000","last_became_peered":"2023-11-20T07:00:54.307257+0000","last_unstale":"2023-11-20T07:00:58.310788+0000","last_undegraded":"2023-11-20T07:00:58.310788+0000","last_fullsized":"2023-11-20T07:00:58.310788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:38:49.218835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311723+0000","last_change":"2023-11-20T07:00:54.320026+0000","last_active":"2023-11-20T07:00:58.311723+0000","last_peered":"2023-11-20T07:00:58.311723+0000","last_clean":"2023-11-20T07:00:58.311723+0000","last_became_active":"2023-11-20T07:00:54.319737+0000","last_became_peered":"2023-11-20T07:00:54.319737+0000","last_unstale":"2023-11-20T07:00:58.311723+0000","last_undegraded":"2023-11-20T07:00:58.311723+0000","last_fullsized":"2023-11-20T07:00:58.311723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311297+0000","last_change":"2023-11-20T07:00:54.323404+0000","last_active":"2023-11-20T07:00:58.311297+0000","last_peered":"2023-11-20T07:00:58.311297+0000","last_clean":"2023-11-20T07:00:58.311297+0000","last_became_active":"2023-11-20T07:00:54.323122+0000","last_became_peered":"2023-11-20T07:00:54.323122+0000","last_unstale":"2023-11-20T07:00:58.311297+0000","last_undegraded":"2023-11-20T07:00:58.311297+0000","last_fullsized":"2023-11-20T07:00:58.311297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494710+0000","last_change":"2023-11-20T07:00:54.320729+0000","last_active":"2023-11-20T07:00:58.494710+0000","last_peered":"2023-11-20T07:00:58.494710+0000","last_clean":"2023-11-20T07:00:58.494710+0000","last_became_active":"2023-11-20T07:00:54.320394+0000","last_became_peered":"2023-11-20T07:00:54.320394+0000","last_unstale":"2023-11-20T07:00:58.494710+0000","last_undegraded":"2023-11-20T07:00:58.494710+0000","last_fullsized":"2023-11-20T07:00:58.494710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:19:22.025419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.302533+0000","last_change":"2023-11-20T07:00:54.322697+0000","last_active":"2023-11-20T07:00:58.302533+0000","last_peered":"2023-11-20T07:00:58.302533+0000","last_clean":"2023-11-20T07:00:58.302533+0000","last_became_active":"2023-11-20T07:00:54.322432+0000","last_became_peered":"2023-11-20T07:00:54.322432+0000","last_unstale":"2023-11-20T07:00:58.302533+0000","last_undegraded":"2023-11-20T07:00:58.302533+0000","last_fullsized":"2023-11-20T07:00:58.302533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:16.073686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493090+0000","last_change":"2023-11-20T07:00:54.319125+0000","last_active":"2023-11-20T07:00:58.493090+0000","last_peered":"2023-11-20T07:00:58.493090+0000","last_clean":"2023-11-20T07:00:58.493090+0000","last_became_active":"2023-11-20T07:00:54.314729+0000","last_became_peered":"2023-11-20T07:00:54.314729+0000","last_unstale":"2023-11-20T07:00:58.493090+0000","last_undegraded":"2023-11-20T07:00:58.493090+0000","last_fullsized":"2023-11-20T07:00:58.493090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:10.131851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318318+0000","last_change":"2023-11-20T07:00:54.317580+0000","last_active":"2023-11-20T07:00:58.318318+0000","last_peered":"2023-11-20T07:00:58.318318+0000","last_clean":"2023-11-20T07:00:58.318318+0000","last_became_active":"2023-11-20T07:00:54.317144+0000","last_became_peered":"2023-11-20T07:00:54.317144+0000","last_unstale":"2023-11-20T07:00:58.318318+0000","last_undegraded":"2023-11-20T07:00:58.318318+0000","last_fullsized":"2023-11-20T07:00:58.318318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:10.131851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493163+0000","last_change":"2023-11-20T07:00:54.313588+0000","last_active":"2023-11-20T07:00:58.493163+0000","last_peered":"2023-11-20T07:00:58.493163+0000","last_clean":"2023-11-20T07:00:58.493163+0000","last_became_active":"2023-11-20T07:00:54.309057+0000","last_became_peered":"2023-11-20T07:00:54.309057+0000","last_unstale":"2023-11-20T07:00:58.493163+0000","last_undegraded":"2023-11-20T07:00:58.493163+0000","last_fullsized":"2023-11-20T07:00:58.493163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:41:56.805008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317745+0000","last_change":"2023-11-20T07:00:54.316503+0000","last_active":"2023-11-20T07:00:58.317745+0000","last_peered":"2023-11-20T07:00:58.317745+0000","last_clean":"2023-11-20T07:00:58.317745+0000","last_became_active":"2023-11-20T07:00:54.316046+0000","last_became_peered":"2023-11-20T07:00:54.316046+0000","last_unstale":"2023-11-20T07:00:58.317745+0000","last_undegraded":"2023-11-20T07:00:58.317745+0000","last_fullsized":"2023-11-20T07:00:58.317745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318929+0000","last_change":"2023-11-20T07:00:54.303021+0000","last_active":"2023-11-20T07:00:58.318929+0000","last_peered":"2023-11-20T07:00:58.318929+0000","last_clean":"2023-11-20T07:00:58.318929+0000","last_became_active":"2023-11-20T07:00:54.302616+0000","last_became_peered":"2023-11-20T07:00:54.302616+0000","last_unstale":"2023-11-20T07:00:58.318929+0000","last_undegraded":"2023-11-20T07:00:58.318929+0000","last_fullsized":"2023-11-20T07:00:58.318929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:23:17.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316083+0000","last_change":"2023-11-20T07:00:54.310934+0000","last_active":"2023-11-20T07:00:58.316083+0000","last_peered":"2023-11-20T07:00:58.316083+0000","last_clean":"2023-11-20T07:00:58.316083+0000","last_became_active":"2023-11-20T07:00:54.306577+0000","last_became_peered":"2023-11-20T07:00:54.306577+0000","last_unstale":"2023-11-20T07:00:58.316083+0000","last_undegraded":"2023-11-20T07:00:58.316083+0000","last_fullsized":"2023-11-20T07:00:58.316083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494543+0000","last_change":"2023-11-20T07:00:54.313082+0000","last_active":"2023-11-20T07:00:58.494543+0000","last_peered":"2023-11-20T07:00:58.494543+0000","last_clean":"2023-11-20T07:00:58.494543+0000","last_became_active":"2023-11-20T07:00:54.312728+0000","last_became_peered":"2023-11-20T07:00:54.312728+0000","last_unstale":"2023-11-20T07:00:58.494543+0000","last_undegraded":"2023-11-20T07:00:58.494543+0000","last_fullsized":"2023-11-20T07:00:58.494543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:04.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1859999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.319}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4830000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T07:01:23.243 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T07:01:23.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4fad1d640 1 Processor -- start 2023-11-20T07:01:23.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4fad1d640 1 -- start start 2023-11-20T07:01:23.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4fad1d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4f415cb90 0x7fd4f40cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4fad1d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f40ce770 con 0x7fd4f40d15d0 2023-11-20T07:01:23.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4fad1d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f40d0600 con 0x7fd4f40d3010 2023-11-20T07:01:23.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4fad1d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f40c6450 con 0x7fd4f415cb90 2023-11-20T07:01:23.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4f92ba640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd4f40d15d0 0x7fd4f40c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52608/0 (socket says 172.21.15.88:52608) 2023-11-20T07:01:23.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4f92ba640 1 -- 172.21.15.88:0/1797627103 learned_addr learned my addr 172.21.15.88:0/1797627103 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:23.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740808917 0 0) 0x7fd4f40ce770 con 0x7fd4f40d15d0 2023-11-20T07:01:23.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4f8ab9640 1 --2- 172.21.15.88:0/1797627103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4f415cb90 0x7fd4f40cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4dc003530 con 0x7fd4f40d15d0 2023-11-20T07:01:23.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3609022597 0 0) 0x7fd4dc003530 con 0x7fd4f40d15d0 2023-11-20T07:01:23.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4f415cb90 msgr2=0x7fd4f40cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:23.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4eb7fe640 1 --2- 172.21.15.88:0/1797627103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4f415cb90 0x7fd4f40cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 >> v1:172.21.15.175:6789/0 conn(0x7fd4f40d3010 legacy=0x7fd4f40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f40d08a0 con 0x7fd4f40d15d0 2023-11-20T07:01:23.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.418+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fd4ec001a00 con 0x7fd4f40d15d0 2023-11-20T07:01:23.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 >> v1:172.21.15.88:6789/0 conn(0x7fd4f40d15d0 legacy=0x7fd4f40c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4eb7fe640 1 --2- 172.21.15.88:0/1797627103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4dc0039b0 0x7fd4dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4eb7fe640 1 --2- 172.21.15.88:0/1797627103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4dc0047d0 0x7fd4dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4eb7fe640 1 --2- 172.21.15.88:0/1797627103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4f415cb90 0x7fd4dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f40c6450 con 0x7fd4dc0047d0 2023-11-20T07:01:23.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc00bac0 con 0x7fd4dc0039b0 2023-11-20T07:01:23.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc00bc80 con 0x7fd4f415cb90 2023-11-20T07:01:23.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4ebfff640 1 --2- 172.21.15.88:0/1797627103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4dc0047d0 0x7fd4dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4f92ba640 1 --2- 172.21.15.88:0/1797627103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4f415cb90 0x7fd4dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4f8ab9640 1 --2- 172.21.15.88:0/1797627103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4dc0039b0 0x7fd4dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4ebfff640 1 -- 172.21.15.88:0/1797627103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4f415cb90 msgr2=0x7fd4dc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:23.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4ebfff640 1 --2- 172.21.15.88:0/1797627103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4f415cb90 0x7fd4dc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4ebfff640 1 -- 172.21.15.88:0/1797627103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4dc0039b0 msgr2=0x7fd4dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:23.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4ebfff640 1 --2- 172.21.15.88:0/1797627103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4dc0039b0 0x7fd4dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4ebfff640 1 -- 172.21.15.88:0/1797627103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc003530 con 0x7fd4dc0047d0 2023-11-20T07:01:23.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4ebfff640 1 --2- 172.21.15.88:0/1797627103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4dc0047d0 0x7fd4dc004c50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4001780 tx=0x7fd4e401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b934be9986ca7009 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:23.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e40052d0 con 0x7fd4dc0047d0 2023-11-20T07:01:23.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e40a7050 con 0x7fd4dc0047d0 2023-11-20T07:01:23.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.422+0000 7fd4eb7fe640 1 -- 172.21.15.88:0/1797627103 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4003600 con 0x7fd4dc0047d0 2023-11-20T07:01:23.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1797627103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4dc0047d0 msgr2=0x7fd4dc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 --2- 172.21.15.88:0/1797627103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4dc0047d0 0x7fd4dc004c50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4001780 tx=0x7fd4e401c3d0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4f92ba640 1 -- 172.21.15.88:0/1797627103 reap_dead start 2023-11-20T07:01:23.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1797627103 shutdown_connections 2023-11-20T07:01:23.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1797627103 >> 172.21.15.88:0/1797627103 conn(0x7fd4f409bc50 msgr2=0x7fd4f40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:23.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1797627103 shutdown_connections 2023-11-20T07:01:23.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1797627103 wait complete. 2023-11-20T07:01:23.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 Processor -- start 2023-11-20T07:01:23.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 -- start start 2023-11-20T07:01:23.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4dc0047d0 0x7fd4f4154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4f406b5a0 0x7fd4f40cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4f4154a90 0x7fd4f40cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f4157eb0 con 0x7fd4dc0047d0 2023-11-20T07:01:23.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f415b360 con 0x7fd4f406b5a0 2023-11-20T07:01:23.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4fad1d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f406bd60 con 0x7fd4f4154a90 2023-11-20T07:01:23.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4f8ab9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4dc0047d0 0x7fd4f4154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4f8ab9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4dc0047d0 0x7fd4f4154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54306/0 (socket says 172.21.15.88:54306) 2023-11-20T07:01:23.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4f8ab9640 1 -- 172.21.15.88:0/1177661322 learned_addr learned my addr 172.21.15.88:0/1177661322 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:23.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4f8ab9640 1 -- 172.21.15.88:0/1177661322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4f4154a90 msgr2=0x7fd4f40cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4f8ab9640 1 --2- 172.21.15.88:0/1177661322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4f4154a90 0x7fd4f40cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4f8ab9640 1 -- 172.21.15.88:0/1177661322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4f406b5a0 msgr2=0x7fd4f40cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4f8ab9640 1 --2- 172.21.15.88:0/1177661322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4f406b5a0 0x7fd4f40cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.426+0000 7fd4f8ab9640 1 -- 172.21.15.88:0/1177661322 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f415ada0 con 0x7fd4dc0047d0 2023-11-20T07:01:23.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.430+0000 7fd4f8ab9640 1 --2- 172.21.15.88:0/1177661322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4dc0047d0 0x7fd4f4154280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0011930 tx=0x7fd4f0011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:23.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.430+0000 7fd4e97fa640 1 -- 172.21.15.88:0/1177661322 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0009590 con 0x7fd4dc0047d0 2023-11-20T07:01:23.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.430+0000 7fd4e97fa640 1 -- 172.21.15.88:0/1177661322 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f0005bb0 con 0x7fd4dc0047d0 2023-11-20T07:01:23.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.430+0000 7fd4e97fa640 1 -- 172.21.15.88:0/1177661322 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f000f800 con 0x7fd4dc0047d0 2023-11-20T07:01:23.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.430+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1177661322 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f415b080 con 0x7fd4dc0047d0 2023-11-20T07:01:23.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.430+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1177661322 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f406b9f0 con 0x7fd4dc0047d0 2023-11-20T07:01:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.430+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1177661322 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f4074010 con 0x7fd4dc0047d0 2023-11-20T07:01:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.430+0000 7fd4e97fa640 1 -- 172.21.15.88:0/1177661322 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd4f000f960 con 0x7fd4dc0047d0 2023-11-20T07:01:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.430+0000 7fd4e97fa640 1 --2- 172.21.15.88:0/1177661322 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd4e00664d0 0x7fd4e0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.430+0000 7fd4e97fa640 1 -- 172.21.15.88:0/1177661322 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4f0084800 con 0x7fd4dc0047d0 2023-11-20T07:01:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.430+0000 7fd4ebfff640 1 --2- 172.21.15.88:0/1177661322 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd4e00664d0 0x7fd4e0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.434+0000 7fd4ebfff640 1 --2- 172.21.15.88:0/1177661322 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd4e00664d0 0x7fd4e0068990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4001750 tx=0x7fd4e4001130 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:23.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.434+0000 7fd4e97fa640 1 -- 172.21.15.88:0/1177661322 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd4f0051a20 con 0x7fd4dc0047d0 2023-11-20T07:01:23.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.582+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1177661322 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4f415ac20 con 0x7fd4e00664d0 2023-11-20T07:01:23.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.590+0000 7fd4e97fa640 1 -- 172.21.15.88:0/1177661322 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345294 (secure 0 0 0) 0x7fd4e40a4e90 con 0x7fd4e00664d0 2023-11-20T07:01:23.595 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:23.597 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-20T07:01:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.594+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1177661322 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd4e00664d0 msgr2=0x7fd4e0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.594+0000 7fd4fad1d640 1 --2- 172.21.15.88:0/1177661322 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd4e00664d0 0x7fd4e0068990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4001750 tx=0x7fd4e4001130 comp rx=0 tx=0).stop 2023-11-20T07:01:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.594+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1177661322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4dc0047d0 msgr2=0x7fd4f4154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.594+0000 7fd4fad1d640 1 --2- 172.21.15.88:0/1177661322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4dc0047d0 0x7fd4f4154280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0011930 tx=0x7fd4f0011df0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.594+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1177661322 shutdown_connections 2023-11-20T07:01:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.594+0000 7fd4fad1d640 1 --2- 172.21.15.88:0/1177661322 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd4e00664d0 0x7fd4e0068990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.594+0000 7fd4fad1d640 1 --2- 172.21.15.88:0/1177661322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4f4154a90 0x7fd4f40cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.594+0000 7fd4fad1d640 1 --2- 172.21.15.88:0/1177661322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4f406b5a0 0x7fd4f40cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.594+0000 7fd4fad1d640 1 --2- 172.21.15.88:0/1177661322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4dc0047d0 0x7fd4f4154280 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.594+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1177661322 >> 172.21.15.88:0/1177661322 conn(0x7fd4f409bc50 msgr2=0x7fd4f40d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:23.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.594+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1177661322 shutdown_connections 2023-11-20T07:01:23.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.594+0000 7fd4fad1d640 1 -- 172.21.15.88:0/1177661322 wait complete. 2023-11-20T07:01:23.616 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-11-20T07:01:23.538278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219376,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755344,"statfs":{"total":773094113280,"available":772869472256,"internally_reserved":0,"allocated":3284992,"data_stored":1988254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003608"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326844+0000","last_change":"2023-11-20T07:00:53.659408+0000","last_active":"2023-11-20T07:00:58.326844+0000","last_peered":"2023-11-20T07:00:58.326844+0000","last_clean":"2023-11-20T07:00:58.326844+0000","last_became_active":"2023-11-20T07:00:53.658981+0000","last_became_peered":"2023-11-20T07:00:53.658981+0000","last_unstale":"2023-11-20T07:00:58.326844+0000","last_undegraded":"2023-11-20T07:00:58.326844+0000","last_fullsized":"2023-11-20T07:00:58.326844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:10.249731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.304069+0000","last_change":"2023-11-20T07:00:54.314501+0000","last_active":"2023-11-20T07:00:58.304069+0000","last_peered":"2023-11-20T07:00:58.304069+0000","last_clean":"2023-11-20T07:00:58.304069+0000","last_became_active":"2023-11-20T07:00:54.314212+0000","last_became_peered":"2023-11-20T07:00:54.314212+0000","last_unstale":"2023-11-20T07:00:58.304069+0000","last_undegraded":"2023-11-20T07:00:58.304069+0000","last_fullsized":"2023-11-20T07:00:58.304069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:43.757635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805339+0000","last_change":"2023-11-20T07:00:58.500585+0000","last_active":"2023-11-20T07:00:59.805339+0000","last_peered":"2023-11-20T07:00:59.805339+0000","last_clean":"2023-11-20T07:00:59.805339+0000","last_became_active":"2023-11-20T07:00:58.500209+0000","last_became_peered":"2023-11-20T07:00:58.500209+0000","last_unstale":"2023-11-20T07:00:59.805339+0000","last_undegraded":"2023-11-20T07:00:59.805339+0000","last_fullsized":"2023-11-20T07:00:59.805339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:10:13.701470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.304262+0000","last_change":"2023-11-20T07:00:53.652110+0000","last_active":"2023-11-20T07:00:58.304262+0000","last_peered":"2023-11-20T07:00:58.304262+0000","last_clean":"2023-11-20T07:00:58.304262+0000","last_became_active":"2023-11-20T07:00:53.651824+0000","last_became_peered":"2023-11-20T07:00:53.651824+0000","last_unstale":"2023-11-20T07:00:58.304262+0000","last_undegraded":"2023-11-20T07:00:58.304262+0000","last_fullsized":"2023-11-20T07:00:58.304262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:16.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326690+0000","last_change":"2023-11-20T07:00:54.318618+0000","last_active":"2023-11-20T07:00:58.326690+0000","last_peered":"2023-11-20T07:00:58.326690+0000","last_clean":"2023-11-20T07:00:58.326690+0000","last_became_active":"2023-11-20T07:00:54.318411+0000","last_became_peered":"2023-11-20T07:00:54.318411+0000","last_unstale":"2023-11-20T07:00:58.326690+0000","last_undegraded":"2023-11-20T07:00:58.326690+0000","last_fullsized":"2023-11-20T07:00:58.326690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:16.073686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307275+0000","last_change":"2023-11-20T07:00:58.320861+0000","last_active":"2023-11-20T07:00:59.307275+0000","last_peered":"2023-11-20T07:00:59.307275+0000","last_clean":"2023-11-20T07:00:59.307275+0000","last_became_active":"2023-11-20T07:00:58.320417+0000","last_became_peered":"2023-11-20T07:00:58.320417+0000","last_unstale":"2023-11-20T07:00:59.307275+0000","last_undegraded":"2023-11-20T07:00:59.307275+0000","last_fullsized":"2023-11-20T07:00:59.307275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:22.712728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494050+0000","last_change":"2023-11-20T07:00:53.656292+0000","last_active":"2023-11-20T07:00:58.494050+0000","last_peered":"2023-11-20T07:00:58.494050+0000","last_clean":"2023-11-20T07:00:58.494050+0000","last_became_active":"2023-11-20T07:00:53.656026+0000","last_became_peered":"2023-11-20T07:00:53.656026+0000","last_unstale":"2023-11-20T07:00:58.494050+0000","last_undegraded":"2023-11-20T07:00:58.494050+0000","last_fullsized":"2023-11-20T07:00:58.494050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:38.340586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317862+0000","last_change":"2023-11-20T07:00:54.322765+0000","last_active":"2023-11-20T07:00:58.317862+0000","last_peered":"2023-11-20T07:00:58.317862+0000","last_clean":"2023-11-20T07:00:58.317862+0000","last_became_active":"2023-11-20T07:00:54.322547+0000","last_became_peered":"2023-11-20T07:00:54.322547+0000","last_unstale":"2023-11-20T07:00:58.317862+0000","last_undegraded":"2023-11-20T07:00:58.317862+0000","last_fullsized":"2023-11-20T07:00:58.317862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:41:56.805008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307365+0000","last_change":"2023-11-20T07:00:58.325322+0000","last_active":"2023-11-20T07:00:59.307365+0000","last_peered":"2023-11-20T07:00:59.307365+0000","last_clean":"2023-11-20T07:00:59.307365+0000","last_became_active":"2023-11-20T07:00:58.324869+0000","last_became_peered":"2023-11-20T07:00:58.324869+0000","last_unstale":"2023-11-20T07:00:59.307365+0000","last_undegraded":"2023-11-20T07:00:59.307365+0000","last_fullsized":"2023-11-20T07:00:59.307365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:43.348511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493286+0000","last_change":"2023-11-20T07:00:53.661990+0000","last_active":"2023-11-20T07:00:58.493286+0000","last_peered":"2023-11-20T07:00:58.493286+0000","last_clean":"2023-11-20T07:00:58.493286+0000","last_became_active":"2023-11-20T07:00:53.661634+0000","last_became_peered":"2023-11-20T07:00:53.661634+0000","last_unstale":"2023-11-20T07:00:58.493286+0000","last_undegraded":"2023-11-20T07:00:58.493286+0000","last_fullsized":"2023-11-20T07:00:58.493286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:44.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318481+0000","last_change":"2023-11-20T07:00:54.322610+0000","last_active":"2023-11-20T07:00:58.318481+0000","last_peered":"2023-11-20T07:00:58.318481+0000","last_clean":"2023-11-20T07:00:58.318481+0000","last_became_active":"2023-11-20T07:00:54.322196+0000","last_became_peered":"2023-11-20T07:00:54.322196+0000","last_unstale":"2023-11-20T07:00:58.318481+0000","last_undegraded":"2023-11-20T07:00:58.318481+0000","last_fullsized":"2023-11-20T07:00:58.318481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:34.029377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307622+0000","last_change":"2023-11-20T07:00:58.326848+0000","last_active":"2023-11-20T07:00:59.307622+0000","last_peered":"2023-11-20T07:00:59.307622+0000","last_clean":"2023-11-20T07:00:59.307622+0000","last_became_active":"2023-11-20T07:00:58.326426+0000","last_became_peered":"2023-11-20T07:00:58.326426+0000","last_unstale":"2023-11-20T07:00:59.307622+0000","last_undegraded":"2023-11-20T07:00:59.307622+0000","last_fullsized":"2023-11-20T07:00:59.307622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:21.571196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310719+0000","last_change":"2023-11-20T07:00:54.313413+0000","last_active":"2023-11-20T07:00:58.310719+0000","last_peered":"2023-11-20T07:00:58.310719+0000","last_clean":"2023-11-20T07:00:58.310719+0000","last_became_active":"2023-11-20T07:00:54.311349+0000","last_became_peered":"2023-11-20T07:00:54.311349+0000","last_unstale":"2023-11-20T07:00:58.310719+0000","last_undegraded":"2023-11-20T07:00:58.310719+0000","last_fullsized":"2023-11-20T07:00:58.310719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493287+0000","last_change":"2023-11-20T07:00:53.653466+0000","last_active":"2023-11-20T07:00:58.493287+0000","last_peered":"2023-11-20T07:00:58.493287+0000","last_clean":"2023-11-20T07:00:58.493287+0000","last_became_active":"2023-11-20T07:00:53.653211+0000","last_became_peered":"2023-11-20T07:00:53.653211+0000","last_unstale":"2023-11-20T07:00:58.493287+0000","last_undegraded":"2023-11-20T07:00:58.493287+0000","last_fullsized":"2023-11-20T07:00:58.493287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308698+0000","last_change":"2023-11-20T07:00:58.326758+0000","last_active":"2023-11-20T07:00:59.308698+0000","last_peered":"2023-11-20T07:00:59.308698+0000","last_clean":"2023-11-20T07:00:59.308698+0000","last_became_active":"2023-11-20T07:00:58.326338+0000","last_became_peered":"2023-11-20T07:00:58.326338+0000","last_unstale":"2023-11-20T07:00:59.308698+0000","last_undegraded":"2023-11-20T07:00:59.308698+0000","last_fullsized":"2023-11-20T07:00:59.308698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:37.701282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303367+0000","last_change":"2023-11-20T07:00:54.316618+0000","last_active":"2023-11-20T07:00:58.303367+0000","last_peered":"2023-11-20T07:00:58.303367+0000","last_clean":"2023-11-20T07:00:58.303367+0000","last_became_active":"2023-11-20T07:00:54.316344+0000","last_became_peered":"2023-11-20T07:00:54.316344+0000","last_unstale":"2023-11-20T07:00:58.303367+0000","last_undegraded":"2023-11-20T07:00:58.303367+0000","last_fullsized":"2023-11-20T07:00:58.303367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.319497+0000","last_change":"2023-11-20T07:00:53.648232+0000","last_active":"2023-11-20T07:00:58.319497+0000","last_peered":"2023-11-20T07:00:58.319497+0000","last_clean":"2023-11-20T07:00:58.319497+0000","last_became_active":"2023-11-20T07:00:53.647945+0000","last_became_peered":"2023-11-20T07:00:53.647945+0000","last_unstale":"2023-11-20T07:00:58.319497+0000","last_undegraded":"2023-11-20T07:00:58.319497+0000","last_fullsized":"2023-11-20T07:00:58.319497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:23:16.836796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308291+0000","last_change":"2023-11-20T07:00:58.328131+0000","last_active":"2023-11-20T07:00:59.308291+0000","last_peered":"2023-11-20T07:00:59.308291+0000","last_clean":"2023-11-20T07:00:59.308291+0000","last_became_active":"2023-11-20T07:00:58.327741+0000","last_became_peered":"2023-11-20T07:00:58.327741+0000","last_unstale":"2023-11-20T07:00:59.308291+0000","last_undegraded":"2023-11-20T07:00:59.308291+0000","last_fullsized":"2023-11-20T07:00:59.308291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:12.994548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303298+0000","last_change":"2023-11-20T07:00:54.310162+0000","last_active":"2023-11-20T07:00:58.303298+0000","last_peered":"2023-11-20T07:00:58.303298+0000","last_clean":"2023-11-20T07:00:58.303298+0000","last_became_active":"2023-11-20T07:00:54.309901+0000","last_became_peered":"2023-11-20T07:00:54.309901+0000","last_unstale":"2023-11-20T07:00:58.303298+0000","last_undegraded":"2023-11-20T07:00:58.303298+0000","last_fullsized":"2023-11-20T07:00:58.303298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316319+0000","last_change":"2023-11-20T07:00:53.647565+0000","last_active":"2023-11-20T07:00:58.316319+0000","last_peered":"2023-11-20T07:00:58.316319+0000","last_clean":"2023-11-20T07:00:58.316319+0000","last_became_active":"2023-11-20T07:00:53.647292+0000","last_became_peered":"2023-11-20T07:00:53.647292+0000","last_unstale":"2023-11-20T07:00:58.316319+0000","last_undegraded":"2023-11-20T07:00:58.316319+0000","last_fullsized":"2023-11-20T07:00:58.316319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:06.154369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.808266+0000","last_change":"2023-11-20T07:00:58.499121+0000","last_active":"2023-11-20T07:00:59.808266+0000","last_peered":"2023-11-20T07:00:59.808266+0000","last_clean":"2023-11-20T07:00:59.808266+0000","last_became_active":"2023-11-20T07:00:58.498681+0000","last_became_peered":"2023-11-20T07:00:58.498681+0000","last_unstale":"2023-11-20T07:00:59.808266+0000","last_undegraded":"2023-11-20T07:00:59.808266+0000","last_fullsized":"2023-11-20T07:00:59.808266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:19:25.697324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310377+0000","last_change":"2023-11-20T07:00:54.307003+0000","last_active":"2023-11-20T07:00:58.310377+0000","last_peered":"2023-11-20T07:00:58.310377+0000","last_clean":"2023-11-20T07:00:58.310377+0000","last_became_active":"2023-11-20T07:00:54.306416+0000","last_became_peered":"2023-11-20T07:00:54.306416+0000","last_unstale":"2023-11-20T07:00:58.310377+0000","last_undegraded":"2023-11-20T07:00:58.310377+0000","last_fullsized":"2023-11-20T07:00:58.310377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:00:19.316968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.492960+0000","last_change":"2023-11-20T07:00:53.658929+0000","last_active":"2023-11-20T07:00:58.492960+0000","last_peered":"2023-11-20T07:00:58.492960+0000","last_clean":"2023-11-20T07:00:58.492960+0000","last_became_active":"2023-11-20T07:00:53.656722+0000","last_became_peered":"2023-11-20T07:00:53.656722+0000","last_unstale":"2023-11-20T07:00:58.492960+0000","last_undegraded":"2023-11-20T07:00:58.492960+0000","last_fullsized":"2023-11-20T07:00:58.492960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:18.352244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308589+0000","last_change":"2023-11-20T07:00:58.328021+0000","last_active":"2023-11-20T07:00:59.308589+0000","last_peered":"2023-11-20T07:00:59.308589+0000","last_clean":"2023-11-20T07:00:59.308589+0000","last_became_active":"2023-11-20T07:00:58.327571+0000","last_became_peered":"2023-11-20T07:00:58.327571+0000","last_unstale":"2023-11-20T07:00:59.308589+0000","last_undegraded":"2023-11-20T07:00:59.308589+0000","last_fullsized":"2023-11-20T07:00:59.308589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:45.316086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326462+0000","last_change":"2023-11-20T07:00:54.307130+0000","last_active":"2023-11-20T07:00:58.326462+0000","last_peered":"2023-11-20T07:00:58.326462+0000","last_clean":"2023-11-20T07:00:58.326462+0000","last_became_active":"2023-11-20T07:00:54.306858+0000","last_became_peered":"2023-11-20T07:00:54.306858+0000","last_unstale":"2023-11-20T07:00:58.326462+0000","last_undegraded":"2023-11-20T07:00:58.326462+0000","last_fullsized":"2023-11-20T07:00:58.326462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:07.160493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311818+0000","last_change":"2023-11-20T07:00:53.658355+0000","last_active":"2023-11-20T07:00:58.311818+0000","last_peered":"2023-11-20T07:00:58.311818+0000","last_clean":"2023-11-20T07:00:58.311818+0000","last_became_active":"2023-11-20T07:00:53.657868+0000","last_became_peered":"2023-11-20T07:00:53.657868+0000","last_unstale":"2023-11-20T07:00:58.311818+0000","last_undegraded":"2023-11-20T07:00:58.311818+0000","last_fullsized":"2023-11-20T07:00:58.311818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308040+0000","last_change":"2023-11-20T07:00:58.500426+0000","last_active":"2023-11-20T07:00:59.308040+0000","last_peered":"2023-11-20T07:00:59.308040+0000","last_clean":"2023-11-20T07:00:59.308040+0000","last_became_active":"2023-11-20T07:00:58.498422+0000","last_became_peered":"2023-11-20T07:00:58.498422+0000","last_unstale":"2023-11-20T07:00:59.308040+0000","last_undegraded":"2023-11-20T07:00:59.308040+0000","last_fullsized":"2023-11-20T07:00:59.308040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:47.429541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.305106+0000","last_change":"2023-11-20T07:00:54.317201+0000","last_active":"2023-11-20T07:00:58.305106+0000","last_peered":"2023-11-20T07:00:58.305106+0000","last_clean":"2023-11-20T07:00:58.305106+0000","last_became_active":"2023-11-20T07:00:54.316914+0000","last_became_peered":"2023-11-20T07:00:54.316914+0000","last_unstale":"2023-11-20T07:00:58.305106+0000","last_undegraded":"2023-11-20T07:00:58.305106+0000","last_fullsized":"2023-11-20T07:00:58.305106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:09.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316138+0000","last_change":"2023-11-20T07:00:53.645493+0000","last_active":"2023-11-20T07:00:58.316138+0000","last_peered":"2023-11-20T07:00:58.316138+0000","last_clean":"2023-11-20T07:00:58.316138+0000","last_became_active":"2023-11-20T07:00:53.644350+0000","last_became_peered":"2023-11-20T07:00:53.644350+0000","last_unstale":"2023-11-20T07:00:58.316138+0000","last_undegraded":"2023-11-20T07:00:58.316138+0000","last_fullsized":"2023-11-20T07:00:58.316138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806145+0000","last_change":"2023-11-20T07:00:58.499371+0000","last_active":"2023-11-20T07:00:59.806145+0000","last_peered":"2023-11-20T07:00:59.806145+0000","last_clean":"2023-11-20T07:00:59.806145+0000","last_became_active":"2023-11-20T07:00:58.498953+0000","last_became_peered":"2023-11-20T07:00:58.498953+0000","last_unstale":"2023-11-20T07:00:59.806145+0000","last_undegraded":"2023-11-20T07:00:59.806145+0000","last_fullsized":"2023-11-20T07:00:59.806145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:03:22.099699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318416+0000","last_change":"2023-11-20T07:00:54.309275+0000","last_active":"2023-11-20T07:00:58.318416+0000","last_peered":"2023-11-20T07:00:58.318416+0000","last_clean":"2023-11-20T07:00:58.318416+0000","last_became_active":"2023-11-20T07:00:54.309012+0000","last_became_peered":"2023-11-20T07:00:54.309012+0000","last_unstale":"2023-11-20T07:00:58.318416+0000","last_undegraded":"2023-11-20T07:00:58.318416+0000","last_fullsized":"2023-11-20T07:00:58.318416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494554+0000","last_change":"2023-11-20T07:00:53.654465+0000","last_active":"2023-11-20T07:00:58.494554+0000","last_peered":"2023-11-20T07:00:58.494554+0000","last_clean":"2023-11-20T07:00:58.494554+0000","last_became_active":"2023-11-20T07:00:53.654148+0000","last_became_peered":"2023-11-20T07:00:53.654148+0000","last_unstale":"2023-11-20T07:00:58.494554+0000","last_undegraded":"2023-11-20T07:00:58.494554+0000","last_fullsized":"2023-11-20T07:00:58.494554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:38.670481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806267+0000","last_change":"2023-11-20T07:00:58.503543+0000","last_active":"2023-11-20T07:00:59.806267+0000","last_peered":"2023-11-20T07:00:59.806267+0000","last_clean":"2023-11-20T07:00:59.806267+0000","last_became_active":"2023-11-20T07:00:58.502762+0000","last_became_peered":"2023-11-20T07:00:58.502762+0000","last_unstale":"2023-11-20T07:00:59.806267+0000","last_undegraded":"2023-11-20T07:00:59.806267+0000","last_fullsized":"2023-11-20T07:00:59.806267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:45.316086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318563+0000","last_change":"2023-11-20T07:00:54.316224+0000","last_active":"2023-11-20T07:00:58.318563+0000","last_peered":"2023-11-20T07:00:58.318563+0000","last_clean":"2023-11-20T07:00:58.318563+0000","last_became_active":"2023-11-20T07:00:54.315909+0000","last_became_peered":"2023-11-20T07:00:54.315909+0000","last_unstale":"2023-11-20T07:00:58.318563+0000","last_undegraded":"2023-11-20T07:00:58.318563+0000","last_fullsized":"2023-11-20T07:00:58.318563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:04.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318503+0000","last_change":"2023-11-20T07:00:53.650522+0000","last_active":"2023-11-20T07:00:58.318503+0000","last_peered":"2023-11-20T07:00:58.318503+0000","last_clean":"2023-11-20T07:00:58.318503+0000","last_became_active":"2023-11-20T07:00:53.649787+0000","last_became_peered":"2023-11-20T07:00:53.649787+0000","last_unstale":"2023-11-20T07:00:58.318503+0000","last_undegraded":"2023-11-20T07:00:58.318503+0000","last_fullsized":"2023-11-20T07:00:58.318503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:18.352244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805309+0000","last_change":"2023-11-20T07:00:58.329318+0000","last_active":"2023-11-20T07:00:59.805309+0000","last_peered":"2023-11-20T07:00:59.805309+0000","last_clean":"2023-11-20T07:00:59.805309+0000","last_became_active":"2023-11-20T07:00:58.327572+0000","last_became_peered":"2023-11-20T07:00:58.327572+0000","last_unstale":"2023-11-20T07:00:59.805309+0000","last_undegraded":"2023-11-20T07:00:59.805309+0000","last_fullsized":"2023-11-20T07:00:59.805309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:34.090825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310713+0000","last_change":"2023-11-20T07:00:54.300938+0000","last_active":"2023-11-20T07:00:58.310713+0000","last_peered":"2023-11-20T07:00:58.310713+0000","last_clean":"2023-11-20T07:00:58.310713+0000","last_became_active":"2023-11-20T07:00:54.300489+0000","last_became_peered":"2023-11-20T07:00:54.300489+0000","last_unstale":"2023-11-20T07:00:58.310713+0000","last_undegraded":"2023-11-20T07:00:58.310713+0000","last_fullsized":"2023-11-20T07:00:58.310713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:19.358368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318471+0000","last_change":"2023-11-20T07:00:53.657372+0000","last_active":"2023-11-20T07:00:58.318471+0000","last_peered":"2023-11-20T07:00:58.318471+0000","last_clean":"2023-11-20T07:00:58.318471+0000","last_became_active":"2023-11-20T07:00:53.656783+0000","last_became_peered":"2023-11-20T07:00:53.656783+0000","last_unstale":"2023-11-20T07:00:58.318471+0000","last_undegraded":"2023-11-20T07:00:58.318471+0000","last_fullsized":"2023-11-20T07:00:58.318471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:06.245657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806936+0000","last_change":"2023-11-20T07:00:58.334074+0000","last_active":"2023-11-20T07:00:59.806936+0000","last_peered":"2023-11-20T07:00:59.806936+0000","last_clean":"2023-11-20T07:00:59.806936+0000","last_became_active":"2023-11-20T07:00:58.333819+0000","last_became_peered":"2023-11-20T07:00:58.333819+0000","last_unstale":"2023-11-20T07:00:59.806936+0000","last_undegraded":"2023-11-20T07:00:59.806936+0000","last_fullsized":"2023-11-20T07:00:59.806936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:08.554606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.315908+0000","last_change":"2023-11-20T07:00:54.308292+0000","last_active":"2023-11-20T07:00:58.315908+0000","last_peered":"2023-11-20T07:00:58.315908+0000","last_clean":"2023-11-20T07:00:58.315908+0000","last_became_active":"2023-11-20T07:00:54.306747+0000","last_became_peered":"2023-11-20T07:00:54.306747+0000","last_unstale":"2023-11-20T07:00:58.315908+0000","last_undegraded":"2023-11-20T07:00:58.315908+0000","last_fullsized":"2023-11-20T07:00:58.315908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.312862+0000","last_change":"2023-11-20T07:00:53.643036+0000","last_active":"2023-11-20T07:00:58.312862+0000","last_peered":"2023-11-20T07:00:58.312862+0000","last_clean":"2023-11-20T07:00:58.312862+0000","last_became_active":"2023-11-20T07:00:53.642571+0000","last_became_peered":"2023-11-20T07:00:53.642571+0000","last_unstale":"2023-11-20T07:00:58.312862+0000","last_undegraded":"2023-11-20T07:00:58.312862+0000","last_fullsized":"2023-11-20T07:00:58.312862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:44.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.808276+0000","last_change":"2023-11-20T07:00:58.333236+0000","last_active":"2023-11-20T07:00:59.808276+0000","last_peered":"2023-11-20T07:00:59.808276+0000","last_clean":"2023-11-20T07:00:59.808276+0000","last_became_active":"2023-11-20T07:00:58.332618+0000","last_became_peered":"2023-11-20T07:00:58.332618+0000","last_unstale":"2023-11-20T07:00:59.808276+0000","last_undegraded":"2023-11-20T07:00:59.808276+0000","last_fullsized":"2023-11-20T07:00:59.808276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:55:34.562598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318629+0000","last_change":"2023-11-20T07:00:54.297521+0000","last_active":"2023-11-20T07:00:58.318629+0000","last_peered":"2023-11-20T07:00:58.318629+0000","last_clean":"2023-11-20T07:00:58.318629+0000","last_became_active":"2023-11-20T07:00:54.297230+0000","last_became_peered":"2023-11-20T07:00:54.297230+0000","last_unstale":"2023-11-20T07:00:58.318629+0000","last_undegraded":"2023-11-20T07:00:58.318629+0000","last_fullsized":"2023-11-20T07:00:58.318629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:59:40.885687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.492983+0000","last_change":"2023-11-20T07:00:53.659113+0000","last_active":"2023-11-20T07:00:58.492983+0000","last_peered":"2023-11-20T07:00:58.492983+0000","last_clean":"2023-11-20T07:00:58.492983+0000","last_became_active":"2023-11-20T07:00:53.658547+0000","last_became_peered":"2023-11-20T07:00:53.658547+0000","last_unstale":"2023-11-20T07:00:58.492983+0000","last_undegraded":"2023-11-20T07:00:58.492983+0000","last_fullsized":"2023-11-20T07:00:58.492983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:38:48.212711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.807596+0000","last_change":"2023-11-20T07:00:58.503986+0000","last_active":"2023-11-20T07:00:59.807596+0000","last_peered":"2023-11-20T07:00:59.807596+0000","last_clean":"2023-11-20T07:00:59.807596+0000","last_became_active":"2023-11-20T07:00:58.503152+0000","last_became_peered":"2023-11-20T07:00:58.503152+0000","last_unstale":"2023-11-20T07:00:59.807596+0000","last_undegraded":"2023-11-20T07:00:59.807596+0000","last_fullsized":"2023-11-20T07:00:59.807596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:08.554606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.302885+0000","last_change":"2023-11-20T07:00:54.322661+0000","last_active":"2023-11-20T07:00:58.302885+0000","last_peered":"2023-11-20T07:00:58.302885+0000","last_clean":"2023-11-20T07:00:58.302885+0000","last_became_active":"2023-11-20T07:00:54.322420+0000","last_became_peered":"2023-11-20T07:00:54.322420+0000","last_unstale":"2023-11-20T07:00:58.302885+0000","last_undegraded":"2023-11-20T07:00:58.302885+0000","last_fullsized":"2023-11-20T07:00:58.302885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317887+0000","last_change":"2023-11-20T07:00:53.657962+0000","last_active":"2023-11-20T07:00:58.317887+0000","last_peered":"2023-11-20T07:00:58.317887+0000","last_clean":"2023-11-20T07:00:58.317887+0000","last_became_active":"2023-11-20T07:00:53.657573+0000","last_became_peered":"2023-11-20T07:00:53.657573+0000","last_unstale":"2023-11-20T07:00:58.317887+0000","last_undegraded":"2023-11-20T07:00:58.317887+0000","last_fullsized":"2023-11-20T07:00:58.317887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:20.103551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493065+0000","last_change":"2023-11-20T07:00:43.158695+0000","last_active":"2023-11-20T07:00:58.493065+0000","last_peered":"2023-11-20T07:00:58.493065+0000","last_clean":"2023-11-20T07:00:58.493065+0000","last_became_active":"2023-11-20T07:00:43.157454+0000","last_became_peered":"2023-11-20T07:00:43.157454+0000","last_unstale":"2023-11-20T07:00:58.493065+0000","last_undegraded":"2023-11-20T07:00:58.493065+0000","last_fullsized":"2023-11-20T07:00:58.493065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_clean_scrub_stamp":"2023-11-20T07:00:42.001721+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:44:20.907460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.306704+0000","last_change":"2023-11-20T07:00:58.498801+0000","last_active":"2023-11-20T07:00:59.306704+0000","last_peered":"2023-11-20T07:00:59.306704+0000","last_clean":"2023-11-20T07:00:59.306704+0000","last_became_active":"2023-11-20T07:00:58.498293+0000","last_became_peered":"2023-11-20T07:00:58.498293+0000","last_unstale":"2023-11-20T07:00:59.306704+0000","last_undegraded":"2023-11-20T07:00:59.306704+0000","last_fullsized":"2023-11-20T07:00:59.306704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:45.316086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493410+0000","last_change":"2023-11-20T07:00:54.327998+0000","last_active":"2023-11-20T07:00:58.493410+0000","last_peered":"2023-11-20T07:00:58.493410+0000","last_clean":"2023-11-20T07:00:58.493410+0000","last_became_active":"2023-11-20T07:00:54.327745+0000","last_became_peered":"2023-11-20T07:00:54.327745+0000","last_unstale":"2023-11-20T07:00:58.493410+0000","last_undegraded":"2023-11-20T07:00:58.493410+0000","last_fullsized":"2023-11-20T07:00:58.493410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:34.029377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.313957+0000","last_change":"2023-11-20T07:00:53.655190+0000","last_active":"2023-11-20T07:00:58.313957+0000","last_peered":"2023-11-20T07:00:58.313957+0000","last_clean":"2023-11-20T07:00:58.313957+0000","last_became_active":"2023-11-20T07:00:53.654911+0000","last_became_peered":"2023-11-20T07:00:53.654911+0000","last_unstale":"2023-11-20T07:00:58.313957+0000","last_undegraded":"2023-11-20T07:00:58.313957+0000","last_fullsized":"2023-11-20T07:00:58.313957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:00:18.310844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.306340+0000","last_change":"2023-11-20T07:00:58.494982+0000","last_active":"2023-11-20T07:00:59.306340+0000","last_peered":"2023-11-20T07:00:59.306340+0000","last_clean":"2023-11-20T07:00:59.306340+0000","last_became_active":"2023-11-20T07:00:58.494289+0000","last_became_peered":"2023-11-20T07:00:58.494289+0000","last_unstale":"2023-11-20T07:00:59.306340+0000","last_undegraded":"2023-11-20T07:00:59.306340+0000","last_fullsized":"2023-11-20T07:00:59.306340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:12.994548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317961+0000","last_change":"2023-11-20T07:00:54.313077+0000","last_active":"2023-11-20T07:00:58.317961+0000","last_peered":"2023-11-20T07:00:58.317961+0000","last_clean":"2023-11-20T07:00:58.317961+0000","last_became_active":"2023-11-20T07:00:54.312340+0000","last_became_peered":"2023-11-20T07:00:54.312340+0000","last_unstale":"2023-11-20T07:00:58.317961+0000","last_undegraded":"2023-11-20T07:00:58.317961+0000","last_fullsized":"2023-11-20T07:00:58.317961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:41.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317512+0000","last_change":"2023-11-20T07:00:53.645227+0000","last_active":"2023-11-20T07:00:58.317512+0000","last_peered":"2023-11-20T07:00:58.317512+0000","last_clean":"2023-11-20T07:00:58.317512+0000","last_became_active":"2023-11-20T07:00:53.644948+0000","last_became_peered":"2023-11-20T07:00:53.644948+0000","last_unstale":"2023-11-20T07:00:58.317512+0000","last_undegraded":"2023-11-20T07:00:58.317512+0000","last_fullsized":"2023-11-20T07:00:58.317512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:16.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806374+0000","last_change":"2023-11-20T07:00:58.328865+0000","last_active":"2023-11-20T07:00:59.806374+0000","last_peered":"2023-11-20T07:00:59.806374+0000","last_clean":"2023-11-20T07:00:59.806374+0000","last_became_active":"2023-11-20T07:00:58.326797+0000","last_became_peered":"2023-11-20T07:00:58.326797+0000","last_unstale":"2023-11-20T07:00:59.806374+0000","last_undegraded":"2023-11-20T07:00:59.806374+0000","last_fullsized":"2023-11-20T07:00:59.806374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:37.701282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494804+0000","last_change":"2023-11-20T07:00:54.322679+0000","last_active":"2023-11-20T07:00:58.494804+0000","last_peered":"2023-11-20T07:00:58.494804+0000","last_clean":"2023-11-20T07:00:58.494804+0000","last_became_active":"2023-11-20T07:00:54.322402+0000","last_became_peered":"2023-11-20T07:00:54.322402+0000","last_unstale":"2023-11-20T07:00:58.494804+0000","last_undegraded":"2023-11-20T07:00:58.494804+0000","last_fullsized":"2023-11-20T07:00:58.494804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:55:30.890692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.312002+0000","last_change":"2023-11-20T07:00:53.648554+0000","last_active":"2023-11-20T07:00:58.312002+0000","last_peered":"2023-11-20T07:00:58.312002+0000","last_clean":"2023-11-20T07:00:58.312002+0000","last_became_active":"2023-11-20T07:00:53.648235+0000","last_became_peered":"2023-11-20T07:00:53.648235+0000","last_unstale":"2023-11-20T07:00:58.312002+0000","last_undegraded":"2023-11-20T07:00:58.312002+0000","last_fullsized":"2023-11-20T07:00:58.312002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:49:18.352244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.804873+0000","last_change":"2023-11-20T07:00:58.495397+0000","last_active":"2023-11-20T07:00:59.804873+0000","last_peered":"2023-11-20T07:00:59.804873+0000","last_clean":"2023-11-20T07:00:59.804873+0000","last_became_active":"2023-11-20T07:00:58.494254+0000","last_became_peered":"2023-11-20T07:00:58.494254+0000","last_unstale":"2023-11-20T07:00:59.804873+0000","last_undegraded":"2023-11-20T07:00:59.804873+0000","last_fullsized":"2023-11-20T07:00:59.804873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:26.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494056+0000","last_change":"2023-11-20T07:00:54.323607+0000","last_active":"2023-11-20T07:00:58.494056+0000","last_peered":"2023-11-20T07:00:58.494056+0000","last_clean":"2023-11-20T07:00:58.494056+0000","last_became_active":"2023-11-20T07:00:54.322379+0000","last_became_peered":"2023-11-20T07:00:54.322379+0000","last_unstale":"2023-11-20T07:00:58.494056+0000","last_undegraded":"2023-11-20T07:00:58.494056+0000","last_fullsized":"2023-11-20T07:00:58.494056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:19.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310927+0000","last_change":"2023-11-20T07:00:53.649849+0000","last_active":"2023-11-20T07:00:58.310927+0000","last_peered":"2023-11-20T07:00:58.310927+0000","last_clean":"2023-11-20T07:00:58.310927+0000","last_became_active":"2023-11-20T07:00:53.649515+0000","last_became_peered":"2023-11-20T07:00:53.649515+0000","last_unstale":"2023-11-20T07:00:58.310927+0000","last_undegraded":"2023-11-20T07:00:58.310927+0000","last_fullsized":"2023-11-20T07:00:58.310927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307960+0000","last_change":"2023-11-20T07:00:58.323467+0000","last_active":"2023-11-20T07:00:59.307960+0000","last_peered":"2023-11-20T07:00:59.307960+0000","last_clean":"2023-11-20T07:00:59.307960+0000","last_became_active":"2023-11-20T07:00:58.323069+0000","last_became_peered":"2023-11-20T07:00:58.323069+0000","last_unstale":"2023-11-20T07:00:59.307960+0000","last_undegraded":"2023-11-20T07:00:59.307960+0000","last_fullsized":"2023-11-20T07:00:59.307960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:13.803757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493206+0000","last_change":"2023-11-20T07:00:54.319865+0000","last_active":"2023-11-20T07:00:58.493206+0000","last_peered":"2023-11-20T07:00:58.493206+0000","last_clean":"2023-11-20T07:00:58.493206+0000","last_became_active":"2023-11-20T07:00:54.319507+0000","last_became_peered":"2023-11-20T07:00:54.319507+0000","last_unstale":"2023-11-20T07:00:58.493206+0000","last_undegraded":"2023-11-20T07:00:58.493206+0000","last_fullsized":"2023-11-20T07:00:58.493206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:43.757635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.313020+0000","last_change":"2023-11-20T07:00:53.645113+0000","last_active":"2023-11-20T07:00:58.313020+0000","last_peered":"2023-11-20T07:00:58.313020+0000","last_clean":"2023-11-20T07:00:58.313020+0000","last_became_active":"2023-11-20T07:00:53.644649+0000","last_became_peered":"2023-11-20T07:00:53.644649+0000","last_unstale":"2023-11-20T07:00:58.313020+0000","last_undegraded":"2023-11-20T07:00:58.313020+0000","last_fullsized":"2023-11-20T07:00:58.313020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:40.618427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.807526+0000","last_change":"2023-11-20T07:00:58.331774+0000","last_active":"2023-11-20T07:00:59.807526+0000","last_peered":"2023-11-20T07:00:59.807526+0000","last_clean":"2023-11-20T07:00:59.807526+0000","last_became_active":"2023-11-20T07:00:58.331450+0000","last_became_peered":"2023-11-20T07:00:58.331450+0000","last_unstale":"2023-11-20T07:00:59.807526+0000","last_undegraded":"2023-11-20T07:00:59.807526+0000","last_fullsized":"2023-11-20T07:00:59.807526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:22.921101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.309552+0000","last_change":"2023-11-20T07:00:54.311720+0000","last_active":"2023-11-20T07:00:58.309552+0000","last_peered":"2023-11-20T07:00:58.309552+0000","last_clean":"2023-11-20T07:00:58.309552+0000","last_became_active":"2023-11-20T07:00:54.311043+0000","last_became_peered":"2023-11-20T07:00:54.311043+0000","last_unstale":"2023-11-20T07:00:58.309552+0000","last_undegraded":"2023-11-20T07:00:58.309552+0000","last_fullsized":"2023-11-20T07:00:58.309552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:16.073686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.309511+0000","last_change":"2023-11-20T07:00:53.641657+0000","last_active":"2023-11-20T07:00:58.309511+0000","last_peered":"2023-11-20T07:00:58.309511+0000","last_clean":"2023-11-20T07:00:58.309511+0000","last_became_active":"2023-11-20T07:00:53.641339+0000","last_became_peered":"2023-11-20T07:00:53.641339+0000","last_unstale":"2023-11-20T07:00:58.309511+0000","last_undegraded":"2023-11-20T07:00:58.309511+0000","last_fullsized":"2023-11-20T07:00:58.309511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:10.249731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806340+0000","last_change":"2023-11-20T07:00:58.499394+0000","last_active":"2023-11-20T07:00:59.806340+0000","last_peered":"2023-11-20T07:00:59.806340+0000","last_clean":"2023-11-20T07:00:59.806340+0000","last_became_active":"2023-11-20T07:00:58.498964+0000","last_became_peered":"2023-11-20T07:00:58.498964+0000","last_unstale":"2023-11-20T07:00:59.806340+0000","last_undegraded":"2023-11-20T07:00:59.806340+0000","last_fullsized":"2023-11-20T07:00:59.806340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:29:17.940481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493222+0000","last_change":"2023-11-20T07:00:54.322332+0000","last_active":"2023-11-20T07:00:58.493222+0000","last_peered":"2023-11-20T07:00:58.493222+0000","last_clean":"2023-11-20T07:00:58.493222+0000","last_became_active":"2023-11-20T07:00:54.322039+0000","last_became_peered":"2023-11-20T07:00:54.322039+0000","last_unstale":"2023-11-20T07:00:58.493222+0000","last_undegraded":"2023-11-20T07:00:58.493222+0000","last_fullsized":"2023-11-20T07:00:58.493222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:07:41.644181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318421+0000","last_change":"2023-11-20T07:00:53.658482+0000","last_active":"2023-11-20T07:00:58.318421+0000","last_peered":"2023-11-20T07:00:58.318421+0000","last_clean":"2023-11-20T07:00:58.318421+0000","last_became_active":"2023-11-20T07:00:53.657099+0000","last_became_peered":"2023-11-20T07:00:53.657099+0000","last_unstale":"2023-11-20T07:00:58.318421+0000","last_undegraded":"2023-11-20T07:00:58.318421+0000","last_fullsized":"2023-11-20T07:00:58.318421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:15.067561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805595+0000","last_change":"2023-11-20T07:00:58.495295+0000","last_active":"2023-11-20T07:00:59.805595+0000","last_peered":"2023-11-20T07:00:59.805595+0000","last_clean":"2023-11-20T07:00:59.805595+0000","last_became_active":"2023-11-20T07:00:58.494557+0000","last_became_peered":"2023-11-20T07:00:58.494557+0000","last_unstale":"2023-11-20T07:00:59.805595+0000","last_undegraded":"2023-11-20T07:00:59.805595+0000","last_fullsized":"2023-11-20T07:00:59.805595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:55:33.954628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.320074+0000","last_change":"2023-11-20T07:00:54.311785+0000","last_active":"2023-11-20T07:00:58.320074+0000","last_peered":"2023-11-20T07:00:58.320074+0000","last_clean":"2023-11-20T07:00:58.320074+0000","last_became_active":"2023-11-20T07:00:54.311435+0000","last_became_peered":"2023-11-20T07:00:54.311435+0000","last_unstale":"2023-11-20T07:00:58.320074+0000","last_undegraded":"2023-11-20T07:00:58.320074+0000","last_fullsized":"2023-11-20T07:00:58.320074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:27.408568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.319062+0000","last_change":"2023-11-20T07:00:53.651972+0000","last_active":"2023-11-20T07:00:58.319062+0000","last_peered":"2023-11-20T07:00:58.319062+0000","last_clean":"2023-11-20T07:00:58.319062+0000","last_became_active":"2023-11-20T07:00:53.651725+0000","last_became_peered":"2023-11-20T07:00:53.651725+0000","last_unstale":"2023-11-20T07:00:58.319062+0000","last_undegraded":"2023-11-20T07:00:58.319062+0000","last_fullsized":"2023-11-20T07:00:58.319062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:00:18.310844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806216+0000","last_change":"2023-11-20T07:00:58.498803+0000","last_active":"2023-11-20T07:00:59.806216+0000","last_peered":"2023-11-20T07:00:59.806216+0000","last_clean":"2023-11-20T07:00:59.806216+0000","last_became_active":"2023-11-20T07:00:58.498348+0000","last_became_peered":"2023-11-20T07:00:58.498348+0000","last_unstale":"2023-11-20T07:00:59.806216+0000","last_undegraded":"2023-11-20T07:00:59.806216+0000","last_fullsized":"2023-11-20T07:00:59.806216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:55:33.954628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493295+0000","last_change":"2023-11-20T07:00:54.320969+0000","last_active":"2023-11-20T07:00:58.493295+0000","last_peered":"2023-11-20T07:00:58.493295+0000","last_clean":"2023-11-20T07:00:58.493295+0000","last_became_active":"2023-11-20T07:00:54.320409+0000","last_became_peered":"2023-11-20T07:00:54.320409+0000","last_unstale":"2023-11-20T07:00:58.493295+0000","last_undegraded":"2023-11-20T07:00:58.493295+0000","last_fullsized":"2023-11-20T07:00:58.493295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:09.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:01:04.877592+0000","last_change":"2023-11-20T07:00:53.644264+0000","last_active":"2023-11-20T07:01:04.877592+0000","last_peered":"2023-11-20T07:01:04.877592+0000","last_clean":"2023-11-20T07:01:04.877592+0000","last_became_active":"2023-11-20T07:00:53.643140+0000","last_became_peered":"2023-11-20T07:00:53.643140+0000","last_unstale":"2023-11-20T07:01:04.877592+0000","last_undegraded":"2023-11-20T07:01:04.877592+0000","last_fullsized":"2023-11-20T07:01:04.877592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:34:36.600135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.806734+0000","last_change":"2023-11-20T07:00:58.328933+0000","last_active":"2023-11-20T07:00:59.806734+0000","last_peered":"2023-11-20T07:00:59.806734+0000","last_clean":"2023-11-20T07:00:59.806734+0000","last_became_active":"2023-11-20T07:00:58.328561+0000","last_became_peered":"2023-11-20T07:00:58.328561+0000","last_unstale":"2023-11-20T07:00:59.806734+0000","last_undegraded":"2023-11-20T07:00:59.806734+0000","last_fullsized":"2023-11-20T07:00:59.806734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:22.921101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310790+0000","last_change":"2023-11-20T07:00:54.309203+0000","last_active":"2023-11-20T07:00:58.310790+0000","last_peered":"2023-11-20T07:00:58.310790+0000","last_clean":"2023-11-20T07:00:58.310790+0000","last_became_active":"2023-11-20T07:00:54.308899+0000","last_became_peered":"2023-11-20T07:00:54.308899+0000","last_unstale":"2023-11-20T07:00:58.310790+0000","last_undegraded":"2023-11-20T07:00:58.310790+0000","last_fullsized":"2023-11-20T07:00:58.310790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:34:37.606259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317463+0000","last_change":"2023-11-20T07:00:53.656825+0000","last_active":"2023-11-20T07:00:58.317463+0000","last_peered":"2023-11-20T07:00:58.317463+0000","last_clean":"2023-11-20T07:00:58.317463+0000","last_became_active":"2023-11-20T07:00:53.656508+0000","last_became_peered":"2023-11-20T07:00:53.656508+0000","last_unstale":"2023-11-20T07:00:58.317463+0000","last_undegraded":"2023-11-20T07:00:58.317463+0000","last_fullsized":"2023-11-20T07:00:58.317463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:10.249731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.308277+0000","last_change":"2023-11-20T07:00:58.322540+0000","last_active":"2023-11-20T07:00:59.308277+0000","last_peered":"2023-11-20T07:00:59.308277+0000","last_clean":"2023-11-20T07:00:59.308277+0000","last_became_active":"2023-11-20T07:00:58.322104+0000","last_became_peered":"2023-11-20T07:00:58.322104+0000","last_unstale":"2023-11-20T07:00:59.308277+0000","last_undegraded":"2023-11-20T07:00:59.308277+0000","last_fullsized":"2023-11-20T07:00:59.308277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:42:00.476914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.326762+0000","last_change":"2023-11-20T07:00:54.318615+0000","last_active":"2023-11-20T07:00:58.326762+0000","last_peered":"2023-11-20T07:00:58.326762+0000","last_clean":"2023-11-20T07:00:58.326762+0000","last_became_active":"2023-11-20T07:00:54.318374+0000","last_became_peered":"2023-11-20T07:00:54.318374+0000","last_unstale":"2023-11-20T07:00:58.326762+0000","last_undegraded":"2023-11-20T07:00:58.326762+0000","last_fullsized":"2023-11-20T07:00:58.326762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318588+0000","last_change":"2023-11-20T07:00:53.663688+0000","last_active":"2023-11-20T07:00:58.318588+0000","last_peered":"2023-11-20T07:00:58.318588+0000","last_clean":"2023-11-20T07:00:58.318588+0000","last_became_active":"2023-11-20T07:00:53.663314+0000","last_became_peered":"2023-11-20T07:00:53.663314+0000","last_unstale":"2023-11-20T07:00:58.318588+0000","last_undegraded":"2023-11-20T07:00:58.318588+0000","last_fullsized":"2023-11-20T07:00:58.318588+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:38.340586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805253+0000","last_change":"2023-11-20T07:00:58.325558+0000","last_active":"2023-11-20T07:00:59.805253+0000","last_peered":"2023-11-20T07:00:59.805253+0000","last_clean":"2023-11-20T07:00:59.805253+0000","last_became_active":"2023-11-20T07:00:58.323820+0000","last_became_peered":"2023-11-20T07:00:58.323820+0000","last_unstale":"2023-11-20T07:00:59.805253+0000","last_undegraded":"2023-11-20T07:00:59.805253+0000","last_fullsized":"2023-11-20T07:00:59.805253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:56:08.258067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317817+0000","last_change":"2023-11-20T07:00:54.322025+0000","last_active":"2023-11-20T07:00:58.317817+0000","last_peered":"2023-11-20T07:00:58.317817+0000","last_clean":"2023-11-20T07:00:58.317817+0000","last_became_active":"2023-11-20T07:00:54.319123+0000","last_became_peered":"2023-11-20T07:00:54.319123+0000","last_unstale":"2023-11-20T07:00:58.317817+0000","last_undegraded":"2023-11-20T07:00:58.317817+0000","last_fullsized":"2023-11-20T07:00:58.317817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:30.418920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311738+0000","last_change":"2023-11-20T07:00:53.658099+0000","last_active":"2023-11-20T07:00:58.311738+0000","last_peered":"2023-11-20T07:00:58.311738+0000","last_clean":"2023-11-20T07:00:58.311738+0000","last_became_active":"2023-11-20T07:00:53.657497+0000","last_became_peered":"2023-11-20T07:00:53.657497+0000","last_unstale":"2023-11-20T07:00:58.311738+0000","last_undegraded":"2023-11-20T07:00:58.311738+0000","last_fullsized":"2023-11-20T07:00:58.311738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:59:39.879563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805495+0000","last_change":"2023-11-20T07:00:58.500441+0000","last_active":"2023-11-20T07:00:59.805495+0000","last_peered":"2023-11-20T07:00:59.805495+0000","last_clean":"2023-11-20T07:00:59.805495+0000","last_became_active":"2023-11-20T07:00:58.499609+0000","last_became_peered":"2023-11-20T07:00:58.499609+0000","last_unstale":"2023-11-20T07:00:59.805495+0000","last_undegraded":"2023-11-20T07:00:59.805495+0000","last_fullsized":"2023-11-20T07:00:59.805495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:25:26.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.807449+0000","last_change":"2023-11-20T07:00:58.503634+0000","last_active":"2023-11-20T07:00:59.807449+0000","last_peered":"2023-11-20T07:00:59.807449+0000","last_clean":"2023-11-20T07:00:59.807449+0000","last_became_active":"2023-11-20T07:00:58.503079+0000","last_became_peered":"2023-11-20T07:00:58.503079+0000","last_unstale":"2023-11-20T07:00:59.807449+0000","last_undegraded":"2023-11-20T07:00:59.807449+0000","last_fullsized":"2023-11-20T07:00:59.807449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:34.090825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316198+0000","last_change":"2023-11-20T07:00:54.313144+0000","last_active":"2023-11-20T07:00:58.316198+0000","last_peered":"2023-11-20T07:00:58.316198+0000","last_clean":"2023-11-20T07:00:58.316198+0000","last_became_active":"2023-11-20T07:00:54.312847+0000","last_became_peered":"2023-11-20T07:00:54.312847+0000","last_unstale":"2023-11-20T07:00:58.316198+0000","last_undegraded":"2023-11-20T07:00:58.316198+0000","last_fullsized":"2023-11-20T07:00:58.316198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318078+0000","last_change":"2023-11-20T07:00:53.653998+0000","last_active":"2023-11-20T07:00:58.318078+0000","last_peered":"2023-11-20T07:00:58.318078+0000","last_clean":"2023-11-20T07:00:58.318078+0000","last_became_active":"2023-11-20T07:00:53.653691+0000","last_became_peered":"2023-11-20T07:00:53.653691+0000","last_unstale":"2023-11-20T07:00:58.318078+0000","last_undegraded":"2023-11-20T07:00:58.318078+0000","last_fullsized":"2023-11-20T07:00:58.318078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:06.154369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.307016+0000","last_change":"2023-11-20T07:00:58.328082+0000","last_active":"2023-11-20T07:00:59.307016+0000","last_peered":"2023-11-20T07:00:59.307016+0000","last_clean":"2023-11-20T07:00:59.307016+0000","last_became_active":"2023-11-20T07:00:58.327691+0000","last_became_peered":"2023-11-20T07:00:58.327691+0000","last_unstale":"2023-11-20T07:00:59.307016+0000","last_undegraded":"2023-11-20T07:00:59.307016+0000","last_fullsized":"2023-11-20T07:00:59.307016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:11:37.701282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303177+0000","last_change":"2023-11-20T07:00:54.313955+0000","last_active":"2023-11-20T07:00:58.303177+0000","last_peered":"2023-11-20T07:00:58.303177+0000","last_clean":"2023-11-20T07:00:58.303177+0000","last_became_active":"2023-11-20T07:00:54.313653+0000","last_became_peered":"2023-11-20T07:00:54.313653+0000","last_unstale":"2023-11-20T07:00:58.303177+0000","last_undegraded":"2023-11-20T07:00:58.303177+0000","last_fullsized":"2023-11-20T07:00:58.303177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303337+0000","last_change":"2023-11-20T07:00:53.649943+0000","last_active":"2023-11-20T07:00:58.303337+0000","last_peered":"2023-11-20T07:00:58.303337+0000","last_clean":"2023-11-20T07:00:58.303337+0000","last_became_active":"2023-11-20T07:00:53.649583+0000","last_became_peered":"2023-11-20T07:00:53.649583+0000","last_unstale":"2023-11-20T07:00:58.303337+0000","last_undegraded":"2023-11-20T07:00:58.303337+0000","last_fullsized":"2023-11-20T07:00:58.303337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:44.552974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310821+0000","last_change":"2023-11-20T07:00:53.641711+0000","last_active":"2023-11-20T07:00:58.310821+0000","last_peered":"2023-11-20T07:00:58.310821+0000","last_clean":"2023-11-20T07:00:58.310821+0000","last_became_active":"2023-11-20T07:00:53.641380+0000","last_became_peered":"2023-11-20T07:00:53.641380+0000","last_unstale":"2023-11-20T07:00:58.310821+0000","last_undegraded":"2023-11-20T07:00:58.310821+0000","last_fullsized":"2023-11-20T07:00:58.310821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:16.908664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318975+0000","last_change":"2023-11-20T07:00:54.299129+0000","last_active":"2023-11-20T07:00:58.318975+0000","last_peered":"2023-11-20T07:00:58.318975+0000","last_clean":"2023-11-20T07:00:58.318975+0000","last_became_active":"2023-11-20T07:00:54.298681+0000","last_became_peered":"2023-11-20T07:00:54.298681+0000","last_unstale":"2023-11-20T07:00:58.318975+0000","last_undegraded":"2023-11-20T07:00:58.318975+0000","last_fullsized":"2023-11-20T07:00:58.318975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.305689+0000","last_change":"2023-11-20T07:00:58.328570+0000","last_active":"2023-11-20T07:00:59.305689+0000","last_peered":"2023-11-20T07:00:59.305689+0000","last_clean":"2023-11-20T07:00:59.305689+0000","last_became_active":"2023-11-20T07:00:58.328166+0000","last_became_peered":"2023-11-20T07:00:58.328166+0000","last_unstale":"2023-11-20T07:00:59.305689+0000","last_undegraded":"2023-11-20T07:00:59.305689+0000","last_fullsized":"2023-11-20T07:00:59.305689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:33:10.832398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303452+0000","last_change":"2023-11-20T07:00:53.653770+0000","last_active":"2023-11-20T07:00:58.303452+0000","last_peered":"2023-11-20T07:00:58.303452+0000","last_clean":"2023-11-20T07:00:58.303452+0000","last_became_active":"2023-11-20T07:00:53.653466+0000","last_became_peered":"2023-11-20T07:00:53.653466+0000","last_unstale":"2023-11-20T07:00:58.303452+0000","last_undegraded":"2023-11-20T07:00:58.303452+0000","last_fullsized":"2023-11-20T07:00:58.303452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:52.614282+0000","last_clean_scrub_stamp":"2023-11-20T07:00:52.614282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:07:26.402443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310410+0000","last_change":"2023-11-20T07:00:54.308587+0000","last_active":"2023-11-20T07:00:58.310410+0000","last_peered":"2023-11-20T07:00:58.310410+0000","last_clean":"2023-11-20T07:00:58.310410+0000","last_became_active":"2023-11-20T07:00:54.308181+0000","last_became_peered":"2023-11-20T07:00:54.308181+0000","last_unstale":"2023-11-20T07:00:58.310410+0000","last_undegraded":"2023-11-20T07:00:58.310410+0000","last_fullsized":"2023-11-20T07:00:58.310410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:30:45.559098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-11-20T07:00:59.805869+0000","last_change":"2023-11-20T07:00:58.326468+0000","last_active":"2023-11-20T07:00:59.805869+0000","last_peered":"2023-11-20T07:00:59.805869+0000","last_clean":"2023-11-20T07:00:59.805869+0000","last_became_active":"2023-11-20T07:00:58.325258+0000","last_became_peered":"2023-11-20T07:00:58.325258+0000","last_unstale":"2023-11-20T07:00:59.805869+0000","last_undegraded":"2023-11-20T07:00:59.805869+0000","last_fullsized":"2023-11-20T07:00:59.805869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:57.292312+0000","last_clean_scrub_stamp":"2023-11-20T07:00:57.292312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:58:39.439432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.309466+0000","last_change":"2023-11-20T07:00:54.304862+0000","last_active":"2023-11-20T07:00:58.309466+0000","last_peered":"2023-11-20T07:00:58.309466+0000","last_clean":"2023-11-20T07:00:58.309466+0000","last_became_active":"2023-11-20T07:00:54.303650+0000","last_became_peered":"2023-11-20T07:00:54.303650+0000","last_unstale":"2023-11-20T07:00:58.309466+0000","last_undegraded":"2023-11-20T07:00:58.309466+0000","last_fullsized":"2023-11-20T07:00:58.309466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.312778+0000","last_change":"2023-11-20T07:00:54.324075+0000","last_active":"2023-11-20T07:00:58.312778+0000","last_peered":"2023-11-20T07:00:58.312778+0000","last_clean":"2023-11-20T07:00:58.312778+0000","last_became_active":"2023-11-20T07:00:54.323676+0000","last_became_peered":"2023-11-20T07:00:54.323676+0000","last_unstale":"2023-11-20T07:00:58.312778+0000","last_undegraded":"2023-11-20T07:00:58.312778+0000","last_fullsized":"2023-11-20T07:00:58.312778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:34:37.606259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318377+0000","last_change":"2023-11-20T07:00:54.318169+0000","last_active":"2023-11-20T07:00:58.318377+0000","last_peered":"2023-11-20T07:00:58.318377+0000","last_clean":"2023-11-20T07:00:58.318377+0000","last_became_active":"2023-11-20T07:00:54.317900+0000","last_became_peered":"2023-11-20T07:00:54.317900+0000","last_unstale":"2023-11-20T07:00:58.318377+0000","last_undegraded":"2023-11-20T07:00:58.318377+0000","last_fullsized":"2023-11-20T07:00:58.318377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:55:09.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318884+0000","last_change":"2023-11-20T07:00:54.312618+0000","last_active":"2023-11-20T07:00:58.318884+0000","last_peered":"2023-11-20T07:00:58.318884+0000","last_clean":"2023-11-20T07:00:58.318884+0000","last_became_active":"2023-11-20T07:00:54.312347+0000","last_became_peered":"2023-11-20T07:00:54.312347+0000","last_unstale":"2023-11-20T07:00:58.318884+0000","last_undegraded":"2023-11-20T07:00:58.318884+0000","last_fullsized":"2023-11-20T07:00:58.318884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303777+0000","last_change":"2023-11-20T07:00:54.320244+0000","last_active":"2023-11-20T07:00:58.303777+0000","last_peered":"2023-11-20T07:00:58.303777+0000","last_clean":"2023-11-20T07:00:58.303777+0000","last_became_active":"2023-11-20T07:00:54.319980+0000","last_became_peered":"2023-11-20T07:00:54.319980+0000","last_unstale":"2023-11-20T07:00:58.303777+0000","last_undegraded":"2023-11-20T07:00:58.303777+0000","last_fullsized":"2023-11-20T07:00:58.303777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:10.131851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317033+0000","last_change":"2023-11-20T07:00:54.306675+0000","last_active":"2023-11-20T07:00:58.317033+0000","last_peered":"2023-11-20T07:00:58.317033+0000","last_clean":"2023-11-20T07:00:58.317033+0000","last_became_active":"2023-11-20T07:00:54.306368+0000","last_became_peered":"2023-11-20T07:00:54.306368+0000","last_unstale":"2023-11-20T07:00:58.317033+0000","last_undegraded":"2023-11-20T07:00:58.317033+0000","last_fullsized":"2023-11-20T07:00:58.317033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311347+0000","last_change":"2023-11-20T07:00:54.311331+0000","last_active":"2023-11-20T07:00:58.311347+0000","last_peered":"2023-11-20T07:00:58.311347+0000","last_clean":"2023-11-20T07:00:58.311347+0000","last_became_active":"2023-11-20T07:00:54.311018+0000","last_became_peered":"2023-11-20T07:00:54.311018+0000","last_unstale":"2023-11-20T07:00:58.311347+0000","last_undegraded":"2023-11-20T07:00:58.311347+0000","last_fullsized":"2023-11-20T07:00:58.311347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.305111+0000","last_change":"2023-11-20T07:00:54.319932+0000","last_active":"2023-11-20T07:00:58.305111+0000","last_peered":"2023-11-20T07:00:58.305111+0000","last_clean":"2023-11-20T07:00:58.305111+0000","last_became_active":"2023-11-20T07:00:54.319701+0000","last_became_peered":"2023-11-20T07:00:54.319701+0000","last_unstale":"2023-11-20T07:00:58.305111+0000","last_undegraded":"2023-11-20T07:00:58.305111+0000","last_fullsized":"2023-11-20T07:00:58.305111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:41:56.805008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318044+0000","last_change":"2023-11-20T07:00:54.318299+0000","last_active":"2023-11-20T07:00:58.318044+0000","last_peered":"2023-11-20T07:00:58.318044+0000","last_clean":"2023-11-20T07:00:58.318044+0000","last_became_active":"2023-11-20T07:00:54.312610+0000","last_became_peered":"2023-11-20T07:00:54.312610+0000","last_unstale":"2023-11-20T07:00:58.318044+0000","last_undegraded":"2023-11-20T07:00:58.318044+0000","last_fullsized":"2023-11-20T07:00:58.318044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303139+0000","last_change":"2023-11-20T07:00:54.316271+0000","last_active":"2023-11-20T07:00:58.303139+0000","last_peered":"2023-11-20T07:00:58.303139+0000","last_clean":"2023-11-20T07:00:58.303139+0000","last_became_active":"2023-11-20T07:00:54.315955+0000","last_became_peered":"2023-11-20T07:00:54.315955+0000","last_unstale":"2023-11-20T07:00:58.303139+0000","last_undegraded":"2023-11-20T07:00:58.303139+0000","last_fullsized":"2023-11-20T07:00:58.303139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:37:21.109675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318282+0000","last_change":"2023-11-20T07:00:54.317416+0000","last_active":"2023-11-20T07:00:58.318282+0000","last_peered":"2023-11-20T07:00:58.318282+0000","last_clean":"2023-11-20T07:00:58.318282+0000","last_became_active":"2023-11-20T07:00:54.316794+0000","last_became_peered":"2023-11-20T07:00:54.316794+0000","last_unstale":"2023-11-20T07:00:58.318282+0000","last_undegraded":"2023-11-20T07:00:58.318282+0000","last_fullsized":"2023-11-20T07:00:58.318282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:19:43.757635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318783+0000","last_change":"2023-11-20T07:00:54.308603+0000","last_active":"2023-11-20T07:00:58.318783+0000","last_peered":"2023-11-20T07:00:58.318783+0000","last_clean":"2023-11-20T07:00:58.318783+0000","last_became_active":"2023-11-20T07:00:54.308324+0000","last_became_peered":"2023-11-20T07:00:54.308324+0000","last_unstale":"2023-11-20T07:00:58.318783+0000","last_undegraded":"2023-11-20T07:00:58.318783+0000","last_fullsized":"2023-11-20T07:00:58.318783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:29:07.251781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310585+0000","last_change":"2023-11-20T07:00:54.315438+0000","last_active":"2023-11-20T07:00:58.310585+0000","last_peered":"2023-11-20T07:00:58.310585+0000","last_clean":"2023-11-20T07:00:58.310585+0000","last_became_active":"2023-11-20T07:00:54.315182+0000","last_became_peered":"2023-11-20T07:00:54.315182+0000","last_unstale":"2023-11-20T07:00:58.310585+0000","last_undegraded":"2023-11-20T07:00:58.310585+0000","last_fullsized":"2023-11-20T07:00:58.310585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:04:39.346710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493594+0000","last_change":"2023-11-20T07:00:54.320102+0000","last_active":"2023-11-20T07:00:58.493594+0000","last_peered":"2023-11-20T07:00:58.493594+0000","last_clean":"2023-11-20T07:00:58.493594+0000","last_became_active":"2023-11-20T07:00:54.313876+0000","last_became_peered":"2023-11-20T07:00:54.313876+0000","last_unstale":"2023-11-20T07:00:58.493594+0000","last_undegraded":"2023-11-20T07:00:58.493594+0000","last_fullsized":"2023-11-20T07:00:58.493594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:24:30.418920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.314165+0000","last_change":"2023-11-20T07:00:54.308769+0000","last_active":"2023-11-20T07:00:58.314165+0000","last_peered":"2023-11-20T07:00:58.314165+0000","last_clean":"2023-11-20T07:00:58.314165+0000","last_became_active":"2023-11-20T07:00:54.307885+0000","last_became_peered":"2023-11-20T07:00:54.307885+0000","last_unstale":"2023-11-20T07:00:58.314165+0000","last_undegraded":"2023-11-20T07:00:58.314165+0000","last_fullsized":"2023-11-20T07:00:58.314165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:53:11.255855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318308+0000","last_change":"2023-11-20T07:00:54.318879+0000","last_active":"2023-11-20T07:00:58.318308+0000","last_peered":"2023-11-20T07:00:58.318308+0000","last_clean":"2023-11-20T07:00:58.318308+0000","last_became_active":"2023-11-20T07:00:54.318590+0000","last_became_peered":"2023-11-20T07:00:54.318590+0000","last_unstale":"2023-11-20T07:00:58.318308+0000","last_undegraded":"2023-11-20T07:00:58.318308+0000","last_fullsized":"2023-11-20T07:00:58.318308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:51:19.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317955+0000","last_change":"2023-11-20T07:00:54.318760+0000","last_active":"2023-11-20T07:00:58.317955+0000","last_peered":"2023-11-20T07:00:58.317955+0000","last_clean":"2023-11-20T07:00:58.317955+0000","last_became_active":"2023-11-20T07:00:54.318437+0000","last_became_peered":"2023-11-20T07:00:54.318437+0000","last_unstale":"2023-11-20T07:00:58.317955+0000","last_undegraded":"2023-11-20T07:00:58.317955+0000","last_fullsized":"2023-11-20T07:00:58.317955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316266+0000","last_change":"2023-11-20T07:00:54.315538+0000","last_active":"2023-11-20T07:00:58.316266+0000","last_peered":"2023-11-20T07:00:58.316266+0000","last_clean":"2023-11-20T07:00:58.316266+0000","last_became_active":"2023-11-20T07:00:54.315233+0000","last_became_peered":"2023-11-20T07:00:54.315233+0000","last_unstale":"2023-11-20T07:00:58.316266+0000","last_undegraded":"2023-11-20T07:00:58.316266+0000","last_fullsized":"2023-11-20T07:00:58.316266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.319999+0000","last_change":"2023-11-20T07:00:54.307661+0000","last_active":"2023-11-20T07:00:58.319999+0000","last_peered":"2023-11-20T07:00:58.319999+0000","last_clean":"2023-11-20T07:00:58.319999+0000","last_became_active":"2023-11-20T07:00:54.306975+0000","last_became_peered":"2023-11-20T07:00:54.306975+0000","last_unstale":"2023-11-20T07:00:58.319999+0000","last_undegraded":"2023-11-20T07:00:58.319999+0000","last_fullsized":"2023-11-20T07:00:58.319999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:49:17.914788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.303292+0000","last_change":"2023-11-20T07:00:54.307989+0000","last_active":"2023-11-20T07:00:58.303292+0000","last_peered":"2023-11-20T07:00:58.303292+0000","last_clean":"2023-11-20T07:00:58.303292+0000","last_became_active":"2023-11-20T07:00:54.307712+0000","last_became_peered":"2023-11-20T07:00:54.307712+0000","last_unstale":"2023-11-20T07:00:58.303292+0000","last_undegraded":"2023-11-20T07:00:58.303292+0000","last_fullsized":"2023-11-20T07:00:58.303292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.310788+0000","last_change":"2023-11-20T07:00:54.307874+0000","last_active":"2023-11-20T07:00:58.310788+0000","last_peered":"2023-11-20T07:00:58.310788+0000","last_clean":"2023-11-20T07:00:58.310788+0000","last_became_active":"2023-11-20T07:00:54.307257+0000","last_became_peered":"2023-11-20T07:00:54.307257+0000","last_unstale":"2023-11-20T07:00:58.310788+0000","last_undegraded":"2023-11-20T07:00:58.310788+0000","last_fullsized":"2023-11-20T07:00:58.310788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:38:49.218835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311723+0000","last_change":"2023-11-20T07:00:54.320026+0000","last_active":"2023-11-20T07:00:58.311723+0000","last_peered":"2023-11-20T07:00:58.311723+0000","last_clean":"2023-11-20T07:00:58.311723+0000","last_became_active":"2023-11-20T07:00:54.319737+0000","last_became_peered":"2023-11-20T07:00:54.319737+0000","last_unstale":"2023-11-20T07:00:58.311723+0000","last_undegraded":"2023-11-20T07:00:58.311723+0000","last_fullsized":"2023-11-20T07:00:58.311723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.311297+0000","last_change":"2023-11-20T07:00:54.323404+0000","last_active":"2023-11-20T07:00:58.311297+0000","last_peered":"2023-11-20T07:00:58.311297+0000","last_clean":"2023-11-20T07:00:58.311297+0000","last_became_active":"2023-11-20T07:00:54.323122+0000","last_became_peered":"2023-11-20T07:00:54.323122+0000","last_unstale":"2023-11-20T07:00:58.311297+0000","last_undegraded":"2023-11-20T07:00:58.311297+0000","last_fullsized":"2023-11-20T07:00:58.311297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:11:39.676605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494710+0000","last_change":"2023-11-20T07:00:54.320729+0000","last_active":"2023-11-20T07:00:58.494710+0000","last_peered":"2023-11-20T07:00:58.494710+0000","last_clean":"2023-11-20T07:00:58.494710+0000","last_became_active":"2023-11-20T07:00:54.320394+0000","last_became_peered":"2023-11-20T07:00:54.320394+0000","last_unstale":"2023-11-20T07:00:58.494710+0000","last_undegraded":"2023-11-20T07:00:58.494710+0000","last_fullsized":"2023-11-20T07:00:58.494710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:19:22.025419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.302533+0000","last_change":"2023-11-20T07:00:54.322697+0000","last_active":"2023-11-20T07:00:58.302533+0000","last_peered":"2023-11-20T07:00:58.302533+0000","last_clean":"2023-11-20T07:00:58.302533+0000","last_became_active":"2023-11-20T07:00:54.322432+0000","last_became_peered":"2023-11-20T07:00:54.322432+0000","last_unstale":"2023-11-20T07:00:58.302533+0000","last_undegraded":"2023-11-20T07:00:58.302533+0000","last_fullsized":"2023-11-20T07:00:58.302533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:53:16.073686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493090+0000","last_change":"2023-11-20T07:00:54.319125+0000","last_active":"2023-11-20T07:00:58.493090+0000","last_peered":"2023-11-20T07:00:58.493090+0000","last_clean":"2023-11-20T07:00:58.493090+0000","last_became_active":"2023-11-20T07:00:54.314729+0000","last_became_peered":"2023-11-20T07:00:54.314729+0000","last_unstale":"2023-11-20T07:00:58.493090+0000","last_undegraded":"2023-11-20T07:00:58.493090+0000","last_fullsized":"2023-11-20T07:00:58.493090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:10.131851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318318+0000","last_change":"2023-11-20T07:00:54.317580+0000","last_active":"2023-11-20T07:00:58.318318+0000","last_peered":"2023-11-20T07:00:58.318318+0000","last_clean":"2023-11-20T07:00:58.318318+0000","last_became_active":"2023-11-20T07:00:54.317144+0000","last_became_peered":"2023-11-20T07:00:54.317144+0000","last_unstale":"2023-11-20T07:00:58.318318+0000","last_undegraded":"2023-11-20T07:00:58.318318+0000","last_fullsized":"2023-11-20T07:00:58.318318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:29:10.131851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.493163+0000","last_change":"2023-11-20T07:00:54.313588+0000","last_active":"2023-11-20T07:00:58.493163+0000","last_peered":"2023-11-20T07:00:58.493163+0000","last_clean":"2023-11-20T07:00:58.493163+0000","last_became_active":"2023-11-20T07:00:54.309057+0000","last_became_peered":"2023-11-20T07:00:54.309057+0000","last_unstale":"2023-11-20T07:00:58.493163+0000","last_undegraded":"2023-11-20T07:00:58.493163+0000","last_fullsized":"2023-11-20T07:00:58.493163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:41:56.805008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.317745+0000","last_change":"2023-11-20T07:00:54.316503+0000","last_active":"2023-11-20T07:00:58.317745+0000","last_peered":"2023-11-20T07:00:58.317745+0000","last_clean":"2023-11-20T07:00:58.317745+0000","last_became_active":"2023-11-20T07:00:54.316046+0000","last_became_peered":"2023-11-20T07:00:54.316046+0000","last_unstale":"2023-11-20T07:00:58.317745+0000","last_undegraded":"2023-11-20T07:00:58.317745+0000","last_fullsized":"2023-11-20T07:00:58.317745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:58:17.899290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.318929+0000","last_change":"2023-11-20T07:00:54.303021+0000","last_active":"2023-11-20T07:00:58.318929+0000","last_peered":"2023-11-20T07:00:58.318929+0000","last_clean":"2023-11-20T07:00:58.318929+0000","last_became_active":"2023-11-20T07:00:54.302616+0000","last_became_peered":"2023-11-20T07:00:54.302616+0000","last_unstale":"2023-11-20T07:00:58.318929+0000","last_undegraded":"2023-11-20T07:00:58.318929+0000","last_fullsized":"2023-11-20T07:00:58.318929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T18:23:17.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.316083+0000","last_change":"2023-11-20T07:00:54.310934+0000","last_active":"2023-11-20T07:00:58.316083+0000","last_peered":"2023-11-20T07:00:58.316083+0000","last_clean":"2023-11-20T07:00:58.316083+0000","last_became_active":"2023-11-20T07:00:54.306577+0000","last_became_peered":"2023-11-20T07:00:54.306577+0000","last_unstale":"2023-11-20T07:00:58.316083+0000","last_undegraded":"2023-11-20T07:00:58.316083+0000","last_fullsized":"2023-11-20T07:00:58.316083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:55:19.040822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-20T07:00:58.494543+0000","last_change":"2023-11-20T07:00:54.313082+0000","last_active":"2023-11-20T07:00:58.494543+0000","last_peered":"2023-11-20T07:00:58.494543+0000","last_clean":"2023-11-20T07:00:58.494543+0000","last_became_active":"2023-11-20T07:00:54.312728+0000","last_became_peered":"2023-11-20T07:00:54.312728+0000","last_unstale":"2023-11-20T07:00:58.494543+0000","last_undegraded":"2023-11-20T07:00:58.494543+0000","last_fullsized":"2023-11-20T07:00:58.494543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:53.620406+0000","last_clean_scrub_stamp":"2023-11-20T07:00:53.620406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:11:04.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7410000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7639999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7919999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T07:01:23.622 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-20T07:01:23.622 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-20T07:01:23.622 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-20T07:01:23.623 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-20T07:01:23.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae4780640 1 Processor -- start 2023-11-20T07:01:23.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae4780640 1 -- start start 2023-11-20T07:01:23.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae4780640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3adc15cb90 0x7f3adc0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae4780640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3adc0d3010 0x7f3adc0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae4780640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3adc0ce770 con 0x7f3adc0d1400 2023-11-20T07:01:23.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae4780640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3adc0d1890 con 0x7f3adc0d3010 2023-11-20T07:01:23.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae4780640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0d0600 con 0x7f3adc15cb90 2023-11-20T07:01:23.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae2d1d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3adc0d1400 0x7f3adc0cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52616/0 (socket says 172.21.15.88:52616) 2023-11-20T07:01:23.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae2d1d640 1 -- 172.21.15.88:0/3606510937 learned_addr learned my addr 172.21.15.88:0/3606510937 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:23.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae1d1b640 1 --2- 172.21.15.88:0/3606510937 >> v2:172.21.15.175:3300/0 conn(0x7f3adc0d3010 0x7f3adc0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae251c640 1 --2- 172.21.15.88:0/3606510937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3adc15cb90 0x7f3adc0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae151a640 1 -- 172.21.15.88:0/3606510937 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178996826 0 0) 0x7f3adc0ce770 con 0x7f3adc0d1400 2023-11-20T07:01:23.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae151a640 1 -- 172.21.15.88:0/3606510937 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac8003530 con 0x7f3adc0d1400 2023-11-20T07:01:23.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae151a640 1 -- 172.21.15.88:0/3606510937 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2783513222 0 0) 0x7f3ac8003530 con 0x7f3adc0d1400 2023-11-20T07:01:23.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae1d1b640 1 -- 172.21.15.88:0/3606510937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3adc15cb90 msgr2=0x7f3adc0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:23.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae1d1b640 1 --2- 172.21.15.88:0/3606510937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3adc15cb90 0x7f3adc0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae1d1b640 1 -- 172.21.15.88:0/3606510937 >> v1:172.21.15.88:6789/0 conn(0x7f3adc0d1400 legacy=0x7f3adc0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae1d1b640 1 -- 172.21.15.88:0/3606510937 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc0c6450 con 0x7f3adc0d3010 2023-11-20T07:01:23.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.794+0000 7f3ae251c640 1 --2- 172.21.15.88:0/3606510937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3adc15cb90 0x7f3adc0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:23.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.798+0000 7f3ae1d1b640 1 --2- 172.21.15.88:0/3606510937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3adc0d3010 0x7f3adc0d0ec0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0097c0 tx=0x7f3acc01c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75d80d369f387660 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:23.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.798+0000 7f3ae151a640 1 -- 172.21.15.88:0/3606510937 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4001a00 con 0x7f3adc0d3010 2023-11-20T07:01:23.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.798+0000 7f3ae151a640 1 -- 172.21.15.88:0/3606510937 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc0a7050 con 0x7f3adc0d3010 2023-11-20T07:01:23.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.798+0000 7f3ae151a640 1 -- 172.21.15.88:0/3606510937 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0ab620 con 0x7f3adc0d3010 2023-11-20T07:01:23.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.798+0000 7f3ae4780640 1 -- 172.21.15.88:0/3606510937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3adc0d3010 msgr2=0x7f3adc0d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.798+0000 7f3ae4780640 1 --2- 172.21.15.88:0/3606510937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3adc0d3010 0x7f3adc0d0ec0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0097c0 tx=0x7f3acc01c2e0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.798+0000 7f3ae4780640 1 -- 172.21.15.88:0/3606510937 shutdown_connections 2023-11-20T07:01:23.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.798+0000 7f3ae4780640 1 --2- 172.21.15.88:0/3606510937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3adc0d3010 0x7f3adc0d0ec0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.798+0000 7f3ae4780640 1 --2- 172.21.15.88:0/3606510937 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3adc15cb90 0x7f3adc0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.798+0000 7f3ae4780640 1 -- 172.21.15.88:0/3606510937 >> 172.21.15.88:0/3606510937 conn(0x7f3adc09bc50 msgr2=0x7f3adc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:23.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.798+0000 7f3ae4780640 1 -- 172.21.15.88:0/3606510937 shutdown_connections 2023-11-20T07:01:23.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.798+0000 7f3ae4780640 1 -- 172.21.15.88:0/3606510937 wait complete. 2023-11-20T07:01:23.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae4780640 1 Processor -- start 2023-11-20T07:01:23.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae4780640 1 -- start start 2023-11-20T07:01:23.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae4780640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3adc0d1400 0x7f3adc0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae4780640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3adc0d3010 0x7f3adc15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae4780640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3adc15cb90 0x7f3adc1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae4780640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0cad30 con 0x7f3adc0d3010 2023-11-20T07:01:23.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae4780640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc15bb30 con 0x7f3adc15cb90 2023-11-20T07:01:23.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae4780640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc159b10 con 0x7f3adc0d1400 2023-11-20T07:01:23.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae1d1b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3adc0d3010 0x7f3adc15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae1d1b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3adc0d3010 0x7f3adc15b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54314/0 (socket says 172.21.15.88:54314) 2023-11-20T07:01:23.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae251c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3adc0d1400 0x7f3adc0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae1d1b640 1 -- 172.21.15.88:0/611990357 learned_addr learned my addr 172.21.15.88:0/611990357 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:23.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae2d1d640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3adc15cb90 0x7f3adc1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae1d1b640 1 -- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3adc0d1400 msgr2=0x7f3adc0c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae1d1b640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3adc0d1400 0x7f3adc0c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae1d1b640 1 -- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3adc15cb90 msgr2=0x7f3adc1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae1d1b640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3adc15cb90 0x7f3adc1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae1d1b640 1 -- 172.21.15.88:0/611990357 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad80093b0 con 0x7f3adc0d3010 2023-11-20T07:01:23.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae251c640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3adc0d1400 0x7f3adc0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:23.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae2d1d640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3adc15cb90 0x7f3adc1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:23.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae1d1b640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3adc0d3010 0x7f3adc15b5f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0ae040 tx=0x7f3acc019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:23.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ad2ffd640 1 -- 172.21.15.88:0/611990357 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0b4430 con 0x7f3adc0d3010 2023-11-20T07:01:23.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ad2ffd640 1 -- 172.21.15.88:0/611990357 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc0b45b0 con 0x7f3adc0d3010 2023-11-20T07:01:23.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae4780640 1 -- 172.21.15.88:0/611990357 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc009420 con 0x7f3adc0d3010 2023-11-20T07:01:23.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ad2ffd640 1 -- 172.21.15.88:0/611990357 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0b4960 con 0x7f3adc0d3010 2023-11-20T07:01:23.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae4780640 1 -- 172.21.15.88:0/611990357 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc0ca390 con 0x7f3adc0d3010 2023-11-20T07:01:23.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.802+0000 7f3ae4780640 1 -- 172.21.15.88:0/611990357 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc0cae70 con 0x7f3adc0d3010 2023-11-20T07:01:23.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.806+0000 7f3ad2ffd640 1 -- 172.21.15.88:0/611990357 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3acc0b2040 con 0x7f3adc0d3010 2023-11-20T07:01:23.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.806+0000 7f3ad2ffd640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3ac00664a0 0x7f3ac0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:23.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.806+0000 7f3ad2ffd640 1 -- 172.21.15.88:0/611990357 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3acc11df10 con 0x7f3adc0d3010 2023-11-20T07:01:23.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.806+0000 7f3ae251c640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3ac00664a0 0x7f3ac0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:23.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.806+0000 7f3ae251c640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3ac00664a0 0x7f3ac0068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8011380 tx=0x7f3ad8006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:23.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.810+0000 7f3ad2ffd640 1 -- 172.21.15.88:0/611990357 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3adc0cae70 con 0x7f3adc0d3010 2023-11-20T07:01:23.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 -- 172.21.15.88:0/611990357 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3adc0cae70 con 0x7f3adc0d3010 2023-11-20T07:01:23.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ad2ffd640 1 -- 172.21.15.88:0/611990357 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3adc0cae70 con 0x7f3adc0d3010 2023-11-20T07:01:23.991 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:23.991 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-20T07:01:23.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 -- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3ac00664a0 msgr2=0x7f3ac0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3ac00664a0 0x7f3ac0068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8011380 tx=0x7f3ad8006f90 comp rx=0 tx=0).stop 2023-11-20T07:01:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 -- 172.21.15.88:0/611990357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3adc0d3010 msgr2=0x7f3adc15b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3adc0d3010 0x7f3adc15b5f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3acc0ae040 tx=0x7f3acc019080 comp rx=0 tx=0).stop 2023-11-20T07:01:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 -- 172.21.15.88:0/611990357 shutdown_connections 2023-11-20T07:01:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3ac00664a0 0x7f3ac0068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3adc15cb90 0x7f3adc1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3adc0d3010 0x7f3adc15b5f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 --2- 172.21.15.88:0/611990357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3adc0d1400 0x7f3adc0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 -- 172.21.15.88:0/611990357 >> 172.21.15.88:0/611990357 conn(0x7f3adc09bc50 msgr2=0x7f3adc06b110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 -- 172.21.15.88:0/611990357 shutdown_connections 2023-11-20T07:01:23.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:23.990+0000 7f3ae4780640 1 -- 172.21.15.88:0/611990357 wait complete. 2023-11-20T07:01:24.011 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-20T07:01:24.012 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:24.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.146+0000 7f86f651d640 1 Processor -- start 2023-11-20T07:01:24.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.146+0000 7f86f651d640 1 -- start start 2023-11-20T07:01:24.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86f651d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f86f00d15d0 0x7f86f00cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86f651d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f00ce770 con 0x7f86f00d3010 2023-11-20T07:01:24.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86f651d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f00d0600 con 0x7f86f015cb90 2023-11-20T07:01:24.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86f651d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f00c6450 con 0x7f86f00d15d0 2023-11-20T07:01:24.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86f4aba640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f86f00d3010 0x7f86f00c6c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52626/0 (socket says 172.21.15.88:52626) 2023-11-20T07:01:24.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86f4aba640 1 -- 172.21.15.88:0/1544547489 learned_addr learned my addr 172.21.15.88:0/1544547489 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:24.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86ef7fe640 1 --2- 172.21.15.88:0/1544547489 >> v2:172.21.15.175:3300/0 conn(0x7f86f00d15d0 0x7f86f00cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825996877 0 0) 0x7f86f00ce770 con 0x7f86f00d3010 2023-11-20T07:01:24.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d8003530 con 0x7f86f00d3010 2023-11-20T07:01:24.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3551780439 0 0) 0x7f86d8003530 con 0x7f86f00d3010 2023-11-20T07:01:24.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 >> v2:172.21.15.175:3300/0 conn(0x7f86f00d15d0 msgr2=0x7f86f00cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:24.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 --2- 172.21.15.88:0/1544547489 >> v2:172.21.15.175:3300/0 conn(0x7f86f00d15d0 0x7f86f00cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 >> v1:172.21.15.175:6789/0 conn(0x7f86f015cb90 legacy=0x7f86f00d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f00d08a0 con 0x7f86f00d3010 2023-11-20T07:01:24.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f86e8001a00 con 0x7f86f00d3010 2023-11-20T07:01:24.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 >> v1:172.21.15.88:6789/0 conn(0x7f86f00d3010 legacy=0x7f86f00c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 --2- 172.21.15.88:0/1544547489 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86d8003980 0x7f86d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 --2- 172.21.15.88:0/1544547489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86d80047d0 0x7f86d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 --2- 172.21.15.88:0/1544547489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86d8005190 0x7f86d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f00c6450 con 0x7f86d8005190 2023-11-20T07:01:24.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d800c130 con 0x7f86d80047d0 2023-11-20T07:01:24.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d800c2f0 con 0x7f86d8003980 2023-11-20T07:01:24.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86f4aba640 1 --2- 172.21.15.88:0/1544547489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86d8005190 0x7f86d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86ef7fe640 1 --2- 172.21.15.88:0/1544547489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86d80047d0 0x7f86d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86effff640 1 --2- 172.21.15.88:0/1544547489 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86d8003980 0x7f86d8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86f4aba640 1 -- 172.21.15.88:0/1544547489 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86d8003980 msgr2=0x7f86d8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:24.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86f4aba640 1 --2- 172.21.15.88:0/1544547489 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86d8003980 0x7f86d8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86f4aba640 1 -- 172.21.15.88:0/1544547489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86d80047d0 msgr2=0x7f86d8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:24.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86f4aba640 1 --2- 172.21.15.88:0/1544547489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86d80047d0 0x7f86d8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.150+0000 7f86f4aba640 1 -- 172.21.15.88:0/1544547489 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d8003530 con 0x7f86d8005190 2023-11-20T07:01:24.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.154+0000 7f86f4aba640 1 -- 172.21.15.88:0/1544547489 reap_dead start 2023-11-20T07:01:24.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.154+0000 7f86f4aba640 1 --2- 172.21.15.88:0/1544547489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86d8005190 0x7f86d800b990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f86e800a830 tx=0x7f86e801faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9dce9b38575d859 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:24.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.154+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80aa6d0 con 0x7f86d8005190 2023-11-20T07:01:24.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.154+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e80aa870 con 0x7f86d8005190 2023-11-20T07:01:24.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.154+0000 7f86eeffd640 1 -- 172.21.15.88:0/1544547489 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80aac20 con 0x7f86d8005190 2023-11-20T07:01:24.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.154+0000 7f86f651d640 1 -- 172.21.15.88:0/1544547489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86d8005190 msgr2=0x7f86d800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.154+0000 7f86f651d640 1 --2- 172.21.15.88:0/1544547489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86d8005190 0x7f86d800b990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f86e800a830 tx=0x7f86e801faa0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.154+0000 7f86f651d640 1 -- 172.21.15.88:0/1544547489 shutdown_connections 2023-11-20T07:01:24.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.154+0000 7f86f651d640 1 --2- 172.21.15.88:0/1544547489 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86d8005190 0x7f86d800b990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.154+0000 7f86f651d640 1 -- 172.21.15.88:0/1544547489 >> 172.21.15.88:0/1544547489 conn(0x7f86f009bc50 msgr2=0x7f86f00d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:24.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.154+0000 7f86f651d640 1 -- 172.21.15.88:0/1544547489 shutdown_connections 2023-11-20T07:01:24.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.154+0000 7f86f651d640 1 -- 172.21.15.88:0/1544547489 wait complete. 2023-11-20T07:01:24.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f651d640 1 Processor -- start 2023-11-20T07:01:24.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f651d640 1 -- start start 2023-11-20T07:01:24.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f651d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86d8005190 0x7f86f01506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f651d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86f01e5fc0 0x7f86f01e2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f651d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f01e6440 0x7f86f01e3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f651d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f01f2420 con 0x7f86f01e6440 2023-11-20T07:01:24.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f651d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f0150c30 con 0x7f86f01e5fc0 2023-11-20T07:01:24.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f651d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f01e5180 con 0x7f86d8005190 2023-11-20T07:01:24.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f4aba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f01e6440 0x7f86f01e3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f4aba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f01e6440 0x7f86f01e3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54328/0 (socket says 172.21.15.88:54328) 2023-11-20T07:01:24.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86effff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86d8005190 0x7f86f01506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f4aba640 1 -- 172.21.15.88:0/1106644108 learned_addr learned my addr 172.21.15.88:0/1106644108 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86ef7fe640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86f01e5fc0 0x7f86f01e2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f4aba640 1 -- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86d8005190 msgr2=0x7f86f01506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f4aba640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86d8005190 0x7f86f01506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f4aba640 1 -- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86f01e5fc0 msgr2=0x7f86f01e2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f4aba640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86f01e5fc0 0x7f86f01e2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f4aba640 1 -- 172.21.15.88:0/1106644108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f01e4570 con 0x7f86f01e6440 2023-11-20T07:01:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f4aba640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f01e6440 0x7f86f01e3480 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f86e8007040 tx=0x7f86d8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86ecff9640 1 -- 172.21.15.88:0/1106644108 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80aa6d0 con 0x7f86f01e6440 2023-11-20T07:01:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86ecff9640 1 -- 172.21.15.88:0/1106644108 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e8001260 con 0x7f86f01e6440 2023-11-20T07:01:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f651d640 1 -- 172.21.15.88:0/1106644108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f01e4850 con 0x7f86f01e6440 2023-11-20T07:01:24.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86ecff9640 1 -- 172.21.15.88:0/1106644108 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80aac40 con 0x7f86f01e6440 2023-11-20T07:01:24.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f651d640 1 -- 172.21.15.88:0/1106644108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f01e4e10 con 0x7f86f01e6440 2023-11-20T07:01:24.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.158+0000 7f86f651d640 1 -- 172.21.15.88:0/1106644108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f0154360 con 0x7f86f01e6440 2023-11-20T07:01:24.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.162+0000 7f86ecff9640 1 -- 172.21.15.88:0/1106644108 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f86e8007070 con 0x7f86f01e6440 2023-11-20T07:01:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.162+0000 7f86ecff9640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f86dc0664d0 0x7f86dc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.162+0000 7f86ecff9640 1 -- 172.21.15.88:0/1106644108 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86e81212f0 con 0x7f86f01e6440 2023-11-20T07:01:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.162+0000 7f86effff640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f86dc0664d0 0x7f86dc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.162+0000 7f86effff640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f86dc0664d0 0x7f86dc068990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f86e0000f00 tx=0x7f86e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:24.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.166+0000 7f86ecff9640 1 -- 172.21.15.88:0/1106644108 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f86f0154360 con 0x7f86f01e6440 2023-11-20T07:01:24.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.318+0000 7f86f651d640 1 -- 172.21.15.88:0/1106644108 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86f0154360 con 0x7f86f01e6440 2023-11-20T07:01:24.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.318+0000 7f86ecff9640 1 -- 172.21.15.88:0/1106644108 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f86f0154360 con 0x7f86f01e6440 2023-11-20T07:01:24.319 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:24.320 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:24.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.322+0000 7f86f651d640 1 -- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f86dc0664d0 msgr2=0x7f86dc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.322+0000 7f86f651d640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f86dc0664d0 0x7f86dc068990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f86e0000f00 tx=0x7f86e0009040 comp rx=0 tx=0).stop 2023-11-20T07:01:24.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.322+0000 7f86f651d640 1 -- 172.21.15.88:0/1106644108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f01e6440 msgr2=0x7f86f01e3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.322+0000 7f86f651d640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f01e6440 0x7f86f01e3480 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f86e8007040 tx=0x7f86d8005800 comp rx=0 tx=0).stop 2023-11-20T07:01:24.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.322+0000 7f86f651d640 1 -- 172.21.15.88:0/1106644108 shutdown_connections 2023-11-20T07:01:24.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.322+0000 7f86f651d640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f86dc0664d0 0x7f86dc068990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.322+0000 7f86f651d640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86f01e6440 0x7f86f01e3480 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.322+0000 7f86f651d640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86f01e5fc0 0x7f86f01e2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.322+0000 7f86f651d640 1 --2- 172.21.15.88:0/1106644108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86d8005190 0x7f86f01506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.322+0000 7f86f651d640 1 -- 172.21.15.88:0/1106644108 >> 172.21.15.88:0/1106644108 conn(0x7f86f009bc50 msgr2=0x7f86f00ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:24.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.322+0000 7f86f651d640 1 -- 172.21.15.88:0/1106644108 shutdown_connections 2023-11-20T07:01:24.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.322+0000 7f86f651d640 1 -- 172.21.15.88:0/1106644108 wait complete. 2023-11-20T07:01:24.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:24.341 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:24.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07ee68640 1 Processor -- start 2023-11-20T07:01:24.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07ee68640 1 -- start start 2023-11-20T07:01:24.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07ee68640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc078159900 0x7fc07806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07ee68640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0780b3f00 0x7fc078069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07ee68640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc07806a3d0 0x7fc0780cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07ee68640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0780cd740 con 0x7fc078159900 2023-11-20T07:01:24.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07ee68640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07806a840 con 0x7fc07806a3d0 2023-11-20T07:01:24.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07ee68640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780b4360 con 0x7fc0780b3f00 2023-11-20T07:01:24.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07cc04640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc078159900 0x7fc07806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07cc04640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc078159900 0x7fc07806e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54336/0 (socket says 172.21.15.88:54336) 2023-11-20T07:01:24.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07cc04640 1 -- 172.21.15.88:0/2293450853 learned_addr learned my addr 172.21.15.88:0/2293450853 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07d405640 1 --2- 172.21.15.88:0/2293450853 >> v2:172.21.15.175:3300/0 conn(0x7fc07806a3d0 0x7fc0780cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc06ffff640 1 --2- 172.21.15.88:0/2293450853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0780b3f00 0x7fc078069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07cc04640 1 -- 172.21.15.88:0/2293450853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0780b3f00 msgr2=0x7fc078069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07cc04640 1 --2- 172.21.15.88:0/2293450853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0780b3f00 0x7fc078069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07cc04640 1 -- 172.21.15.88:0/2293450853 >> v2:172.21.15.175:3300/0 conn(0x7fc07806a3d0 msgr2=0x7fc0780cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:24.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07cc04640 1 --2- 172.21.15.88:0/2293450853 >> v2:172.21.15.175:3300/0 conn(0x7fc07806a3d0 0x7fc0780cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.482+0000 7fc07cc04640 1 -- 172.21.15.88:0/2293450853 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780b4600 con 0x7fc078159900 2023-11-20T07:01:24.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc07cc04640 1 --2- 172.21.15.88:0/2293450853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc078159900 0x7fc07806e260 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc0780c8d10 tx=0x7fc07401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177692f2f5792cf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:24.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc06f7fe640 1 -- 172.21.15.88:0/2293450853 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0740ab600 con 0x7fc078159900 2023-11-20T07:01:24.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc06f7fe640 1 -- 172.21.15.88:0/2293450853 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0740a7050 con 0x7fc078159900 2023-11-20T07:01:24.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc06f7fe640 1 -- 172.21.15.88:0/2293450853 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0740ab980 con 0x7fc078159900 2023-11-20T07:01:24.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc07ee68640 1 -- 172.21.15.88:0/2293450853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc078159900 msgr2=0x7fc07806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc07ee68640 1 --2- 172.21.15.88:0/2293450853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc078159900 0x7fc07806e260 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc0780c8d10 tx=0x7fc07401c210 comp rx=0 tx=0).stop 2023-11-20T07:01:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc07ee68640 1 -- 172.21.15.88:0/2293450853 shutdown_connections 2023-11-20T07:01:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc07ee68640 1 --2- 172.21.15.88:0/2293450853 >> v2:172.21.15.175:3300/0 conn(0x7fc07806a3d0 0x7fc0780cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc07ee68640 1 --2- 172.21.15.88:0/2293450853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0780b3f00 0x7fc078069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc07ee68640 1 --2- 172.21.15.88:0/2293450853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc078159900 0x7fc07806e260 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc07ee68640 1 -- 172.21.15.88:0/2293450853 >> 172.21.15.88:0/2293450853 conn(0x7fc0780b0da0 msgr2=0x7fc0780ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc07ee68640 1 -- 172.21.15.88:0/2293450853 shutdown_connections 2023-11-20T07:01:24.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.486+0000 7fc07ee68640 1 -- 172.21.15.88:0/2293450853 wait complete. 2023-11-20T07:01:24.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07ee68640 1 Processor -- start 2023-11-20T07:01:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07ee68640 1 -- start start 2023-11-20T07:01:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07ee68640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc07806a3d0 0x7fc078152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07ee68640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0780b3f00 0x7fc0780c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07ee68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc078159900 0x7fc0780b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07ee68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07815adb0 con 0x7fc078159900 2023-11-20T07:01:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07ee68640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07815a1a0 con 0x7fc0780b3f00 2023-11-20T07:01:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07ee68640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07815a480 con 0x7fc07806a3d0 2023-11-20T07:01:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07d405640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc078159900 0x7fc0780b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07d405640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc078159900 0x7fc0780b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54344/0 (socket says 172.21.15.88:54344) 2023-11-20T07:01:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07d405640 1 -- 172.21.15.88:0/2594864934 learned_addr learned my addr 172.21.15.88:0/2594864934 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07cc04640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc07806a3d0 0x7fc078152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc06ffff640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0780b3f00 0x7fc0780c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07d405640 1 -- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc07806a3d0 msgr2=0x7fc078152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07d405640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc07806a3d0 0x7fc078152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07d405640 1 -- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0780b3f00 msgr2=0x7fc0780c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07d405640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0780b3f00 0x7fc0780c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07d405640 1 -- 172.21.15.88:0/2594864934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0740094d0 con 0x7fc078159900 2023-11-20T07:01:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07d405640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc078159900 0x7fc0780b1da0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc070007d20 tx=0x7fc07000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc06d7fa640 1 -- 172.21.15.88:0/2594864934 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070014420 con 0x7fc078159900 2023-11-20T07:01:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc06d7fa640 1 -- 172.21.15.88:0/2594864934 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0700145a0 con 0x7fc078159900 2023-11-20T07:01:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc06d7fa640 1 -- 172.21.15.88:0/2594864934 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070014950 con 0x7fc078159900 2023-11-20T07:01:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07ee68640 1 -- 172.21.15.88:0/2594864934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07815a760 con 0x7fc078159900 2023-11-20T07:01:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.490+0000 7fc07ee68640 1 -- 172.21.15.88:0/2594864934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0780c5ed0 con 0x7fc078159900 2023-11-20T07:01:24.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.494+0000 7fc07ee68640 1 -- 172.21.15.88:0/2594864934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07804e170 con 0x7fc078159900 2023-11-20T07:01:24.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.494+0000 7fc06d7fa640 1 -- 172.21.15.88:0/2594864934 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc070014ab0 con 0x7fc078159900 2023-11-20T07:01:24.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.494+0000 7fc06d7fa640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0640664a0 0x7fc064068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.494+0000 7fc06d7fa640 1 -- 172.21.15.88:0/2594864934 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc070084960 con 0x7fc078159900 2023-11-20T07:01:24.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.494+0000 7fc07cc04640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0640664a0 0x7fc064068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.494+0000 7fc07cc04640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0640664a0 0x7fc064068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc0740ad000 tx=0x7fc074008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:24.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.498+0000 7fc06d7fa640 1 -- 172.21.15.88:0/2594864934 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc070051b00 con 0x7fc078159900 2023-11-20T07:01:24.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 -- 172.21.15.88:0/2594864934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0780c42c0 con 0x7fc078159900 2023-11-20T07:01:24.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc06d7fa640 1 -- 172.21.15.88:0/2594864934 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc070055120 con 0x7fc078159900 2023-11-20T07:01:24.650 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:24.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 -- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0640664a0 msgr2=0x7fc064068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0640664a0 0x7fc064068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc0740ad000 tx=0x7fc074008040 comp rx=0 tx=0).stop 2023-11-20T07:01:24.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 -- 172.21.15.88:0/2594864934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc078159900 msgr2=0x7fc0780b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc078159900 0x7fc0780b1da0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc070007d20 tx=0x7fc07000e4b0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 -- 172.21.15.88:0/2594864934 shutdown_connections 2023-11-20T07:01:24.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0640664a0 0x7fc064068960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc078159900 0x7fc0780b1da0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0780b3f00 0x7fc0780c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 --2- 172.21.15.88:0/2594864934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc07806a3d0 0x7fc078152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 -- 172.21.15.88:0/2594864934 >> 172.21.15.88:0/2594864934 conn(0x7fc0780b0da0 msgr2=0x7fc0780aed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:24.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 -- 172.21.15.88:0/2594864934 shutdown_connections 2023-11-20T07:01:24.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.650+0000 7fc07ee68640 1 -- 172.21.15.88:0/2594864934 wait complete. 2023-11-20T07:01:24.671 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:24.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.810+0000 7f517173e640 1 Processor -- start 2023-11-20T07:01:24.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.810+0000 7f517173e640 1 -- start start 2023-11-20T07:01:24.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f517173e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f516c15feb0 0x7f516c0af410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f517173e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f516c0b14c0 0x7f516c0b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f517173e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f516c0afc40 con 0x7f516c0d0830 2023-11-20T07:01:24.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f517173e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516c0aff20 con 0x7f516c0b14c0 2023-11-20T07:01:24.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f517173e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0b0200 con 0x7f516c15feb0 2023-11-20T07:01:24.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f51627fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f516c0b14c0 0x7f516c0b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f51627fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f516c0b14c0 0x7f516c0b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54346/0 (socket says 172.21.15.88:54346) 2023-11-20T07:01:24.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f516b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f516c0d0830 0x7f516c06b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52630/0 (socket says 172.21.15.88:52630) 2023-11-20T07:01:24.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f51627fc640 1 -- 172.21.15.88:0/211900386 learned_addr learned my addr 172.21.15.88:0/211900386 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:24.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f51627fc640 1 -- 172.21.15.88:0/211900386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f516c15feb0 msgr2=0x7f516c0af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:24.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f516affd640 1 --2- 172.21.15.88:0/211900386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f516c15feb0 0x7f516c0af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f51627fc640 1 --2- 172.21.15.88:0/211900386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f516c15feb0 0x7f516c0af410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f51627fc640 1 -- 172.21.15.88:0/211900386 >> v1:172.21.15.88:6789/0 conn(0x7f516c0d0830 legacy=0x7f516c06b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f516a7fc640 1 -- 172.21.15.88:0/211900386 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688098595 0 0) 0x7f516c0afc40 con 0x7f516c0d0830 2023-11-20T07:01:24.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f51627fc640 1 -- 172.21.15.88:0/211900386 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c0b04e0 con 0x7f516c0b14c0 2023-11-20T07:01:24.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f516affd640 1 --2- 172.21.15.88:0/211900386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f516c15feb0 0x7f516c0af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:24.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.814+0000 7f51627fc640 1 --2- 172.21.15.88:0/211900386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f516c0b14c0 0x7f516c0b0ce0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5154009870 tx=0x7f515401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f3863f4e18a784 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:24.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f516a7fc640 1 -- 172.21.15.88:0/211900386 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51540ad640 con 0x7f516c0b14c0 2023-11-20T07:01:24.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f516a7fc640 1 -- 172.21.15.88:0/211900386 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51540ad7a0 con 0x7f516c0b14c0 2023-11-20T07:01:24.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f516a7fc640 1 -- 172.21.15.88:0/211900386 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51540adb30 con 0x7f516c0b14c0 2023-11-20T07:01:24.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 -- 172.21.15.88:0/211900386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f516c0b14c0 msgr2=0x7f516c0b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 --2- 172.21.15.88:0/211900386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f516c0b14c0 0x7f516c0b0ce0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5154009870 tx=0x7f515401c480 comp rx=0 tx=0).stop 2023-11-20T07:01:24.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 -- 172.21.15.88:0/211900386 shutdown_connections 2023-11-20T07:01:24.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 --2- 172.21.15.88:0/211900386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f516c0b14c0 0x7f516c0b0ce0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 --2- 172.21.15.88:0/211900386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f516c15feb0 0x7f516c0af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 -- 172.21.15.88:0/211900386 >> 172.21.15.88:0/211900386 conn(0x7f516c089f80 msgr2=0x7f516c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:24.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 -- 172.21.15.88:0/211900386 shutdown_connections 2023-11-20T07:01:24.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 -- 172.21.15.88:0/211900386 wait complete. 2023-11-20T07:01:24.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 Processor -- start 2023-11-20T07:01:24.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 -- start start 2023-11-20T07:01:24.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f516c0b14c0 0x7f516c15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f516c0d0830 0x7f516c14d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f516c15feb0 0x7f516c14ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c14e2f0 con 0x7f516c15feb0 2023-11-20T07:01:24.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0ce9d0 con 0x7f516c0b14c0 2023-11-20T07:01:24.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f517173e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0cddc0 con 0x7f516c0d0830 2023-11-20T07:01:24.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.818+0000 7f516b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f516c15feb0 0x7f516c14ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f516b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f516c15feb0 0x7f516c14ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54348/0 (socket says 172.21.15.88:54348) 2023-11-20T07:01:24.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f516b7fe640 1 -- 172.21.15.88:0/4086983465 learned_addr learned my addr 172.21.15.88:0/4086983465 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:24.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f51627fc640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f516c0d0830 0x7f516c14d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f516affd640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f516c0b14c0 0x7f516c15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f516b7fe640 1 -- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f516c0d0830 msgr2=0x7f516c14d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f516b7fe640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f516c0d0830 0x7f516c14d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f516b7fe640 1 -- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f516c0b14c0 msgr2=0x7f516c15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f516b7fe640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f516c0b14c0 0x7f516c15ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f516b7fe640 1 -- 172.21.15.88:0/4086983465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540094d0 con 0x7f516c15feb0 2023-11-20T07:01:24.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f51627fc640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f516c0d0830 0x7f516c14d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:24.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f516b7fe640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f516c15feb0 0x7f516c14ddb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f516400c470 tx=0x7f516400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:24.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f5163fff640 1 -- 172.21.15.88:0/4086983465 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51640074e0 con 0x7f516c15feb0 2023-11-20T07:01:24.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f5163fff640 1 -- 172.21.15.88:0/4086983465 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5164007640 con 0x7f516c15feb0 2023-11-20T07:01:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f517173e640 1 -- 172.21.15.88:0/4086983465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516c0d11d0 con 0x7f516c15feb0 2023-11-20T07:01:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f5163fff640 1 -- 172.21.15.88:0/4086983465 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164004a30 con 0x7f516c15feb0 2023-11-20T07:01:24.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f517173e640 1 -- 172.21.15.88:0/4086983465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c0ce380 con 0x7f516c15feb0 2023-11-20T07:01:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f517173e640 1 -- 172.21.15.88:0/4086983465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516c0ceb40 con 0x7f516c15feb0 2023-11-20T07:01:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f5163fff640 1 -- 172.21.15.88:0/4086983465 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5164004b90 con 0x7f516c15feb0 2023-11-20T07:01:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f5163fff640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f514c0664a0 0x7f514c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:24.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.822+0000 7f5163fff640 1 -- 172.21.15.88:0/4086983465 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5164083380 con 0x7f516c15feb0 2023-11-20T07:01:24.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.826+0000 7f516affd640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f514c0664a0 0x7f514c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:24.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.826+0000 7f516affd640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f514c0664a0 0x7f514c068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f515c007560 tx=0x7f515c0074f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:24.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.826+0000 7f5163fff640 1 -- 172.21.15.88:0/4086983465 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5164050470 con 0x7f516c15feb0 2023-11-20T07:01:24.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.974+0000 7f517173e640 1 -- 172.21.15.88:0/4086983465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f516c073fa0 con 0x7f516c15feb0 2023-11-20T07:01:24.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.974+0000 7f5163fff640 1 -- 172.21.15.88:0/4086983465 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5164053a90 con 0x7f516c15feb0 2023-11-20T07:01:24.977 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:24.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.978+0000 7f517173e640 1 -- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f514c0664a0 msgr2=0x7f514c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.978+0000 7f517173e640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f514c0664a0 0x7f514c068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f515c007560 tx=0x7f515c0074f0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.978+0000 7f517173e640 1 -- 172.21.15.88:0/4086983465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f516c15feb0 msgr2=0x7f516c14ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:24.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.978+0000 7f517173e640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f516c15feb0 0x7f516c14ddb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f516400c470 tx=0x7f516400c930 comp rx=0 tx=0).stop 2023-11-20T07:01:24.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.978+0000 7f517173e640 1 -- 172.21.15.88:0/4086983465 shutdown_connections 2023-11-20T07:01:24.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.978+0000 7f517173e640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f514c0664a0 0x7f514c068960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.978+0000 7f517173e640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f516c0d0830 0x7f516c14d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.978+0000 7f517173e640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f516c15feb0 0x7f516c14ddb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.978+0000 7f517173e640 1 --2- 172.21.15.88:0/4086983465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f516c0b14c0 0x7f516c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:24.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.978+0000 7f517173e640 1 -- 172.21.15.88:0/4086983465 >> 172.21.15.88:0/4086983465 conn(0x7f516c089f80 msgr2=0x7f516c06b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:24.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.978+0000 7f517173e640 1 -- 172.21.15.88:0/4086983465 shutdown_connections 2023-11-20T07:01:24.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:24.978+0000 7f517173e640 1 -- 172.21.15.88:0/4086983465 wait complete. 2023-11-20T07:01:24.998 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:25.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb80d89c640 1 Processor -- start 2023-11-20T07:01:25.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb80d89c640 1 -- start start 2023-11-20T07:01:25.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb80d89c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8081590d0 0x7fb80806df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb80d89c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8080c8dd0 0x7fb8080702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb80d89c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb808070830 0x7fb80815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb80d89c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb808070ce0 con 0x7fb808070830 2023-11-20T07:01:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb80d89c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8080c9600 con 0x7fb8081590d0 2023-11-20T07:01:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb80d89c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080c98e0 con 0x7fb8080c8dd0 2023-11-20T07:01:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb8077fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb808070830 0x7fb80815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb8077fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb808070830 0x7fb80815cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54360/0 (socket says 172.21.15.88:54360) 2023-11-20T07:01:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb8077fe640 1 -- 172.21.15.88:0/2850406157 learned_addr learned my addr 172.21.15.88:0/2850406157 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb7fe7fc640 1 --2- 172.21.15.88:0/2850406157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8080c8dd0 0x7fb8080702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb806ffd640 1 --2- 172.21.15.88:0/2850406157 >> v2:172.21.15.175:3300/0 conn(0x7fb8081590d0 0x7fb80806df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb8077fe640 1 -- 172.21.15.88:0/2850406157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8080c8dd0 msgr2=0x7fb8080702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:25.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb8077fe640 1 --2- 172.21.15.88:0/2850406157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8080c8dd0 0x7fb8080702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb8077fe640 1 -- 172.21.15.88:0/2850406157 >> v2:172.21.15.175:3300/0 conn(0x7fb8081590d0 msgr2=0x7fb80806df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:25.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb8077fe640 1 --2- 172.21.15.88:0/2850406157 >> v2:172.21.15.175:3300/0 conn(0x7fb8081590d0 0x7fb80806df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb8077fe640 1 -- 172.21.15.88:0/2850406157 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8080c9bc0 con 0x7fb808070830 2023-11-20T07:01:25.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.138+0000 7fb806ffd640 1 --2- 172.21.15.88:0/2850406157 >> v2:172.21.15.175:3300/0 conn(0x7fb8081590d0 0x7fb80806df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:25.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb8077fe640 1 --2- 172.21.15.88:0/2850406157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb808070830 0x7fb80815cc10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb808070f80 tx=0x7fb80001ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dae763f5afb909 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:25.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb8067fc640 1 -- 172.21.15.88:0/2850406157 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8000a79c0 con 0x7fb808070830 2023-11-20T07:01:25.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb8067fc640 1 -- 172.21.15.88:0/2850406157 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8000a7b20 con 0x7fb808070830 2023-11-20T07:01:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb8067fc640 1 -- 172.21.15.88:0/2850406157 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8000af3f0 con 0x7fb808070830 2023-11-20T07:01:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb80d89c640 1 -- 172.21.15.88:0/2850406157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb808070830 msgr2=0x7fb80815cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb80d89c640 1 --2- 172.21.15.88:0/2850406157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb808070830 0x7fb80815cc10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb808070f80 tx=0x7fb80001ebb0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb80d89c640 1 -- 172.21.15.88:0/2850406157 shutdown_connections 2023-11-20T07:01:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb80d89c640 1 --2- 172.21.15.88:0/2850406157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb808070830 0x7fb80815cc10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb80d89c640 1 --2- 172.21.15.88:0/2850406157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8080c8dd0 0x7fb8080702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb80d89c640 1 --2- 172.21.15.88:0/2850406157 >> v2:172.21.15.175:3300/0 conn(0x7fb8081590d0 0x7fb80806df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb80d89c640 1 -- 172.21.15.88:0/2850406157 >> 172.21.15.88:0/2850406157 conn(0x7fb8080b0da0 msgr2=0x7fb8080ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb80d89c640 1 -- 172.21.15.88:0/2850406157 shutdown_connections 2023-11-20T07:01:25.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.142+0000 7fb80d89c640 1 -- 172.21.15.88:0/2850406157 wait complete. 2023-11-20T07:01:25.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb80d89c640 1 Processor -- start 2023-11-20T07:01:25.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb80d89c640 1 -- start start 2023-11-20T07:01:25.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb80d89c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb808070830 0x7fb8080c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb80d89c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8080c8dd0 0x7fb8080c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb80d89c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8081590d0 0x7fb808157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb80d89c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080c5d90 con 0x7fb808070830 2023-11-20T07:01:25.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb80d89c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080c6030 con 0x7fb8080c8dd0 2023-11-20T07:01:25.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb80d89c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080c6310 con 0x7fb8081590d0 2023-11-20T07:01:25.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb806ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb808070830 0x7fb8080c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb806ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb808070830 0x7fb8080c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54372/0 (socket says 172.21.15.88:54372) 2023-11-20T07:01:25.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb806ffd640 1 -- 172.21.15.88:0/671328379 learned_addr learned my addr 172.21.15.88:0/671328379 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:25.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb8077fe640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8081590d0 0x7fb808157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb7fe7fc640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8080c8dd0 0x7fb8080c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb806ffd640 1 -- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8081590d0 msgr2=0x7fb808157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb806ffd640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8081590d0 0x7fb808157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb806ffd640 1 -- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8080c8dd0 msgr2=0x7fb8080c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb806ffd640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8080c8dd0 0x7fb8080c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb806ffd640 1 -- 172.21.15.88:0/671328379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800009b30 con 0x7fb808070830 2023-11-20T07:01:25.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb7fe7fc640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8080c8dd0 0x7fb8080c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:25.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb8077fe640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8081590d0 0x7fb808157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:25.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb806ffd640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb808070830 0x7fb8080c46a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800d800 tx=0x7fb7f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:25.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb804ff9640 1 -- 172.21.15.88:0/671328379 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f80096c0 con 0x7fb808070830 2023-11-20T07:01:25.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb804ff9640 1 -- 172.21.15.88:0/671328379 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f8009820 con 0x7fb808070830 2023-11-20T07:01:25.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb804ff9640 1 -- 172.21.15.88:0/671328379 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8009bd0 con 0x7fb808070830 2023-11-20T07:01:25.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb80d89c640 1 -- 172.21.15.88:0/671328379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8080ca820 con 0x7fb808070830 2023-11-20T07:01:25.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb80d89c640 1 -- 172.21.15.88:0/671328379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8080c68d0 con 0x7fb808070830 2023-11-20T07:01:25.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.146+0000 7fb80d89c640 1 -- 172.21.15.88:0/671328379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80804e170 con 0x7fb808070830 2023-11-20T07:01:25.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.150+0000 7fb804ff9640 1 -- 172.21.15.88:0/671328379 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb7f8009d30 con 0x7fb808070830 2023-11-20T07:01:25.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.150+0000 7fb804ff9640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7e80664a0 0x7fb7e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.150+0000 7fb804ff9640 1 -- 172.21.15.88:0/671328379 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb7f8084910 con 0x7fb808070830 2023-11-20T07:01:25.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.150+0000 7fb7fe7fc640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7e80664a0 0x7fb7e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.150+0000 7fb7fe7fc640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7e80664a0 0x7fb7e8068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb80806e0b0 tx=0x7fb7f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:25.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.154+0000 7fb804ff9640 1 -- 172.21.15.88:0/671328379 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb7f8051a00 con 0x7fb808070830 2023-11-20T07:01:25.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.302+0000 7fb80d89c640 1 -- 172.21.15.88:0/671328379 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8080cd5a0 con 0x7fb808070830 2023-11-20T07:01:25.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.302+0000 7fb804ff9640 1 -- 172.21.15.88:0/671328379 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7f8055020 con 0x7fb808070830 2023-11-20T07:01:25.303 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:25.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.302+0000 7fb80d89c640 1 -- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7e80664a0 msgr2=0x7fb7e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.302+0000 7fb80d89c640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7e80664a0 0x7fb7e8068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb80806e0b0 tx=0x7fb7f0008040 comp rx=0 tx=0).stop 2023-11-20T07:01:25.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.302+0000 7fb80d89c640 1 -- 172.21.15.88:0/671328379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb808070830 msgr2=0x7fb8080c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.302+0000 7fb80d89c640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb808070830 0x7fb8080c46a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800d800 tx=0x7fb7f800dcc0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.302+0000 7fb80d89c640 1 -- 172.21.15.88:0/671328379 shutdown_connections 2023-11-20T07:01:25.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.302+0000 7fb80d89c640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7e80664a0 0x7fb7e8068960 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.302+0000 7fb80d89c640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8081590d0 0x7fb808157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.302+0000 7fb80d89c640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8080c8dd0 0x7fb8080c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.302+0000 7fb80d89c640 1 --2- 172.21.15.88:0/671328379 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb808070830 0x7fb8080c46a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.302+0000 7fb80d89c640 1 -- 172.21.15.88:0/671328379 >> 172.21.15.88:0/671328379 conn(0x7fb8080b0da0 msgr2=0x7fb8080cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:25.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.306+0000 7fb80d89c640 1 -- 172.21.15.88:0/671328379 shutdown_connections 2023-11-20T07:01:25.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.306+0000 7fb80d89c640 1 -- 172.21.15.88:0/671328379 wait complete. 2023-11-20T07:01:25.324 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.462+0000 7fb84cf0e640 1 Processor -- start 2023-11-20T07:01:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.462+0000 7fb84cf0e640 1 -- start start 2023-11-20T07:01:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb84cf0e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8481590d0 0x7fb84806df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb84cf0e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb848070a00 0x7fb8480cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb84cf0e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8480c9600 con 0x7fb8480c8dd0 2023-11-20T07:01:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb84cf0e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480c98e0 con 0x7fb848070a00 2023-11-20T07:01:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb84cf0e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480c9bc0 con 0x7fb8481590d0 2023-11-20T07:01:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb846d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb848070a00 0x7fb8480cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb846d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb848070a00 0x7fb8480cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54376/0 (socket says 172.21.15.88:54376) 2023-11-20T07:01:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb846d9d640 1 -- 172.21.15.88:0/893264510 learned_addr learned my addr 172.21.15.88:0/893264510 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:25.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb84659c640 1 --2- 172.21.15.88:0/893264510 >> v2:172.21.15.175:3300/0 conn(0x7fb8481590d0 0x7fb84806df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb846d9d640 1 -- 172.21.15.88:0/893264510 >> v2:172.21.15.175:3300/0 conn(0x7fb8481590d0 msgr2=0x7fb84806df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:25.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb846d9d640 1 --2- 172.21.15.88:0/893264510 >> v2:172.21.15.175:3300/0 conn(0x7fb8481590d0 0x7fb84806df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb846d9d640 1 -- 172.21.15.88:0/893264510 >> v1:172.21.15.88:6789/0 conn(0x7fb8480c8dd0 legacy=0x7fb8480702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb846d9d640 1 -- 172.21.15.88:0/893264510 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8480c9ea0 con 0x7fb848070a00 2023-11-20T07:01:25.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.466+0000 7fb845d9b640 1 -- 172.21.15.88:0/893264510 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529876292 0 0) 0x7fb8480c9600 con 0x7fb8480c8dd0 2023-11-20T07:01:25.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb846d9d640 1 --2- 172.21.15.88:0/893264510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb848070a00 0x7fb8480cc350 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb848070f80 tx=0x7fb84001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e6aeacd4135c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:25.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb845d9b640 1 -- 172.21.15.88:0/893264510 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400a64c0 con 0x7fb848070a00 2023-11-20T07:01:25.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb845d9b640 1 -- 172.21.15.88:0/893264510 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400a6620 con 0x7fb848070a00 2023-11-20T07:01:25.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb845d9b640 1 -- 172.21.15.88:0/893264510 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400a69b0 con 0x7fb848070a00 2023-11-20T07:01:25.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb84cf0e640 1 -- 172.21.15.88:0/893264510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb848070a00 msgr2=0x7fb8480cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb84cf0e640 1 --2- 172.21.15.88:0/893264510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb848070a00 0x7fb8480cc350 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb848070f80 tx=0x7fb84001c9a0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb84cf0e640 1 -- 172.21.15.88:0/893264510 shutdown_connections 2023-11-20T07:01:25.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb84cf0e640 1 --2- 172.21.15.88:0/893264510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb848070a00 0x7fb8480cc350 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb84cf0e640 1 --2- 172.21.15.88:0/893264510 >> v2:172.21.15.175:3300/0 conn(0x7fb8481590d0 0x7fb84806df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb84cf0e640 1 -- 172.21.15.88:0/893264510 >> 172.21.15.88:0/893264510 conn(0x7fb8480b0da0 msgr2=0x7fb8480ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:25.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb84cf0e640 1 -- 172.21.15.88:0/893264510 shutdown_connections 2023-11-20T07:01:25.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb84cf0e640 1 -- 172.21.15.88:0/893264510 wait complete. 2023-11-20T07:01:25.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb84cf0e640 1 Processor -- start 2023-11-20T07:01:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.470+0000 7fb84cf0e640 1 -- start start 2023-11-20T07:01:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84cf0e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb848070a00 0x7fb8480c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84cf0e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8480c8dd0 0x7fb848143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84cf0e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8481590d0 0x7fb8481463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84cf0e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480c78e0 con 0x7fb848070a00 2023-11-20T07:01:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84cf0e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480c7280 con 0x7fb8480c8dd0 2023-11-20T07:01:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84cf0e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480c22b0 con 0x7fb8481590d0 2023-11-20T07:01:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb848070a00 0x7fb8480c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb848070a00 0x7fb8480c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54390/0 (socket says 172.21.15.88:54390) 2023-11-20T07:01:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84659c640 1 -- 172.21.15.88:0/800426942 learned_addr learned my addr 172.21.15.88:0/800426942 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb846d9d640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8481590d0 0x7fb8481463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb83dd9b640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8480c8dd0 0x7fb848143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84659c640 1 -- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8481590d0 msgr2=0x7fb8481463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84659c640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8481590d0 0x7fb8481463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84659c640 1 -- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8480c8dd0 msgr2=0x7fb848143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84659c640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8480c8dd0 0x7fb848143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84659c640 1 -- 172.21.15.88:0/800426942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840009b30 con 0x7fb848070a00 2023-11-20T07:01:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84659c640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb848070a00 0x7fb8480c7d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c820 tx=0x7fb83800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb83f7fe640 1 -- 172.21.15.88:0/800426942 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838004220 con 0x7fb848070a00 2023-11-20T07:01:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb83f7fe640 1 -- 172.21.15.88:0/800426942 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8380043a0 con 0x7fb848070a00 2023-11-20T07:01:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb83f7fe640 1 -- 172.21.15.88:0/800426942 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838004510 con 0x7fb848070a00 2023-11-20T07:01:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84cf0e640 1 -- 172.21.15.88:0/800426942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8480ca820 con 0x7fb848070a00 2023-11-20T07:01:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84cf0e640 1 -- 172.21.15.88:0/800426942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8480c2830 con 0x7fb848070a00 2023-11-20T07:01:25.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb84cf0e640 1 -- 172.21.15.88:0/800426942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8480c91d0 con 0x7fb848070a00 2023-11-20T07:01:25.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.474+0000 7fb83f7fe640 1 -- 172.21.15.88:0/800426942 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb838007a70 con 0x7fb848070a00 2023-11-20T07:01:25.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.478+0000 7fb83f7fe640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb8280664d0 0x7fb828068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.478+0000 7fb83f7fe640 1 -- 172.21.15.88:0/800426942 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb838083f60 con 0x7fb848070a00 2023-11-20T07:01:25.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.478+0000 7fb83dd9b640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb8280664d0 0x7fb828068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.478+0000 7fb83dd9b640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb8280664d0 0x7fb828068990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb84806cf90 tx=0x7fb830009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.482+0000 7fb83f7fe640 1 -- 172.21.15.88:0/800426942 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb8480c91d0 con 0x7fb848070a00 2023-11-20T07:01:25.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 -- 172.21.15.88:0/800426942 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb8480c91d0 con 0x7fb848070a00 2023-11-20T07:01:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb83f7fe640 1 -- 172.21.15.88:0/800426942 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb8480c91d0 con 0x7fb848070a00 2023-11-20T07:01:25.630 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:25.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 -- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb8280664d0 msgr2=0x7fb828068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb8280664d0 0x7fb828068990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb84806cf90 tx=0x7fb830009040 comp rx=0 tx=0).stop 2023-11-20T07:01:25.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 -- 172.21.15.88:0/800426942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb848070a00 msgr2=0x7fb8480c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb848070a00 0x7fb8480c7d00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c820 tx=0x7fb83800cce0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 -- 172.21.15.88:0/800426942 shutdown_connections 2023-11-20T07:01:25.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb8280664d0 0x7fb828068990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8481590d0 0x7fb8481463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8480c8dd0 0x7fb848143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 --2- 172.21.15.88:0/800426942 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb848070a00 0x7fb8480c7d00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 -- 172.21.15.88:0/800426942 >> 172.21.15.88:0/800426942 conn(0x7fb8480b0da0 msgr2=0x7fb848154b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:25.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 -- 172.21.15.88:0/800426942 shutdown_connections 2023-11-20T07:01:25.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.630+0000 7fb84cf0e640 1 -- 172.21.15.88:0/800426942 wait complete. 2023-11-20T07:01:25.652 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:01:25.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.790+0000 7fb9dddc5640 1 Processor -- start 2023-11-20T07:01:25.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.790+0000 7fb9dddc5640 1 -- start start 2023-11-20T07:01:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.790+0000 7fb9dddc5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d815cb90 0x7fb9d80cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.790+0000 7fb9dddc5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d80ce770 con 0x7fb9d80d3010 2023-11-20T07:01:25.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.790+0000 7fb9dddc5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d80d0600 con 0x7fb9d80d15d0 2023-11-20T07:01:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.790+0000 7fb9dddc5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80c6450 con 0x7fb9d815cb90 2023-11-20T07:01:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.790+0000 7fb9d6ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb9d80d3010 0x7fb9d80d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52662/0 (socket says 172.21.15.88:52662) 2023-11-20T07:01:25.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.790+0000 7fb9d6ffd640 1 -- 172.21.15.88:0/1492420398 learned_addr learned my addr 172.21.15.88:0/1492420398 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:25.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d77fe640 1 --2- 172.21.15.88:0/1492420398 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d815cb90 0x7fb9d80cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448744073 0 0) 0x7fb9d80ce770 con 0x7fb9d80d3010 2023-11-20T07:01:25.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c0003530 con 0x7fb9d80d3010 2023-11-20T07:01:25.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463310835 0 0) 0x7fb9d80d0600 con 0x7fb9d80d15d0 2023-11-20T07:01:25.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d80ce770 con 0x7fb9d80d15d0 2023-11-20T07:01:25.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2670890738 0 0) 0x7fb9c0003530 con 0x7fb9d80d3010 2023-11-20T07:01:25.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d815cb90 msgr2=0x7fb9d80cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:25.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 --2- 172.21.15.88:0/1492420398 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d815cb90 0x7fb9d80cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 >> v1:172.21.15.175:6789/0 conn(0x7fb9d80d15d0 legacy=0x7fb9d80c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80d08a0 con 0x7fb9d80d3010 2023-11-20T07:01:25.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fb9cc001680 con 0x7fb9d80d3010 2023-11-20T07:01:25.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 >> v1:172.21.15.88:6789/0 conn(0x7fb9d80d3010 legacy=0x7fb9d80d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 --2- 172.21.15.88:0/1492420398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c0003b40 0x7fb9c0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 --2- 172.21.15.88:0/1492420398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c00047d0 0x7fb9c0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 --2- 172.21.15.88:0/1492420398 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d815cb90 0x7fb9c00051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80c6450 con 0x7fb9c0003b40 2023-11-20T07:01:25.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c000baa0 con 0x7fb9c00047d0 2023-11-20T07:01:25.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c000bc60 con 0x7fb9d815cb90 2023-11-20T07:01:25.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d77fe640 1 --2- 172.21.15.88:0/1492420398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c0003b40 0x7fb9c0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d6ffd640 1 --2- 172.21.15.88:0/1492420398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c00047d0 0x7fb9c0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d7fff640 1 --2- 172.21.15.88:0/1492420398 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d815cb90 0x7fb9c00051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d77fe640 1 -- 172.21.15.88:0/1492420398 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d815cb90 msgr2=0x7fb9c00051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:25.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d77fe640 1 --2- 172.21.15.88:0/1492420398 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d815cb90 0x7fb9c00051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d77fe640 1 -- 172.21.15.88:0/1492420398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c00047d0 msgr2=0x7fb9c0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:25.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d77fe640 1 --2- 172.21.15.88:0/1492420398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c00047d0 0x7fb9c0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.794+0000 7fb9d77fe640 1 -- 172.21.15.88:0/1492420398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0003530 con 0x7fb9c0003b40 2023-11-20T07:01:25.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9d77fe640 1 --2- 172.21.15.88:0/1492420398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c0003b40 0x7fb9c0003f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009ac0 tx=0x7fb9c801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d39feb2e0423db server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:25.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c80059a0 con 0x7fb9c0003b40 2023-11-20T07:01:25.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c8005b00 con 0x7fb9c0003b40 2023-11-20T07:01:25.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9d67fc640 1 -- 172.21.15.88:0/1492420398 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8006030 con 0x7fb9c0003b40 2023-11-20T07:01:25.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9dddc5640 1 -- 172.21.15.88:0/1492420398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c0003b40 msgr2=0x7fb9c0003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9dddc5640 1 --2- 172.21.15.88:0/1492420398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9c0003b40 0x7fb9c0003f40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009ac0 tx=0x7fb9c801ca00 comp rx=0 tx=0).stop 2023-11-20T07:01:25.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9d7fff640 1 -- 172.21.15.88:0/1492420398 reap_dead start 2023-11-20T07:01:25.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9dddc5640 1 -- 172.21.15.88:0/1492420398 shutdown_connections 2023-11-20T07:01:25.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9dddc5640 1 -- 172.21.15.88:0/1492420398 >> 172.21.15.88:0/1492420398 conn(0x7fb9d809bc50 msgr2=0x7fb9d80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:25.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9dddc5640 1 -- 172.21.15.88:0/1492420398 shutdown_connections 2023-11-20T07:01:25.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9dddc5640 1 -- 172.21.15.88:0/1492420398 wait complete. 2023-11-20T07:01:25.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9dddc5640 1 Processor -- start 2023-11-20T07:01:25.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.798+0000 7fb9dddc5640 1 -- start start 2023-11-20T07:01:25.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9dddc5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c0003b40 0x7fb9d80b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9dddc5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9d80b34f0 0x7fb9d809e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9dddc5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d809d090 0x7fb9d809edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9dddc5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d809d640 con 0x7fb9d80b34f0 2023-11-20T07:01:25.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9dddc5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d809d920 con 0x7fb9c0003b40 2023-11-20T07:01:25.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9dddc5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d809dc00 con 0x7fb9d809d090 2023-11-20T07:01:25.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9d6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9d80b34f0 0x7fb9d809e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9d6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9d80b34f0 0x7fb9d809e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54402/0 (socket says 172.21.15.88:54402) 2023-11-20T07:01:25.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9d6ffd640 1 -- 172.21.15.88:0/3380259509 learned_addr learned my addr 172.21.15.88:0/3380259509 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:25.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9d77fe640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c0003b40 0x7fb9d80b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9d7fff640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d809d090 0x7fb9d809edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9d6ffd640 1 -- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d809d090 msgr2=0x7fb9d809edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9d6ffd640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d809d090 0x7fb9d809edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9d6ffd640 1 -- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c0003b40 msgr2=0x7fb9d80b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9d6ffd640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c0003b40 0x7fb9d80b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9d6ffd640 1 -- 172.21.15.88:0/3380259509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d809dee0 con 0x7fb9d80b34f0 2023-11-20T07:01:25.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9d6ffd640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9d80b34f0 0x7fb9d809e8b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc004f50 tx=0x7fb9cc0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:25.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9bffff640 1 -- 172.21.15.88:0/3380259509 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc007740 con 0x7fb9d80b34f0 2023-11-20T07:01:25.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9bffff640 1 -- 172.21.15.88:0/3380259509 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc00f940 con 0x7fb9d80b34f0 2023-11-20T07:01:25.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9bffff640 1 -- 172.21.15.88:0/3380259509 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc00fcf0 con 0x7fb9d80b34f0 2023-11-20T07:01:25.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9dddc5640 1 -- 172.21.15.88:0/3380259509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d80c9cc0 con 0x7fb9d80b34f0 2023-11-20T07:01:25.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9dddc5640 1 -- 172.21.15.88:0/3380259509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d809f330 con 0x7fb9d80b34f0 2023-11-20T07:01:25.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9dddc5640 1 -- 172.21.15.88:0/3380259509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d80c9f00 con 0x7fb9d80b34f0 2023-11-20T07:01:25.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.802+0000 7fb9bffff640 1 -- 172.21.15.88:0/3380259509 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb9cc01d460 con 0x7fb9d80b34f0 2023-11-20T07:01:25.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.806+0000 7fb9bffff640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb9c40664a0 0x7fb9c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:25.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.806+0000 7fb9bffff640 1 -- 172.21.15.88:0/3380259509 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9cc084150 con 0x7fb9d80b34f0 2023-11-20T07:01:25.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.806+0000 7fb9d77fe640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb9c40664a0 0x7fb9c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:25.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.806+0000 7fb9d77fe640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb9c40664a0 0x7fb9c4068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80ae000 tx=0x7fb9c80046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:25.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.806+0000 7fb9bffff640 1 -- 172.21.15.88:0/3380259509 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb9d80c9f00 con 0x7fb9d80b34f0 2023-11-20T07:01:25.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.986+0000 7fb9dddc5640 1 -- 172.21.15.88:0/3380259509 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9d80c9f00 con 0x7fb9d80b34f0 2023-11-20T07:01:25.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9bffff640 1 -- 172.21.15.88:0/3380259509 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fb9d80c9f00 con 0x7fb9d80b34f0 2023-11-20T07:01:25.989 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:25.990 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/1097293366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1097293366},{"type":"v1","addr":"172.21.15.175:6836","nonce":1097293366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/438678526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":438678526},{"type":"v1","addr":"172.21.15.88:6834","nonce":438678526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1083863684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":1083863684},{"type":"v1","addr":"172.21.15.88:6835","nonce":1083863684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:00:54.012155+0000","modified":"2023-11-20T07:01:16.901950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3413113678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3413113678},{"type":"v1","addr":"172.21.15.175:6837","nonce":3413113678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T07:01:25.990 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-11-20T07:01:25.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9dddc5640 1 -- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb9c40664a0 msgr2=0x7fb9c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9dddc5640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb9c40664a0 0x7fb9c4068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80ae000 tx=0x7fb9c80046d0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9dddc5640 1 -- 172.21.15.88:0/3380259509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9d80b34f0 msgr2=0x7fb9d809e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:25.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9dddc5640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9d80b34f0 0x7fb9d809e8b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc004f50 tx=0x7fb9cc0074f0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9dddc5640 1 -- 172.21.15.88:0/3380259509 shutdown_connections 2023-11-20T07:01:25.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9dddc5640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb9c40664a0 0x7fb9c4068960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9dddc5640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9d809d090 0x7fb9d809edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9dddc5640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9d80b34f0 0x7fb9d809e8b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9dddc5640 1 --2- 172.21.15.88:0/3380259509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c0003b40 0x7fb9d80b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:25.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9dddc5640 1 -- 172.21.15.88:0/3380259509 >> 172.21.15.88:0/3380259509 conn(0x7fb9d809bc50 msgr2=0x7fb9d8072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:25.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9dddc5640 1 -- 172.21.15.88:0/3380259509 shutdown_connections 2023-11-20T07:01:25.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:25.990+0000 7fb9dddc5640 1 -- 172.21.15.88:0/3380259509 wait complete. 2023-11-20T07:01:26.011 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:26.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07f0dc640 1 Processor -- start 2023-11-20T07:01:26.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07f0dc640 1 -- start start 2023-11-20T07:01:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07f0dc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe07815c910 0x7fe0780d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07f0dc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0780d3170 0x7fe0780cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07f0dc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0780ce730 con 0x7fe0780cefe0 2023-11-20T07:01:26.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07f0dc640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0780d17a0 con 0x7fe07815c910 2023-11-20T07:01:26.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07f0dc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780d0dd0 con 0x7fe0780d3170 2023-11-20T07:01:26.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07e0da640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe07815c910 0x7fe0780d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07e0da640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe07815c910 0x7fe0780d1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37382/0 (socket says 172.21.15.88:37382) 2023-11-20T07:01:26.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07e0da640 1 -- 172.21.15.88:0/1570216952 learned_addr learned my addr 172.21.15.88:0/1570216952 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:26.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07e8db640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe0780cefe0 0x7fe07806b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37718/0 (socket says 172.21.15.88:37718) 2023-11-20T07:01:26.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07d8d9640 1 --2- 172.21.15.88:0/1570216952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0780d3170 0x7fe0780cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07e0da640 1 -- 172.21.15.88:0/1570216952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0780d3170 msgr2=0x7fe0780cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:26.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07e0da640 1 --2- 172.21.15.88:0/1570216952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0780d3170 0x7fe0780cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07e0da640 1 -- 172.21.15.88:0/1570216952 >> v1:172.21.15.88:6789/0 conn(0x7fe0780cefe0 legacy=0x7fe07806b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07e0da640 1 -- 172.21.15.88:0/1570216952 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780d04a0 con 0x7fe07815c910 2023-11-20T07:01:26.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.150+0000 7fe07d0d8640 1 -- 172.21.15.88:0/1570216952 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802971335 0 0) 0x7fe0780ce730 con 0x7fe0780cefe0 2023-11-20T07:01:26.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07e0da640 1 --2- 172.21.15.88:0/1570216952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe07815c910 0x7fe0780d1260 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe074006fd0 tx=0x7fe07401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee85b209dcc45bb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:26.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07d0d8640 1 -- 172.21.15.88:0/1570216952 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0740ab660 con 0x7fe07815c910 2023-11-20T07:01:26.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07d0d8640 1 -- 172.21.15.88:0/1570216952 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0740ab7c0 con 0x7fe07815c910 2023-11-20T07:01:26.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07d0d8640 1 -- 172.21.15.88:0/1570216952 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0740abb50 con 0x7fe07815c910 2023-11-20T07:01:26.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07f0dc640 1 -- 172.21.15.88:0/1570216952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe07815c910 msgr2=0x7fe0780d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07f0dc640 1 --2- 172.21.15.88:0/1570216952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe07815c910 0x7fe0780d1260 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe074006fd0 tx=0x7fe07401c460 comp rx=0 tx=0).stop 2023-11-20T07:01:26.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07f0dc640 1 -- 172.21.15.88:0/1570216952 shutdown_connections 2023-11-20T07:01:26.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07f0dc640 1 --2- 172.21.15.88:0/1570216952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0780d3170 0x7fe0780cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07f0dc640 1 --2- 172.21.15.88:0/1570216952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe07815c910 0x7fe0780d1260 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07f0dc640 1 -- 172.21.15.88:0/1570216952 >> 172.21.15.88:0/1570216952 conn(0x7fe07809bb50 msgr2=0x7fe0780d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07f0dc640 1 -- 172.21.15.88:0/1570216952 shutdown_connections 2023-11-20T07:01:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07f0dc640 1 -- 172.21.15.88:0/1570216952 wait complete. 2023-11-20T07:01:26.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07f0dc640 1 Processor -- start 2023-11-20T07:01:26.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.154+0000 7fe07f0dc640 1 -- start start 2023-11-20T07:01:26.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07f0dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0780cefe0 0x7fe0780af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07f0dc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0780d3170 0x7fe0780c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07f0dc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe07815c910 0x7fe078157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07f0dc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780b0aa0 con 0x7fe0780d3170 2023-11-20T07:01:26.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07f0dc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780cb610 con 0x7fe0780cefe0 2023-11-20T07:01:26.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07f0dc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0780b0cf0 con 0x7fe07815c910 2023-11-20T07:01:26.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07d8d9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0780d3170 0x7fe0780c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07d8d9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0780d3170 0x7fe0780c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37392/0 (socket says 172.21.15.88:37392) 2023-11-20T07:01:26.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07d8d9640 1 -- 172.21.15.88:0/3431642782 learned_addr learned my addr 172.21.15.88:0/3431642782 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:26.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07e8db640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe07815c910 0x7fe078157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07e0da640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0780cefe0 0x7fe0780af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07d8d9640 1 -- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe07815c910 msgr2=0x7fe078157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07d8d9640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe07815c910 0x7fe078157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07d8d9640 1 -- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0780cefe0 msgr2=0x7fe0780af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07d8d9640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0780cefe0 0x7fe0780af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07d8d9640 1 -- 172.21.15.88:0/3431642782 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe074009480 con 0x7fe0780d3170 2023-11-20T07:01:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07e8db640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe07815c910 0x7fe078157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07e0da640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0780cefe0 0x7fe0780af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07d8d9640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0780d3170 0x7fe0780c9870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe06800d5d0 tx=0x7fe06800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe06effd640 1 -- 172.21.15.88:0/3431642782 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068004240 con 0x7fe0780d3170 2023-11-20T07:01:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe06effd640 1 -- 172.21.15.88:0/3431642782 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0680043a0 con 0x7fe0780d3170 2023-11-20T07:01:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe06effd640 1 -- 172.21.15.88:0/3431642782 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068003840 con 0x7fe0780d3170 2023-11-20T07:01:26.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07f0dc640 1 -- 172.21.15.88:0/3431642782 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0780b0fd0 con 0x7fe0780d3170 2023-11-20T07:01:26.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07f0dc640 1 -- 172.21.15.88:0/3431642782 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0780af8f0 con 0x7fe0780d3170 2023-11-20T07:01:26.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe07f0dc640 1 -- 172.21.15.88:0/3431642782 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0780cb470 con 0x7fe0780d3170 2023-11-20T07:01:26.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.158+0000 7fe06effd640 1 -- 172.21.15.88:0/3431642782 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe0680039a0 con 0x7fe0780d3170 2023-11-20T07:01:26.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.162+0000 7fe06effd640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe05c0664a0 0x7fe05c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.162+0000 7fe06effd640 1 -- 172.21.15.88:0/3431642782 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe0680842e0 con 0x7fe0780d3170 2023-11-20T07:01:26.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.162+0000 7fe07e0da640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe05c0664a0 0x7fe05c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.162+0000 7fe07e0da640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe05c0664a0 0x7fe05c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe0740af000 tx=0x7fe074009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:26.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.166+0000 7fe06effd640 1 -- 172.21.15.88:0/3431642782 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe0780cb470 con 0x7fe0780d3170 2023-11-20T07:01:26.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.326+0000 7fe07f0dc640 1 -- 172.21.15.88:0/3431642782 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0780cb470 con 0x7fe0780d3170 2023-11-20T07:01:26.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.326+0000 7fe06effd640 1 -- 172.21.15.88:0/3431642782 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fe0780cb470 con 0x7fe0780d3170 2023-11-20T07:01:26.327 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:26.327 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:26.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.326+0000 7fe07f0dc640 1 -- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe05c0664a0 msgr2=0x7fe05c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.326+0000 7fe07f0dc640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe05c0664a0 0x7fe05c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe0740af000 tx=0x7fe074009040 comp rx=0 tx=0).stop 2023-11-20T07:01:26.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.326+0000 7fe07f0dc640 1 -- 172.21.15.88:0/3431642782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0780d3170 msgr2=0x7fe0780c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.326+0000 7fe07f0dc640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0780d3170 0x7fe0780c9870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe06800d5d0 tx=0x7fe06800da90 comp rx=0 tx=0).stop 2023-11-20T07:01:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.326+0000 7fe07f0dc640 1 -- 172.21.15.88:0/3431642782 shutdown_connections 2023-11-20T07:01:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.326+0000 7fe07f0dc640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe05c0664a0 0x7fe05c068960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.326+0000 7fe07f0dc640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe07815c910 0x7fe078157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.326+0000 7fe07f0dc640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0780d3170 0x7fe0780c9870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.326+0000 7fe07f0dc640 1 --2- 172.21.15.88:0/3431642782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0780cefe0 0x7fe0780af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.326+0000 7fe07f0dc640 1 -- 172.21.15.88:0/3431642782 >> 172.21.15.88:0/3431642782 conn(0x7fe07809bb50 msgr2=0x7fe0780b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:26.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.330+0000 7fe07f0dc640 1 -- 172.21.15.88:0/3431642782 shutdown_connections 2023-11-20T07:01:26.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.330+0000 7fe07f0dc640 1 -- 172.21.15.88:0/3431642782 wait complete. 2023-11-20T07:01:26.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:26.349 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:26.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.486+0000 7fe5f2d94640 1 Processor -- start 2023-11-20T07:01:26.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.486+0000 7fe5f2d94640 1 -- start start 2023-11-20T07:01:26.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.490+0000 7fe5f2d94640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5ec06e260 0x7fe5ec0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.490+0000 7fe5f2d94640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec0b4600 con 0x7fe5ec159900 2023-11-20T07:01:26.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.490+0000 7fe5f2d94640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec0c8dd0 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.490+0000 7fe5f2d94640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ec0cd740 con 0x7fe5ec06e260 2023-11-20T07:01:26.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.490+0000 7fe5f0b30640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe5ec159900 0x7fe5ec069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37730/0 (socket says 172.21.15.88:37730) 2023-11-20T07:01:26.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.490+0000 7fe5f0b30640 1 -- 172.21.15.88:0/2421130241 learned_addr learned my addr 172.21.15.88:0/2421130241 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:26.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.490+0000 7fe5f1331640 1 --2- 172.21.15.88:0/2421130241 >> v2:172.21.15.88:3300/0 conn(0x7fe5ec06e260 0x7fe5ec0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.490+0000 7fe5f1331640 1 -- 172.21.15.88:0/2421130241 >> v1:172.21.15.175:6789/0 conn(0x7fe5ec06a5a0 legacy=0x7fe5ec0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.490+0000 7fe5f1331640 1 -- 172.21.15.88:0/2421130241 >> v1:172.21.15.88:6789/0 conn(0x7fe5ec159900 legacy=0x7fe5ec069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.490+0000 7fe5f1331640 1 -- 172.21.15.88:0/2421130241 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec0c90b0 con 0x7fe5ec06e260 2023-11-20T07:01:26.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.490+0000 7fe5e37fe640 1 -- 172.21.15.88:0/2421130241 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253488926 0 0) 0x7fe5ec0b4600 con 0x7fe5ec159900 2023-11-20T07:01:26.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5f1331640 1 --2- 172.21.15.88:0/2421130241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5ec06e260 0x7fe5ec0b3f00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4009d90 tx=0x7fe5e401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb6e5968e5dc481 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:26.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5e37fe640 1 -- 172.21.15.88:0/2421130241 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40a5a10 con 0x7fe5ec06e260 2023-11-20T07:01:26.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5e37fe640 1 -- 172.21.15.88:0/2421130241 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e40a5b70 con 0x7fe5ec06e260 2023-11-20T07:01:26.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5e37fe640 1 -- 172.21.15.88:0/2421130241 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40ad440 con 0x7fe5ec06e260 2023-11-20T07:01:26.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5f2d94640 1 -- 172.21.15.88:0/2421130241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5ec06e260 msgr2=0x7fe5ec0b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5f2d94640 1 --2- 172.21.15.88:0/2421130241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5ec06e260 0x7fe5ec0b3f00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4009d90 tx=0x7fe5e401c950 comp rx=0 tx=0).stop 2023-11-20T07:01:26.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5f2d94640 1 -- 172.21.15.88:0/2421130241 shutdown_connections 2023-11-20T07:01:26.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5f2d94640 1 --2- 172.21.15.88:0/2421130241 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5ec06e260 0x7fe5ec0b3f00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5f2d94640 1 -- 172.21.15.88:0/2421130241 >> 172.21.15.88:0/2421130241 conn(0x7fe5ec0b0da0 msgr2=0x7fe5ec0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:26.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5f2d94640 1 -- 172.21.15.88:0/2421130241 shutdown_connections 2023-11-20T07:01:26.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5f2d94640 1 -- 172.21.15.88:0/2421130241 wait complete. 2023-11-20T07:01:26.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5f2d94640 1 Processor -- start 2023-11-20T07:01:26.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.494+0000 7fe5f2d94640 1 -- start start 2023-11-20T07:01:26.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f2d94640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5ec06a5a0 0x7fe5ec070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f2d94640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5ec06e260 0x7fe5ec155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f2d94640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5ec159900 0x7fe5ec14e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f2d94640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec150bb0 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f2d94640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec14f290 con 0x7fe5ec06e260 2023-11-20T07:01:26.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f2d94640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec14f4e0 con 0x7fe5ec159900 2023-11-20T07:01:26.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f0b30640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5ec06a5a0 0x7fe5ec070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f0b30640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5ec06a5a0 0x7fe5ec070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37410/0 (socket says 172.21.15.88:37410) 2023-11-20T07:01:26.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f0b30640 1 -- 172.21.15.88:0/1537654251 learned_addr learned my addr 172.21.15.88:0/1537654251 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:26.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f1331640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5ec159900 0x7fe5ec14e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5e3fff640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5ec06e260 0x7fe5ec155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f0b30640 1 -- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5ec159900 msgr2=0x7fe5ec14e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f0b30640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5ec159900 0x7fe5ec14e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f0b30640 1 -- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5ec06e260 msgr2=0x7fe5ec155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f0b30640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5ec06e260 0x7fe5ec155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f0b30640 1 -- 172.21.15.88:0/1537654251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4009a70 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f0b30640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5ec06a5a0 0x7fe5ec070450 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800c440 tx=0x7fe5e800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:26.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5e17fa640 1 -- 172.21.15.88:0/1537654251 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e80074e0 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5e17fa640 1 -- 172.21.15.88:0/1537654251 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e8007640 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f2d94640 1 -- 172.21.15.88:0/1537654251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ec14f7c0 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5e17fa640 1 -- 172.21.15.88:0/1537654251 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8004a10 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f2d94640 1 -- 172.21.15.88:0/1537654251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ec14fd80 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5f2d94640 1 -- 172.21.15.88:0/1537654251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ec04e170 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.498+0000 7fe5e17fa640 1 -- 172.21.15.88:0/1537654251 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe5e8004b70 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.502+0000 7fe5e17fa640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe5d80664a0 0x7fe5d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.502+0000 7fe5e17fa640 1 -- 172.21.15.88:0/1537654251 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5e8083610 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.502+0000 7fe5e3fff640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe5d80664a0 0x7fe5d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.502+0000 7fe5e3fff640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe5d80664a0 0x7fe5d8068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0b1940 tx=0x7fe5dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:26.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.506+0000 7fe5e17fa640 1 -- 172.21.15.88:0/1537654251 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe5e8050790 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 -- 172.21.15.88:0/1537654251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5ec06ca90 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5e17fa640 1 -- 172.21.15.88:0/1537654251 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5e8018020 con 0x7fe5ec06a5a0 2023-11-20T07:01:26.658 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 -- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe5d80664a0 msgr2=0x7fe5d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe5d80664a0 0x7fe5d8068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0b1940 tx=0x7fe5dc009040 comp rx=0 tx=0).stop 2023-11-20T07:01:26.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 -- 172.21.15.88:0/1537654251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5ec06a5a0 msgr2=0x7fe5ec070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5ec06a5a0 0x7fe5ec070450 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800c440 tx=0x7fe5e800c900 comp rx=0 tx=0).stop 2023-11-20T07:01:26.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 -- 172.21.15.88:0/1537654251 shutdown_connections 2023-11-20T07:01:26.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe5d80664a0 0x7fe5d8068960 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5ec159900 0x7fe5ec14e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5ec06e260 0x7fe5ec155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 --2- 172.21.15.88:0/1537654251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5ec06a5a0 0x7fe5ec070450 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 -- 172.21.15.88:0/1537654251 >> 172.21.15.88:0/1537654251 conn(0x7fe5ec0b0da0 msgr2=0x7fe5ec069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:26.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 -- 172.21.15.88:0/1537654251 shutdown_connections 2023-11-20T07:01:26.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.658+0000 7fe5f2d94640 1 -- 172.21.15.88:0/1537654251 wait complete. 2023-11-20T07:01:26.679 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:26.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.818+0000 7fd5a79c5640 1 Processor -- start 2023-11-20T07:01:26.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.818+0000 7fd5a79c5640 1 -- start start 2023-11-20T07:01:26.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a79c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5a00cb040 0x7fd5a00ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a79c5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5a00cebd0 0x7fd5a00cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a79c5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a00cc330 con 0x7fd5a015cc60 2023-11-20T07:01:26.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a79c5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a00cb4a0 con 0x7fd5a00cebd0 2023-11-20T07:01:26.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a79c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00cefe0 con 0x7fd5a00cb040 2023-11-20T07:01:26.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a5f62640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5a00cebd0 0x7fd5a00cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a5761640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd5a015cc60 0x7fd5a0161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:60878/0 (socket says 172.21.15.88:60878) 2023-11-20T07:01:26.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a4f60640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5a00cb040 0x7fd5a00ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a5761640 1 -- 172.21.15.88:0/2107855600 learned_addr learned my addr 172.21.15.88:0/2107855600 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:26.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd597fff640 1 -- 172.21.15.88:0/2107855600 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5148749 0 0) 0x7fd5a00cc330 con 0x7fd5a015cc60 2023-11-20T07:01:26.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd597fff640 1 -- 172.21.15.88:0/2107855600 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd58c003530 con 0x7fd5a015cc60 2023-11-20T07:01:26.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a4f60640 1 -- 172.21.15.88:0/2107855600 >> v2:172.21.15.175:3300/0 conn(0x7fd5a00cebd0 msgr2=0x7fd5a00cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:26.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a4f60640 1 --2- 172.21.15.88:0/2107855600 >> v2:172.21.15.175:3300/0 conn(0x7fd5a00cebd0 0x7fd5a00cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a4f60640 1 -- 172.21.15.88:0/2107855600 >> v1:172.21.15.175:6789/0 conn(0x7fd5a015cc60 legacy=0x7fd5a0161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a4f60640 1 -- 172.21.15.88:0/2107855600 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a00cb720 con 0x7fd5a00cb040 2023-11-20T07:01:26.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.822+0000 7fd5a5f62640 1 --2- 172.21.15.88:0/2107855600 >> v2:172.21.15.175:3300/0 conn(0x7fd5a00cebd0 0x7fd5a00cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:26.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.826+0000 7fd5a4f60640 1 --2- 172.21.15.88:0/2107855600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5a00cb040 0x7fd5a00ce690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd5900097c0 tx=0x7fd59001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e50fc1e746cafede server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:26.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.826+0000 7fd597fff640 1 -- 172.21.15.88:0/2107855600 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5900ab650 con 0x7fd5a00cb040 2023-11-20T07:01:26.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.826+0000 7fd597fff640 1 -- 172.21.15.88:0/2107855600 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5900ab7b0 con 0x7fd5a00cb040 2023-11-20T07:01:26.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.826+0000 7fd597fff640 1 -- 172.21.15.88:0/2107855600 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5900abb40 con 0x7fd5a00cb040 2023-11-20T07:01:26.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.826+0000 7fd5a79c5640 1 -- 172.21.15.88:0/2107855600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5a00cb040 msgr2=0x7fd5a00ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.826+0000 7fd5a79c5640 1 --2- 172.21.15.88:0/2107855600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5a00cb040 0x7fd5a00ce690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd5900097c0 tx=0x7fd59001c450 comp rx=0 tx=0).stop 2023-11-20T07:01:26.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.826+0000 7fd5a79c5640 1 -- 172.21.15.88:0/2107855600 shutdown_connections 2023-11-20T07:01:26.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.826+0000 7fd5a79c5640 1 --2- 172.21.15.88:0/2107855600 >> v2:172.21.15.175:3300/0 conn(0x7fd5a00cebd0 0x7fd5a00cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.826+0000 7fd5a79c5640 1 --2- 172.21.15.88:0/2107855600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5a00cb040 0x7fd5a00ce690 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.826+0000 7fd5a79c5640 1 -- 172.21.15.88:0/2107855600 >> 172.21.15.88:0/2107855600 conn(0x7fd5a006e570 msgr2=0x7fd5a006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:26.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.826+0000 7fd5a79c5640 1 -- 172.21.15.88:0/2107855600 shutdown_connections 2023-11-20T07:01:26.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.826+0000 7fd5a79c5640 1 -- 172.21.15.88:0/2107855600 wait complete. 2023-11-20T07:01:26.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a79c5640 1 Processor -- start 2023-11-20T07:01:26.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a79c5640 1 -- start start 2023-11-20T07:01:26.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a79c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5a00cb040 0x7fd5a014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a79c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5a00cebd0 0x7fd5a00b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a79c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5a015cc60 0x7fd5a00c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a79c5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a015b4c0 con 0x7fd5a00cb040 2023-11-20T07:01:26.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a79c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a014c1a0 con 0x7fd5a00cebd0 2023-11-20T07:01:26.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a79c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00b0d40 con 0x7fd5a015cc60 2023-11-20T07:01:26.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a5761640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5a00cb040 0x7fd5a014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a5761640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5a00cb040 0x7fd5a014bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37426/0 (socket says 172.21.15.88:37426) 2023-11-20T07:01:26.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a5761640 1 -- 172.21.15.88:0/429777135 learned_addr learned my addr 172.21.15.88:0/429777135 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:26.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a5f62640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5a015cc60 0x7fd5a00c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a4f60640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5a00cebd0 0x7fd5a00b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a5761640 1 -- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5a015cc60 msgr2=0x7fd5a00c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a5761640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5a015cc60 0x7fd5a00c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a5761640 1 -- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5a00cebd0 msgr2=0x7fd5a00b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a5761640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5a00cebd0 0x7fd5a00b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a5761640 1 -- 172.21.15.88:0/429777135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598009a70 con 0x7fd5a00cb040 2023-11-20T07:01:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a5761640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5a00cb040 0x7fd5a014bc60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00c3c0 tx=0x7fd59c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd595ffb640 1 -- 172.21.15.88:0/429777135 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c005db0 con 0x7fd5a00cb040 2023-11-20T07:01:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd595ffb640 1 -- 172.21.15.88:0/429777135 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c0070d0 con 0x7fd5a00cb040 2023-11-20T07:01:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd595ffb640 1 -- 172.21.15.88:0/429777135 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0074a0 con 0x7fd5a00cb040 2023-11-20T07:01:26.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a79c5640 1 -- 172.21.15.88:0/429777135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd590009420 con 0x7fd5a00cb040 2023-11-20T07:01:26.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.830+0000 7fd5a79c5640 1 -- 172.21.15.88:0/429777135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a015b0e0 con 0x7fd5a00cb040 2023-11-20T07:01:26.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.834+0000 7fd5a79c5640 1 -- 172.21.15.88:0/429777135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a004e170 con 0x7fd5a00cb040 2023-11-20T07:01:26.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.834+0000 7fd595ffb640 1 -- 172.21.15.88:0/429777135 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd59c007600 con 0x7fd5a00cb040 2023-11-20T07:01:26.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.834+0000 7fd595ffb640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd5840664a0 0x7fd584068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:26.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.834+0000 7fd595ffb640 1 -- 172.21.15.88:0/429777135 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd59c0836f0 con 0x7fd5a00cb040 2023-11-20T07:01:26.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.834+0000 7fd5a4f60640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd5840664a0 0x7fd584068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.834+0000 7fd5a4f60640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd5840664a0 0x7fd584068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd5900af000 tx=0x7fd5900a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.838+0000 7fd595ffb640 1 -- 172.21.15.88:0/429777135 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd59c0509a0 con 0x7fd5a00cb040 2023-11-20T07:01:26.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.986+0000 7fd5a79c5640 1 -- 172.21.15.88:0/429777135 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5a00b6830 con 0x7fd5a00cb040 2023-11-20T07:01:26.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd595ffb640 1 -- 172.21.15.88:0/429777135 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd59c053fc0 con 0x7fd5a00cb040 2023-11-20T07:01:26.989 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:26.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd5a79c5640 1 -- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd5840664a0 msgr2=0x7fd584068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd5a79c5640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd5840664a0 0x7fd584068960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd5900af000 tx=0x7fd5900a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:26.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd5a79c5640 1 -- 172.21.15.88:0/429777135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5a00cb040 msgr2=0x7fd5a014bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:26.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd5a79c5640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5a00cb040 0x7fd5a014bc60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00c3c0 tx=0x7fd59c00c7c0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd5a79c5640 1 -- 172.21.15.88:0/429777135 shutdown_connections 2023-11-20T07:01:26.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd5a79c5640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd5840664a0 0x7fd584068960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd5a79c5640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5a015cc60 0x7fd5a00c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd5a79c5640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5a00cebd0 0x7fd5a00b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd5a79c5640 1 --2- 172.21.15.88:0/429777135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5a00cb040 0x7fd5a014bc60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:26.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd5a79c5640 1 -- 172.21.15.88:0/429777135 >> 172.21.15.88:0/429777135 conn(0x7fd5a006e570 msgr2=0x7fd5a01673f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:26.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd5a79c5640 1 -- 172.21.15.88:0/429777135 shutdown_connections 2023-11-20T07:01:26.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:26.990+0000 7fd5a79c5640 1 -- 172.21.15.88:0/429777135 wait complete. 2023-11-20T07:01:27.010 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:27.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e67c91640 1 Processor -- start 2023-11-20T07:01:27.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e67c91640 1 -- start start 2023-11-20T07:01:27.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e67c91640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e6015cc60 0x7f3e600cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e67c91640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e60161260 0x7f3e600ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e67c91640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e600cc330 con 0x7f3e600cebd0 2023-11-20T07:01:27.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e67c91640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e600cefe0 con 0x7f3e6015cc60 2023-11-20T07:01:27.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e67c91640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600cb720 con 0x7f3e60161260 2023-11-20T07:01:27.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e65a2d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e6015cc60 0x7f3e600cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e6622e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3e600cebd0 0x7f3e600b2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37736/0 (socket says 172.21.15.88:37736) 2023-11-20T07:01:27.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e65a2d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e6015cc60 0x7f3e600cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37430/0 (socket says 172.21.15.88:37430) 2023-11-20T07:01:27.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e6622e640 1 -- 172.21.15.88:0/2554718700 learned_addr learned my addr 172.21.15.88:0/2554718700 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:27.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e6522c640 1 --2- 172.21.15.88:0/2554718700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e60161260 0x7f3e600ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e65a2d640 1 -- 172.21.15.88:0/2554718700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e60161260 msgr2=0x7f3e600ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:27.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e65a2d640 1 --2- 172.21.15.88:0/2554718700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e60161260 0x7f3e600ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e65a2d640 1 -- 172.21.15.88:0/2554718700 >> v1:172.21.15.88:6789/0 conn(0x7f3e600cebd0 legacy=0x7f3e600b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e65a2d640 1 -- 172.21.15.88:0/2554718700 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e600cba00 con 0x7f3e6015cc60 2023-11-20T07:01:27.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.150+0000 7f3e64a2b640 1 -- 172.21.15.88:0/2554718700 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517873834 0 0) 0x7f3e600cc330 con 0x7f3e600cebd0 2023-11-20T07:01:27.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.154+0000 7f3e65a2d640 1 --2- 172.21.15.88:0/2554718700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e6015cc60 0x7f3e600cb040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0097c0 tx=0x7f3e5c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0f270d135d4e2a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:27.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.154+0000 7f3e64a2b640 1 -- 172.21.15.88:0/2554718700 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c0ab650 con 0x7f3e6015cc60 2023-11-20T07:01:27.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.154+0000 7f3e64a2b640 1 -- 172.21.15.88:0/2554718700 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c0ab7b0 con 0x7f3e6015cc60 2023-11-20T07:01:27.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.154+0000 7f3e64a2b640 1 -- 172.21.15.88:0/2554718700 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c0abb40 con 0x7f3e6015cc60 2023-11-20T07:01:27.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.154+0000 7f3e67c91640 1 -- 172.21.15.88:0/2554718700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e6015cc60 msgr2=0x7f3e600cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.154+0000 7f3e67c91640 1 --2- 172.21.15.88:0/2554718700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e6015cc60 0x7f3e600cb040 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0097c0 tx=0x7f3e5c01c450 comp rx=0 tx=0).stop 2023-11-20T07:01:27.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.154+0000 7f3e67c91640 1 -- 172.21.15.88:0/2554718700 shutdown_connections 2023-11-20T07:01:27.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.154+0000 7f3e67c91640 1 --2- 172.21.15.88:0/2554718700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e60161260 0x7f3e600ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.154+0000 7f3e67c91640 1 --2- 172.21.15.88:0/2554718700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e6015cc60 0x7f3e600cb040 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.154+0000 7f3e67c91640 1 -- 172.21.15.88:0/2554718700 >> 172.21.15.88:0/2554718700 conn(0x7f3e6006e570 msgr2=0x7f3e6006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:27.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.154+0000 7f3e67c91640 1 -- 172.21.15.88:0/2554718700 shutdown_connections 2023-11-20T07:01:27.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.154+0000 7f3e67c91640 1 -- 172.21.15.88:0/2554718700 wait complete. 2023-11-20T07:01:27.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e67c91640 1 Processor -- start 2023-11-20T07:01:27.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e67c91640 1 -- start start 2023-11-20T07:01:27.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e67c91640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e600cebd0 0x7f3e60154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e67c91640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e6015cc60 0x7f3e6015b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e67c91640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e60161260 0x7f3e600c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e67c91640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600b3460 con 0x7f3e60161260 2023-11-20T07:01:27.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e67c91640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600b3fe0 con 0x7f3e600cebd0 2023-11-20T07:01:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e67c91640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e600b36b0 con 0x7f3e6015cc60 2023-11-20T07:01:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e6622e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e60161260 0x7f3e600c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e6622e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e60161260 0x7f3e600c4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37446/0 (socket says 172.21.15.88:37446) 2023-11-20T07:01:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e6622e640 1 -- 172.21.15.88:0/1879312790 learned_addr learned my addr 172.21.15.88:0/1879312790 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e65a2d640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e600cebd0 0x7f3e60154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e6522c640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e6015cc60 0x7f3e6015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e6622e640 1 -- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e6015cc60 msgr2=0x7f3e6015b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e6622e640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e6015cc60 0x7f3e6015b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e6622e640 1 -- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e600cebd0 msgr2=0x7f3e60154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e6622e640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e600cebd0 0x7f3e60154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e6622e640 1 -- 172.21.15.88:0/1879312790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c009420 con 0x7f3e60161260 2023-11-20T07:01:27.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e65a2d640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e600cebd0 0x7f3e60154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:27.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e6622e640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e60161260 0x7f3e600c4420 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800c780 tx=0x7f3e5800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:27.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e567fc640 1 -- 172.21.15.88:0/1879312790 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5800ce90 con 0x7f3e60161260 2023-11-20T07:01:27.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e567fc640 1 -- 172.21.15.88:0/1879312790 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5800a640 con 0x7f3e60161260 2023-11-20T07:01:27.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e567fc640 1 -- 172.21.15.88:0/1879312790 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5800a9d0 con 0x7f3e60161260 2023-11-20T07:01:27.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e67c91640 1 -- 172.21.15.88:0/1879312790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e600b3990 con 0x7f3e60161260 2023-11-20T07:01:27.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e67c91640 1 -- 172.21.15.88:0/1879312790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e60154f90 con 0x7f3e60161260 2023-11-20T07:01:27.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.158+0000 7f3e67c91640 1 -- 172.21.15.88:0/1879312790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6004e170 con 0x7f3e60161260 2023-11-20T07:01:27.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.162+0000 7f3e567fc640 1 -- 172.21.15.88:0/1879312790 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3e5800ab30 con 0x7f3e60161260 2023-11-20T07:01:27.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.162+0000 7f3e567fc640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3e440664a0 0x7f3e44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.162+0000 7f3e567fc640 1 -- 172.21.15.88:0/1879312790 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e580836c0 con 0x7f3e60161260 2023-11-20T07:01:27.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.162+0000 7f3e65a2d640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3e440664a0 0x7f3e44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.162+0000 7f3e65a2d640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3e440664a0 0x7f3e44068960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0af000 tx=0x7f3e5c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:27.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.166+0000 7f3e567fc640 1 -- 172.21.15.88:0/1879312790 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3e58050840 con 0x7f3e60161260 2023-11-20T07:01:27.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 -- 172.21.15.88:0/1879312790 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e600b4120 con 0x7f3e60161260 2023-11-20T07:01:27.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e567fc640 1 -- 172.21.15.88:0/1879312790 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e580180a0 con 0x7f3e60161260 2023-11-20T07:01:27.315 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:27.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 -- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3e440664a0 msgr2=0x7f3e44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3e440664a0 0x7f3e44068960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0af000 tx=0x7f3e5c0a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 -- 172.21.15.88:0/1879312790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e60161260 msgr2=0x7f3e600c4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e60161260 0x7f3e600c4420 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800c780 tx=0x7f3e5800cc40 comp rx=0 tx=0).stop 2023-11-20T07:01:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 -- 172.21.15.88:0/1879312790 shutdown_connections 2023-11-20T07:01:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3e440664a0 0x7f3e44068960 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e6015cc60 0x7f3e6015b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e60161260 0x7f3e600c4420 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 --2- 172.21.15.88:0/1879312790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e600cebd0 0x7f3e60154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 -- 172.21.15.88:0/1879312790 >> 172.21.15.88:0/1879312790 conn(0x7f3e6006e570 msgr2=0x7f3e60159150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 -- 172.21.15.88:0/1879312790 shutdown_connections 2023-11-20T07:01:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.314+0000 7f3e67c91640 1 -- 172.21.15.88:0/1879312790 wait complete. 2023-11-20T07:01:27.335 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:27.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.474+0000 7f32fd33e640 1 Processor -- start 2023-11-20T07:01:27.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.474+0000 7f32fd33e640 1 -- start start 2023-11-20T07:01:27.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32fd33e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f32f80b84e0 0x7f32f80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32fd33e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f80d1670 con 0x7f32f80d0210 2023-11-20T07:01:27.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32fd33e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f80d1950 con 0x7f32f815cba0 2023-11-20T07:01:27.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32fd33e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f80d1460 con 0x7f32f80b84e0 2023-11-20T07:01:27.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32ee7fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f32f80d0210 0x7f32f80b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37744/0 (socket says 172.21.15.88:37744) 2023-11-20T07:01:27.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32ee7fc640 1 -- 172.21.15.88:0/664607605 learned_addr learned my addr 172.21.15.88:0/664607605 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:27.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32f77fe640 1 --2- 172.21.15.88:0/664607605 >> v2:172.21.15.175:3300/0 conn(0x7f32f80b84e0 0x7f32f80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32f67fc640 1 -- 172.21.15.88:0/664607605 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129208213 0 0) 0x7f32f80d1670 con 0x7f32f80d0210 2023-11-20T07:01:27.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32f67fc640 1 -- 172.21.15.88:0/664607605 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e4003530 con 0x7f32f80d0210 2023-11-20T07:01:27.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32f67fc640 1 -- 172.21.15.88:0/664607605 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1521705545 0 0) 0x7f32e4003530 con 0x7f32f80d0210 2023-11-20T07:01:27.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32f77fe640 1 -- 172.21.15.88:0/664607605 >> v1:172.21.15.175:6789/0 conn(0x7f32f815cba0 legacy=0x7f32f80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32f77fe640 1 -- 172.21.15.88:0/664607605 >> v1:172.21.15.88:6789/0 conn(0x7f32f80d0210 legacy=0x7f32f80b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.478+0000 7f32f77fe640 1 -- 172.21.15.88:0/664607605 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80d1c30 con 0x7f32f80b84e0 2023-11-20T07:01:27.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32f77fe640 1 --2- 172.21.15.88:0/664607605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f80b84e0 0x7f32f80d0f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009d90 tx=0x7f32f001c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6841134f6fb60a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:27.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32f67fc640 1 -- 172.21.15.88:0/664607605 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0001680 con 0x7f32f80b84e0 2023-11-20T07:01:27.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32f67fc640 1 -- 172.21.15.88:0/664607605 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f00a5620 con 0x7f32f80b84e0 2023-11-20T07:01:27.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32f67fc640 1 -- 172.21.15.88:0/664607605 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f00a59b0 con 0x7f32f80b84e0 2023-11-20T07:01:27.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 -- 172.21.15.88:0/664607605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f80b84e0 msgr2=0x7f32f80d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 --2- 172.21.15.88:0/664607605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f80b84e0 0x7f32f80d0f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009d90 tx=0x7f32f001c7e0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 -- 172.21.15.88:0/664607605 shutdown_connections 2023-11-20T07:01:27.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 --2- 172.21.15.88:0/664607605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f80b84e0 0x7f32f80d0f20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 -- 172.21.15.88:0/664607605 >> 172.21.15.88:0/664607605 conn(0x7f32f80719c0 msgr2=0x7f32f8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:27.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 -- 172.21.15.88:0/664607605 shutdown_connections 2023-11-20T07:01:27.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 -- 172.21.15.88:0/664607605 wait complete. 2023-11-20T07:01:27.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 Processor -- start 2023-11-20T07:01:27.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 -- start start 2023-11-20T07:01:27.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f80b84e0 0x7f32f814a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80d0210 0x7f32f815f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32f815cba0 0x7f32f8153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f815e340 con 0x7f32f80d0210 2023-11-20T07:01:27.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f814cd70 con 0x7f32f80b84e0 2023-11-20T07:01:27.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.482+0000 7f32fd33e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f80c7850 con 0x7f32f815cba0 2023-11-20T07:01:27.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32ee7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80d0210 0x7f32f815f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32ee7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80d0210 0x7f32f815f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37450/0 (socket says 172.21.15.88:37450) 2023-11-20T07:01:27.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32ee7fc640 1 -- 172.21.15.88:0/2095219152 learned_addr learned my addr 172.21.15.88:0/2095219152 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:27.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32f6ffd640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f80b84e0 0x7f32f814a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32f77fe640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32f815cba0 0x7f32f8153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32ee7fc640 1 -- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32f815cba0 msgr2=0x7f32f8153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32ee7fc640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32f815cba0 0x7f32f8153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32ee7fc640 1 -- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f80b84e0 msgr2=0x7f32f814a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32ee7fc640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f80b84e0 0x7f32f814a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32ee7fc640 1 -- 172.21.15.88:0/2095219152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f0009a70 con 0x7f32f80d0210 2023-11-20T07:01:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32f6ffd640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f80b84e0 0x7f32f814a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32ee7fc640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80d0210 0x7f32f815f070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f32e000c750 tx=0x7f32e000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32effff640 1 -- 172.21.15.88:0/2095219152 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0005ae0 con 0x7f32f80d0210 2023-11-20T07:01:27.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32effff640 1 -- 172.21.15.88:0/2095219152 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e0005c40 con 0x7f32f80d0210 2023-11-20T07:01:27.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32effff640 1 -- 172.21.15.88:0/2095219152 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0007290 con 0x7f32f80d0210 2023-11-20T07:01:27.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32fd33e640 1 -- 172.21.15.88:0/2095219152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f814cfd0 con 0x7f32f80d0210 2023-11-20T07:01:27.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32fd33e640 1 -- 172.21.15.88:0/2095219152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f815e870 con 0x7f32f80d0210 2023-11-20T07:01:27.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32fd33e640 1 -- 172.21.15.88:0/2095219152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f804e170 con 0x7f32f80d0210 2023-11-20T07:01:27.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.486+0000 7f32effff640 1 -- 172.21.15.88:0/2095219152 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f32e00073f0 con 0x7f32f80d0210 2023-11-20T07:01:27.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.490+0000 7f32effff640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f32d80664d0 0x7f32d8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.490+0000 7f32effff640 1 -- 172.21.15.88:0/2095219152 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f32e00838d0 con 0x7f32f80d0210 2023-11-20T07:01:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.490+0000 7f32f6ffd640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f32d80664d0 0x7f32d8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.490+0000 7f32f6ffd640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f32d80664d0 0x7f32d8068990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f32f815c4b0 tx=0x7f32e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:27.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.494+0000 7f32effff640 1 -- 172.21.15.88:0/2095219152 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f32e0050b00 con 0x7f32f80d0210 2023-11-20T07:01:27.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.642+0000 7f32fd33e640 1 -- 172.21.15.88:0/2095219152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f32f8072f10 con 0x7f32f80d0210 2023-11-20T07:01:27.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.642+0000 7f32effff640 1 -- 172.21.15.88:0/2095219152 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f32e00170a0 con 0x7f32f80d0210 2023-11-20T07:01:27.644 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:27.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.646+0000 7f32fd33e640 1 -- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f32d80664d0 msgr2=0x7f32d8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.646+0000 7f32fd33e640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f32d80664d0 0x7f32d8068990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f32f815c4b0 tx=0x7f32e8009040 comp rx=0 tx=0).stop 2023-11-20T07:01:27.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.646+0000 7f32fd33e640 1 -- 172.21.15.88:0/2095219152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80d0210 msgr2=0x7f32f815f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.646+0000 7f32fd33e640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80d0210 0x7f32f815f070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f32e000c750 tx=0x7f32e000cc10 comp rx=0 tx=0).stop 2023-11-20T07:01:27.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.646+0000 7f32fd33e640 1 -- 172.21.15.88:0/2095219152 shutdown_connections 2023-11-20T07:01:27.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.646+0000 7f32fd33e640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f32d80664d0 0x7f32d8068990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.646+0000 7f32fd33e640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32f815cba0 0x7f32f8153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.646+0000 7f32fd33e640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32f80d0210 0x7f32f815f070 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.646+0000 7f32fd33e640 1 --2- 172.21.15.88:0/2095219152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f80b84e0 0x7f32f814a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.646+0000 7f32fd33e640 1 -- 172.21.15.88:0/2095219152 >> 172.21.15.88:0/2095219152 conn(0x7f32f80719c0 msgr2=0x7f32f80d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:27.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.646+0000 7f32fd33e640 1 -- 172.21.15.88:0/2095219152 shutdown_connections 2023-11-20T07:01:27.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.646+0000 7f32fd33e640 1 -- 172.21.15.88:0/2095219152 wait complete. 2023-11-20T07:01:27.665 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:01:27.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.802+0000 7fe98ffb8640 1 Processor -- start 2023-11-20T07:01:27.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.802+0000 7fe98ffb8640 1 -- start start 2023-11-20T07:01:27.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.802+0000 7fe98ffb8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe988159a00 0x7fe988069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.802+0000 7fe98ffb8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe98806de60 0x7fe9880c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.802+0000 7fe98ffb8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe98806a810 con 0x7fe98806a3d0 2023-11-20T07:01:27.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.802+0000 7fe98ffb8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9880cd720 con 0x7fe988159a00 2023-11-20T07:01:27.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.802+0000 7fe98ffb8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98806e2f0 con 0x7fe98806de60 2023-11-20T07:01:27.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.802+0000 7fe98dd54640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe988159a00 0x7fe988069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.802+0000 7fe98dd54640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe988159a00 0x7fe988069e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37458/0 (socket says 172.21.15.88:37458) 2023-11-20T07:01:27.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.802+0000 7fe98dd54640 1 -- 172.21.15.88:0/1124482899 learned_addr learned my addr 172.21.15.88:0/1124482899 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:27.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.802+0000 7fe98e555640 1 --2- 172.21.15.88:0/1124482899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe98806de60 0x7fe9880c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98dd54640 1 -- 172.21.15.88:0/1124482899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe98806de60 msgr2=0x7fe9880c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:27.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98dd54640 1 --2- 172.21.15.88:0/1124482899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe98806de60 0x7fe9880c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98dd54640 1 -- 172.21.15.88:0/1124482899 >> v1:172.21.15.88:6789/0 conn(0x7fe98806a3d0 legacy=0x7fe98806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98dd54640 1 -- 172.21.15.88:0/1124482899 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988159de0 con 0x7fe988159a00 2023-11-20T07:01:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98e555640 1 --2- 172.21.15.88:0/1124482899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe98806de60 0x7fe9880c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98cd52640 1 -- 172.21.15.88:0/1124482899 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577931929 0 0) 0x7fe98806a810 con 0x7fe98806a3d0 2023-11-20T07:01:27.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98dd54640 1 --2- 172.21.15.88:0/1124482899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe988159a00 0x7fe988069e90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe984009870 tx=0x7fe98401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed518d5754fd616 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:27.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98cd52640 1 -- 172.21.15.88:0/1124482899 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840aa670 con 0x7fe988159a00 2023-11-20T07:01:27.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98cd52640 1 -- 172.21.15.88:0/1124482899 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9840aa7d0 con 0x7fe988159a00 2023-11-20T07:01:27.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98cd52640 1 -- 172.21.15.88:0/1124482899 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840aab60 con 0x7fe988159a00 2023-11-20T07:01:27.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98ffb8640 1 -- 172.21.15.88:0/1124482899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe988159a00 msgr2=0x7fe988069e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98ffb8640 1 --2- 172.21.15.88:0/1124482899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe988159a00 0x7fe988069e90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe984009870 tx=0x7fe98401c510 comp rx=0 tx=0).stop 2023-11-20T07:01:27.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98ffb8640 1 -- 172.21.15.88:0/1124482899 shutdown_connections 2023-11-20T07:01:27.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98ffb8640 1 --2- 172.21.15.88:0/1124482899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe98806de60 0x7fe9880c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98ffb8640 1 --2- 172.21.15.88:0/1124482899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe988159a00 0x7fe988069e90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.806+0000 7fe98ffb8640 1 -- 172.21.15.88:0/1124482899 >> 172.21.15.88:0/1124482899 conn(0x7fe9880b0d30 msgr2=0x7fe9880ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:27.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98ffb8640 1 -- 172.21.15.88:0/1124482899 shutdown_connections 2023-11-20T07:01:27.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98ffb8640 1 -- 172.21.15.88:0/1124482899 wait complete. 2023-11-20T07:01:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98ffb8640 1 Processor -- start 2023-11-20T07:01:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98ffb8640 1 -- start start 2023-11-20T07:01:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98ffb8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe98806a3d0 0x7fe98815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98ffb8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe98806de60 0x7fe988156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98ffb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe988159a00 0x7fe988156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98ffb8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9881f8f90 con 0x7fe988159a00 2023-11-20T07:01:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98ffb8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98815d270 con 0x7fe98806a3d0 2023-11-20T07:01:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98ffb8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9881f8310 con 0x7fe98806de60 2023-11-20T07:01:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98e555640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe988159a00 0x7fe988156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98e555640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe988159a00 0x7fe988156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37470/0 (socket says 172.21.15.88:37470) 2023-11-20T07:01:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98e555640 1 -- 172.21.15.88:0/2329354188 learned_addr learned my addr 172.21.15.88:0/2329354188 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98dd54640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe98806a3d0 0x7fe98815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98d553640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe98806de60 0x7fe988156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98e555640 1 -- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe98806de60 msgr2=0x7fe988156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98e555640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe98806de60 0x7fe988156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98e555640 1 -- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe98806a3d0 msgr2=0x7fe98815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98e555640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe98806a3d0 0x7fe98815cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98e555640 1 -- 172.21.15.88:0/2329354188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9840094d0 con 0x7fe988159a00 2023-11-20T07:01:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98d553640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe98806de60 0x7fe988156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98e555640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe988159a00 0x7fe988156cb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe980007df0 tx=0x7fe98000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:27.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe97e7fc640 1 -- 172.21.15.88:0/2329354188 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800039a0 con 0x7fe988159a00 2023-11-20T07:01:27.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe97e7fc640 1 -- 172.21.15.88:0/2329354188 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98000f040 con 0x7fe988159a00 2023-11-20T07:01:27.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe97e7fc640 1 -- 172.21.15.88:0/2329354188 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980003d40 con 0x7fe988159a00 2023-11-20T07:01:27.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.810+0000 7fe98ffb8640 1 -- 172.21.15.88:0/2329354188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9881f85f0 con 0x7fe988159a00 2023-11-20T07:01:27.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.814+0000 7fe98ffb8640 1 -- 172.21.15.88:0/2329354188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9881f8bb0 con 0x7fe988159a00 2023-11-20T07:01:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.814+0000 7fe98ffb8640 1 -- 172.21.15.88:0/2329354188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9881f90d0 con 0x7fe988159a00 2023-11-20T07:01:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.814+0000 7fe97e7fc640 1 -- 172.21.15.88:0/2329354188 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe980004030 con 0x7fe988159a00 2023-11-20T07:01:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.814+0000 7fe97e7fc640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe96c0664a0 0x7fe96c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.814+0000 7fe97e7fc640 1 -- 172.21.15.88:0/2329354188 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe980084470 con 0x7fe988159a00 2023-11-20T07:01:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.814+0000 7fe98dd54640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe96c0664a0 0x7fe96c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.814+0000 7fe98dd54640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe96c0664a0 0x7fe96c068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9840ae000 tx=0x7fe9840a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:27.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.818+0000 7fe97e7fc640 1 -- 172.21.15.88:0/2329354188 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe9881f90d0 con 0x7fe988159a00 2023-11-20T07:01:27.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 -- 172.21.15.88:0/2329354188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9881f90d0 con 0x7fe988159a00 2023-11-20T07:01:27.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe97e7fc640 1 -- 172.21.15.88:0/2329354188 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fe9881f90d0 con 0x7fe988159a00 2023-11-20T07:01:27.998 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:27.998 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/1097293366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1097293366},{"type":"v1","addr":"172.21.15.175:6836","nonce":1097293366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/438678526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":438678526},{"type":"v1","addr":"172.21.15.88:6834","nonce":438678526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1083863684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":1083863684},{"type":"v1","addr":"172.21.15.88:6835","nonce":1083863684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:00:54.012155+0000","modified":"2023-11-20T07:01:16.901950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3413113678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3413113678},{"type":"v1","addr":"172.21.15.175:6837","nonce":3413113678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T07:01:27.999 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-11-20T07:01:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 -- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe96c0664a0 msgr2=0x7fe96c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe96c0664a0 0x7fe96c068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9840ae000 tx=0x7fe9840a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 -- 172.21.15.88:0/2329354188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe988159a00 msgr2=0x7fe988156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe988159a00 0x7fe988156cb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe980007df0 tx=0x7fe98000d4a0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 -- 172.21.15.88:0/2329354188 shutdown_connections 2023-11-20T07:01:28.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe96c0664a0 0x7fe96c068960 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe98806de60 0x7fe988156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe988159a00 0x7fe988156cb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 --2- 172.21.15.88:0/2329354188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe98806a3d0 0x7fe98815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 -- 172.21.15.88:0/2329354188 >> 172.21.15.88:0/2329354188 conn(0x7fe9880b0d30 msgr2=0x7fe988158980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:28.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 -- 172.21.15.88:0/2329354188 shutdown_connections 2023-11-20T07:01:28.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:27.998+0000 7fe98ffb8640 1 -- 172.21.15.88:0/2329354188 wait complete. 2023-11-20T07:01:28.019 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:28.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f320759e640 1 Processor -- start 2023-11-20T07:01:28.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f320759e640 1 -- start start 2023-11-20T07:01:28.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f320759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320815c980 0x7f320806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:28.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f320759e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f320815cd60 0x7f32080b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:28.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f320759e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32080d3510 con 0x7f32080d0d80 2023-11-20T07:01:28.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f320759e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32080cd2b0 con 0x7f320815cd60 2023-11-20T07:01:28.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f320759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32080d2f50 con 0x7f320815c980 2023-11-20T07:01:28.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f3205d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f320815cd60 0x7f32080b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:28.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f3205d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f320815cd60 0x7f32080b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37482/0 (socket says 172.21.15.88:37482) 2023-11-20T07:01:28.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f3205d9b640 1 -- 172.21.15.88:0/166213377 learned_addr learned my addr 172.21.15.88:0/166213377 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:28.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f320659c640 1 --2- 172.21.15.88:0/166213377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320815c980 0x7f320806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:28.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f3205d9b640 1 -- 172.21.15.88:0/166213377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320815c980 msgr2=0x7f320806af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:28.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f3205d9b640 1 --2- 172.21.15.88:0/166213377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320815c980 0x7f320806af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f3205d9b640 1 -- 172.21.15.88:0/166213377 >> v1:172.21.15.175:6789/0 conn(0x7f32080d0d80 legacy=0x7f32080cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.158+0000 7f3205d9b640 1 -- 172.21.15.88:0/166213377 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32080d3230 con 0x7f320815cd60 2023-11-20T07:01:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f3205d9b640 1 --2- 172.21.15.88:0/166213377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f320815cd60 0x7f32080b1b90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009870 tx=0x7f31fc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b17e251cdb8219e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f320559a640 1 -- 172.21.15.88:0/166213377 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0ab650 con 0x7f320815cd60 2023-11-20T07:01:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f320559a640 1 -- 172.21.15.88:0/166213377 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc0ab7b0 con 0x7f320815cd60 2023-11-20T07:01:28.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f320559a640 1 -- 172.21.15.88:0/166213377 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0abb40 con 0x7f320815cd60 2023-11-20T07:01:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f320759e640 1 -- 172.21.15.88:0/166213377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f320815cd60 msgr2=0x7f32080b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f320759e640 1 --2- 172.21.15.88:0/166213377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f320815cd60 0x7f32080b1b90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009870 tx=0x7f31fc01c540 comp rx=0 tx=0).stop 2023-11-20T07:01:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f320759e640 1 -- 172.21.15.88:0/166213377 shutdown_connections 2023-11-20T07:01:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f320759e640 1 --2- 172.21.15.88:0/166213377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f320815cd60 0x7f32080b1b90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f320759e640 1 --2- 172.21.15.88:0/166213377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320815c980 0x7f320806af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f320759e640 1 -- 172.21.15.88:0/166213377 >> 172.21.15.88:0/166213377 conn(0x7f320809ba80 msgr2=0x7f32080d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f320759e640 1 -- 172.21.15.88:0/166213377 shutdown_connections 2023-11-20T07:01:28.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f320759e640 1 -- 172.21.15.88:0/166213377 wait complete. 2023-11-20T07:01:28.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.162+0000 7f320759e640 1 Processor -- start 2023-11-20T07:01:28.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f320759e640 1 -- start start 2023-11-20T07:01:28.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f320759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32080d0d80 0x7f32080b8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:28.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f320759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320815c980 0x7f32080cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:28.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f320759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f320815cd60 0x7f32080cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:28.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f320759e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32081f8db0 con 0x7f320815cd60 2023-11-20T07:01:28.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f320759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32081f9c10 con 0x7f32080d0d80 2023-11-20T07:01:28.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f320759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32081f9000 con 0x7f320815c980 2023-11-20T07:01:28.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f3206d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f320815cd60 0x7f32080cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:28.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f3206d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f320815cd60 0x7f32080cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37496/0 (socket says 172.21.15.88:37496) 2023-11-20T07:01:28.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f3206d9d640 1 -- 172.21.15.88:0/3656595602 learned_addr learned my addr 172.21.15.88:0/3656595602 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f320659c640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32080d0d80 0x7f32080b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f3205d9b640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320815c980 0x7f32080cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f3206d9d640 1 -- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320815c980 msgr2=0x7f32080cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f3206d9d640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320815c980 0x7f32080cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f3206d9d640 1 -- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32080d0d80 msgr2=0x7f32080b8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f3206d9d640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32080d0d80 0x7f32080b8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f3206d9d640 1 -- 172.21.15.88:0/3656595602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc0094d0 con 0x7f320815cd60 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f3206d9d640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f320815cd60 0x7f32080cc570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f320000c770 tx=0x7f320000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f31f6ffd640 1 -- 172.21.15.88:0/3656595602 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200003b80 con 0x7f320815cd60 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f31f6ffd640 1 -- 172.21.15.88:0/3656595602 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3200003ce0 con 0x7f320815cd60 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f31f6ffd640 1 -- 172.21.15.88:0/3656595602 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320000aa90 con 0x7f320815cd60 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f320759e640 1 -- 172.21.15.88:0/3656595602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32080d1720 con 0x7f320815cd60 2023-11-20T07:01:28.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f320759e640 1 -- 172.21.15.88:0/3656595602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32081f95c0 con 0x7f320815cd60 2023-11-20T07:01:28.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.166+0000 7f320759e640 1 -- 172.21.15.88:0/3656595602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320804e9c0 con 0x7f320815cd60 2023-11-20T07:01:28.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.170+0000 7f31f6ffd640 1 -- 172.21.15.88:0/3656595602 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f320000abf0 con 0x7f320815cd60 2023-11-20T07:01:28.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.170+0000 7f31f6ffd640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31e80664a0 0x7f31e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:28.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.170+0000 7f31f6ffd640 1 -- 172.21.15.88:0/3656595602 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3200083c40 con 0x7f320815cd60 2023-11-20T07:01:28.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.170+0000 7f320659c640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31e80664a0 0x7f31e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:28.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.170+0000 7f320659c640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31e80664a0 0x7f31e8068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009b40 tx=0x7f31f8006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:28.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.174+0000 7f31f6ffd640 1 -- 172.21.15.88:0/3656595602 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3200050f10 con 0x7f320815cd60 2023-11-20T07:01:28.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.326+0000 7f320759e640 1 -- 172.21.15.88:0/3656595602 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32080cff00 con 0x7f320815cd60 2023-11-20T07:01:28.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.326+0000 7f31f6ffd640 1 -- 172.21.15.88:0/3656595602 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f3200054530 con 0x7f320815cd60 2023-11-20T07:01:28.327 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:28.327 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:00:58.690500+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:28.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.330+0000 7f320759e640 1 -- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31e80664a0 msgr2=0x7f31e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.330+0000 7f320759e640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31e80664a0 0x7f31e8068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009b40 tx=0x7f31f8006f90 comp rx=0 tx=0).stop 2023-11-20T07:01:28.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.330+0000 7f320759e640 1 -- 172.21.15.88:0/3656595602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f320815cd60 msgr2=0x7f32080cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.330+0000 7f320759e640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f320815cd60 0x7f32080cc570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f320000c770 tx=0x7f320000cc30 comp rx=0 tx=0).stop 2023-11-20T07:01:28.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.330+0000 7f320759e640 1 -- 172.21.15.88:0/3656595602 shutdown_connections 2023-11-20T07:01:28.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.330+0000 7f320759e640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31e80664a0 0x7f31e8068960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.330+0000 7f320759e640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320815c980 0x7f32080cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.330+0000 7f320759e640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f320815cd60 0x7f32080cc570 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.330+0000 7f320759e640 1 --2- 172.21.15.88:0/3656595602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32080d0d80 0x7f32080b8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.330+0000 7f320759e640 1 -- 172.21.15.88:0/3656595602 >> 172.21.15.88:0/3656595602 conn(0x7f320809ba80 msgr2=0x7f32080b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:28.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.330+0000 7f320759e640 1 -- 172.21.15.88:0/3656595602 shutdown_connections 2023-11-20T07:01:28.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.330+0000 7f320759e640 1 -- 172.21.15.88:0/3656595602 wait complete. 2023-11-20T07:01:28.348 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:01:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c15e09640 1 Processor -- start 2023-11-20T07:01:28.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c15e09640 1 -- start start 2023-11-20T07:01:28.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c15e09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c100d15d0 0x7f5c100cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:28.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c15e09640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5c100d3010 0x7f5c100c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:28.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c15e09640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c100ce770 con 0x7f5c1015cb90 2023-11-20T07:01:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c15e09640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c100d0600 con 0x7f5c100d3010 2023-11-20T07:01:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c15e09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100c6450 con 0x7f5c100d15d0 2023-11-20T07:01:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c0ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5c100d3010 0x7f5c100c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c0ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5c100d3010 0x7f5c100c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37498/0 (socket says 172.21.15.88:37498) 2023-11-20T07:01:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c0ffff640 1 -- 172.21.15.88:0/1746662951 learned_addr learned my addr 172.21.15.88:0/1746662951 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c07fff640 1 --2- 172.21.15.88:0/1746662951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c100d15d0 0x7f5c100cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c0ffff640 1 -- 172.21.15.88:0/1746662951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c100d15d0 msgr2=0x7f5c100cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c0ffff640 1 --2- 172.21.15.88:0/1746662951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c100d15d0 0x7f5c100cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c0ffff640 1 -- 172.21.15.88:0/1746662951 >> v1:172.21.15.175:6789/0 conn(0x7f5c1015cb90 legacy=0x7f5c100d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.486+0000 7f5c0ffff640 1 -- 172.21.15.88:0/1746662951 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100d08a0 con 0x7f5c100d3010 2023-11-20T07:01:28.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.490+0000 7f5c0ffff640 1 --2- 172.21.15.88:0/1746662951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c100d3010 0x7f5c100c6c10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009e50 tx=0x7f5c0801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4890aa3b016d66 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:28.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.490+0000 7f5c0effd640 1 -- 172.21.15.88:0/1746662951 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080a5810 con 0x7f5c100d3010 2023-11-20T07:01:28.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.490+0000 7f5c0effd640 1 -- 172.21.15.88:0/1746662951 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c080a5970 con 0x7f5c100d3010 2023-11-20T07:01:28.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.490+0000 7f5c0effd640 1 -- 172.21.15.88:0/1746662951 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080a5d00 con 0x7f5c100d3010 2023-11-20T07:01:28.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.490+0000 7f5c15e09640 1 -- 172.21.15.88:0/1746662951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c100d3010 msgr2=0x7f5c100c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.490+0000 7f5c15e09640 1 --2- 172.21.15.88:0/1746662951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c100d3010 0x7f5c100c6c10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009e50 tx=0x7f5c0801c950 comp rx=0 tx=0).stop 2023-11-20T07:01:28.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.490+0000 7f5c15e09640 1 -- 172.21.15.88:0/1746662951 shutdown_connections 2023-11-20T07:01:28.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.490+0000 7f5c15e09640 1 --2- 172.21.15.88:0/1746662951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c100d3010 0x7f5c100c6c10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.490+0000 7f5c15e09640 1 --2- 172.21.15.88:0/1746662951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c100d15d0 0x7f5c100cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.490+0000 7f5c15e09640 1 -- 172.21.15.88:0/1746662951 >> 172.21.15.88:0/1746662951 conn(0x7f5c1009bc50 msgr2=0x7f5c100d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:28.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.490+0000 7f5c15e09640 1 -- 172.21.15.88:0/1746662951 shutdown_connections 2023-11-20T07:01:28.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.490+0000 7f5c15e09640 1 -- 172.21.15.88:0/1746662951 wait complete. 2023-11-20T07:01:28.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c15e09640 1 Processor -- start 2023-11-20T07:01:28.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c15e09640 1 -- start start 2023-11-20T07:01:28.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c15e09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c100d15d0 0x7f5c1014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:28.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c15e09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c100d3010 0x7f5c100b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:28.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c15e09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c1015cb90 0x7f5c101574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:28.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c15e09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1014ee40 con 0x7f5c1015cb90 2023-11-20T07:01:28.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c15e09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100b6b10 con 0x7f5c100d15d0 2023-11-20T07:01:28.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c15e09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100caaa0 con 0x7f5c100d3010 2023-11-20T07:01:28.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c1015cb90 0x7f5c101574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:28.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c1015cb90 0x7f5c101574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37506/0 (socket says 172.21.15.88:37506) 2023-11-20T07:01:28.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0ffff640 1 -- 172.21.15.88:0/2364115824 learned_addr learned my addr 172.21.15.88:0/2364115824 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:28.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0f7fe640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c100d15d0 0x7f5c1014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:28.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c07fff640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c100d3010 0x7f5c100b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:28.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0ffff640 1 -- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c100d3010 msgr2=0x7f5c100b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0ffff640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c100d3010 0x7f5c100b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0ffff640 1 -- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c100d15d0 msgr2=0x7f5c1014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0ffff640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c100d15d0 0x7f5c1014e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0ffff640 1 -- 172.21.15.88:0/2364115824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08009b30 con 0x7f5c1015cb90 2023-11-20T07:01:28.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0ffff640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c1015cb90 0x7f5c101574a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5c080af040 tx=0x7f5c080196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:28.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0cff9640 1 -- 172.21.15.88:0/2364115824 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080b8670 con 0x7f5c1015cb90 2023-11-20T07:01:28.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0cff9640 1 -- 172.21.15.88:0/2364115824 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c080b87f0 con 0x7f5c1015cb90 2023-11-20T07:01:28.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c0cff9640 1 -- 172.21.15.88:0/2364115824 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080b8ba0 con 0x7f5c1015cb90 2023-11-20T07:01:28.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c15e09640 1 -- 172.21.15.88:0/2364115824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c100b5f00 con 0x7f5c1015cb90 2023-11-20T07:01:28.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c15e09640 1 -- 172.21.15.88:0/2364115824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c100b64c0 con 0x7f5c1015cb90 2023-11-20T07:01:28.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.494+0000 7f5c15e09640 1 -- 172.21.15.88:0/2364115824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c10074010 con 0x7f5c1015cb90 2023-11-20T07:01:28.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.498+0000 7f5c0cff9640 1 -- 172.21.15.88:0/2364115824 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5c080b8d00 con 0x7f5c1015cb90 2023-11-20T07:01:28.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.498+0000 7f5c0cff9640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bf00664a0 0x7f5bf0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:28.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.498+0000 7f5c0cff9640 1 -- 172.21.15.88:0/2364115824 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5c0811f580 con 0x7f5c1015cb90 2023-11-20T07:01:28.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.498+0000 7f5c0f7fe640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bf00664a0 0x7f5bf0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:28.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.498+0000 7f5c0f7fe640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bf00664a0 0x7f5bf0068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5c1015c590 tx=0x7f5c00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:28.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.502+0000 7f5c0cff9640 1 -- 172.21.15.88:0/2364115824 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5c080ec720 con 0x7f5c1015cb90 2023-11-20T07:01:28.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 -- 172.21.15.88:0/2364115824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c100cac30 con 0x7f5c1015cb90 2023-11-20T07:01:28.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c0cff9640 1 -- 172.21.15.88:0/2364115824 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f5c080efd40 con 0x7f5c1015cb90 2023-11-20T07:01:28.682 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:28.682 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/1097293366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1097293366},{"type":"v1","addr":"172.21.15.175:6836","nonce":1097293366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/438678526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":438678526},{"type":"v1","addr":"172.21.15.88:6834","nonce":438678526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1083863684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":1083863684},{"type":"v1","addr":"172.21.15.88:6835","nonce":1083863684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:00:54.012155+0000","modified":"2023-11-20T07:01:16.901950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3413113678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3413113678},{"type":"v1","addr":"172.21.15.175:6837","nonce":3413113678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T07:01:28.683 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-11-20T07:01:28.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 -- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bf00664a0 msgr2=0x7f5bf0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bf00664a0 0x7f5bf0068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5c1015c590 tx=0x7f5c00009040 comp rx=0 tx=0).stop 2023-11-20T07:01:28.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 -- 172.21.15.88:0/2364115824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c1015cb90 msgr2=0x7f5c101574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:28.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c1015cb90 0x7f5c101574a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5c080af040 tx=0x7f5c080196f0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 -- 172.21.15.88:0/2364115824 shutdown_connections 2023-11-20T07:01:28.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bf00664a0 0x7f5bf0068960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c100d3010 0x7f5c100b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c1015cb90 0x7f5c101574a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 --2- 172.21.15.88:0/2364115824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c100d15d0 0x7f5c1014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:28.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 -- 172.21.15.88:0/2364115824 >> 172.21.15.88:0/2364115824 conn(0x7f5c1009bc50 msgr2=0x7f5c100cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:28.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 -- 172.21.15.88:0/2364115824 shutdown_connections 2023-11-20T07:01:28.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:28.682+0000 7f5c15e09640 1 -- 172.21.15.88:0/2364115824 wait complete. 2023-11-20T07:01:29.106 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-20T07:00:54.012155+0000', 'modified': '2023-11-20T07:01:16.901950+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6837/3413113678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 3413113678}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 3413113678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-20T07:01:29.106 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-20T07:01:29.106 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-20T07:01:29.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d9e09640 1 Processor -- start 2023-11-20T07:01:29.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d9e09640 1 -- start start 2023-11-20T07:01:29.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d9e09640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02d415ca70 0x7f02d40d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d9e09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d40cf7a0 0x7f02d40c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d9e09640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d40c65f0 con 0x7f02d40d3550 2023-11-20T07:01:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d9e09640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d40ce820 con 0x7f02d415ca70 2023-11-20T07:01:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d9e09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d40cdf80 con 0x7f02d40cf7a0 2023-11-20T07:01:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d37fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02d415ca70 0x7f02d40d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d40cf7a0 0x7f02d40c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d37fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02d415ca70 0x7f02d40d3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:42192/0 (socket says 172.21.15.88:42192) 2023-11-20T07:01:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d37fe640 1 -- 172.21.15.88:0/2030893224 learned_addr learned my addr 172.21.15.88:0/2030893224 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d37fe640 1 -- 172.21.15.88:0/2030893224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d40cf7a0 msgr2=0x7f02d40c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d37fe640 1 --2- 172.21.15.88:0/2030893224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d40cf7a0 0x7f02d40c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d37fe640 1 -- 172.21.15.88:0/2030893224 >> v1:172.21.15.175:6789/0 conn(0x7f02d40d3550 legacy=0x7f02d40cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d37fe640 1 -- 172.21.15.88:0/2030893224 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d40ce260 con 0x7f02d415ca70 2023-11-20T07:01:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d2ffd640 1 -- 172.21.15.88:0/2030893224 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120278799 0 0) 0x7f02d40c65f0 con 0x7f02d40d3550 2023-11-20T07:01:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.246+0000 7f02d3fff640 1 --2- 172.21.15.88:0/2030893224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d40cf7a0 0x7f02d40c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.250+0000 7f02d37fe640 1 --2- 172.21.15.88:0/2030893224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d415ca70 0x7f02d40d3010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f02c4006fd0 tx=0x7f02c401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2de5611a24ff11e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.250+0000 7f02d2ffd640 1 -- 172.21.15.88:0/2030893224 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40ab650 con 0x7f02d415ca70 2023-11-20T07:01:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.250+0000 7f02d2ffd640 1 -- 172.21.15.88:0/2030893224 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c40ab7b0 con 0x7f02d415ca70 2023-11-20T07:01:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.250+0000 7f02d2ffd640 1 -- 172.21.15.88:0/2030893224 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40abb40 con 0x7f02d415ca70 2023-11-20T07:01:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.250+0000 7f02d9e09640 1 -- 172.21.15.88:0/2030893224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d415ca70 msgr2=0x7f02d40d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.250+0000 7f02d9e09640 1 --2- 172.21.15.88:0/2030893224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d415ca70 0x7f02d40d3010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f02c4006fd0 tx=0x7f02c401c4f0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.250+0000 7f02d9e09640 1 -- 172.21.15.88:0/2030893224 shutdown_connections 2023-11-20T07:01:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.250+0000 7f02d9e09640 1 --2- 172.21.15.88:0/2030893224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d40cf7a0 0x7f02d40c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.250+0000 7f02d9e09640 1 --2- 172.21.15.88:0/2030893224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d415ca70 0x7f02d40d3010 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.250+0000 7f02d9e09640 1 -- 172.21.15.88:0/2030893224 >> 172.21.15.88:0/2030893224 conn(0x7f02d409bc50 msgr2=0x7f02d40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.250+0000 7f02d9e09640 1 -- 172.21.15.88:0/2030893224 shutdown_connections 2023-11-20T07:01:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.250+0000 7f02d9e09640 1 -- 172.21.15.88:0/2030893224 wait complete. 2023-11-20T07:01:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d9e09640 1 Processor -- start 2023-11-20T07:01:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d9e09640 1 -- start start 2023-11-20T07:01:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d9e09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d40cf7a0 0x7f02d4153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d9e09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d40d3550 0x7f02d414e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d9e09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02d415ca70 0x7f02d4155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d9e09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d41542d0 con 0x7f02d415ca70 2023-11-20T07:01:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d9e09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d41545b0 con 0x7f02d40cf7a0 2023-11-20T07:01:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d9e09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d4154890 con 0x7f02d40d3550 2023-11-20T07:01:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02d415ca70 0x7f02d4155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02d415ca70 0x7f02d4155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37516/0 (socket says 172.21.15.88:37516) 2023-11-20T07:01:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d3fff640 1 -- 172.21.15.88:0/661804142 learned_addr learned my addr 172.21.15.88:0/661804142 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02cbfff640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d40d3550 0x7f02d414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d37fe640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d40cf7a0 0x7f02d4153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d3fff640 1 -- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d40d3550 msgr2=0x7f02d414e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d3fff640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d40d3550 0x7f02d414e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d3fff640 1 -- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d40cf7a0 msgr2=0x7f02d4153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d3fff640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d40cf7a0 0x7f02d4153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d3fff640 1 -- 172.21.15.88:0/661804142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc009a70 con 0x7f02d415ca70 2023-11-20T07:01:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d3fff640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02d415ca70 0x7f02d4155370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00efc0 tx=0x7f02cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d0ff9640 1 -- 172.21.15.88:0/661804142 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc014480 con 0x7f02d415ca70 2023-11-20T07:01:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d0ff9640 1 -- 172.21.15.88:0/661804142 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc00f040 con 0x7f02d415ca70 2023-11-20T07:01:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d9e09640 1 -- 172.21.15.88:0/661804142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c4009480 con 0x7f02d415ca70 2023-11-20T07:01:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d0ff9640 1 -- 172.21.15.88:0/661804142 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc014840 con 0x7f02d415ca70 2023-11-20T07:01:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.254+0000 7f02d9e09640 1 -- 172.21.15.88:0/661804142 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d4154e50 con 0x7f02d415ca70 2023-11-20T07:01:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.258+0000 7f02d0ff9640 1 -- 172.21.15.88:0/661804142 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f02cc0149a0 con 0x7f02d415ca70 2023-11-20T07:01:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.258+0000 7f02d0ff9640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f02b40664d0 0x7f02b4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.258+0000 7f02d0ff9640 1 -- 172.21.15.88:0/661804142 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02cc084ff0 con 0x7f02d415ca70 2023-11-20T07:01:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.258+0000 7f02d37fe640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f02b40664d0 0x7f02b4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.258+0000 7f02dd195000 1 Processor -- start 2023-11-20T07:01:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.258+0000 7f02dd195000 1 -- start start 2023-11-20T07:01:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.258+0000 7f02d37fe640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f02b40664d0 0x7f02b4068990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02c40af000 tx=0x7f02c40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a78c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a79160 0x564ea1a2e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a2ebf0 0x564ea1a2efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea1823cc0 con 0x564ea1a78840 2023-11-20T07:01:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea18868e0 con 0x564ea1a79160 2023-11-20T07:01:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ea1883e10 con 0x564ea1a2ebf0 2023-11-20T07:01:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02d37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a78c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02d37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a78c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37530/0 (socket says 172.21.15.88:37530) 2023-11-20T07:01:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02d37fe640 1 -- 172.21.15.88:0/161445220 learned_addr learned my addr 172.21.15.88:0/161445220 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02cbfff640 1 --2- 172.21.15.88:0/161445220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a79160 0x564ea1a2e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02d3fff640 1 --2- 172.21.15.88:0/161445220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a2ebf0 0x564ea1a2efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02d37fe640 1 -- 172.21.15.88:0/161445220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a2ebf0 msgr2=0x564ea1a2efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02d37fe640 1 --2- 172.21.15.88:0/161445220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a2ebf0 0x564ea1a2efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02d37fe640 1 -- 172.21.15.88:0/161445220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a79160 msgr2=0x564ea1a2e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02d37fe640 1 --2- 172.21.15.88:0/161445220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a79160 0x564ea1a2e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02d37fe640 1 -- 172.21.15.88:0/161445220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ea1578890 con 0x564ea1a78840 2023-11-20T07:01:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02d37fe640 1 --2- 172.21.15.88:0/161445220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a78c20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f02c40ad040 tx=0x7f02c4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdaaaeb02abea6db server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02c97fa640 1 -- 172.21.15.88:0/161445220 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40abbe0 con 0x564ea1a78840 2023-11-20T07:01:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02c97fa640 1 -- 172.21.15.88:0/161445220 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c40c4070 con 0x564ea1a78840 2023-11-20T07:01:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02c97fa640 1 -- 172.21.15.88:0/161445220 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4003620 con 0x564ea1a78840 2023-11-20T07:01:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 -- 172.21.15.88:0/161445220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 msgr2=0x564ea1a78c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 --2- 172.21.15.88:0/161445220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a78c20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f02c40ad040 tx=0x7f02c4004740 comp rx=0 tx=0).stop 2023-11-20T07:01:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 -- 172.21.15.88:0/161445220 shutdown_connections 2023-11-20T07:01:29.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 --2- 172.21.15.88:0/161445220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a2ebf0 0x564ea1a2efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 --2- 172.21.15.88:0/161445220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a79160 0x564ea1a2e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 --2- 172.21.15.88:0/161445220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a78c20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 -- 172.21.15.88:0/161445220 >> 172.21.15.88:0/161445220 conn(0x564ea1a25f60 msgr2=0x564ea1a2cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 -- 172.21.15.88:0/161445220 shutdown_connections 2023-11-20T07:01:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 -- 172.21.15.88:0/161445220 wait complete. 2023-11-20T07:01:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 -- start start 2023-11-20T07:01:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.262+0000 7f02dd195000 1 Processor -- start 2023-11-20T07:01:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a2ebf0 0x564ea1a78290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a33d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a79160 0x564ea1a342c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea187f700 con 0x564ea1a78840 2023-11-20T07:01:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea183ed10 con 0x564ea1a2ebf0 2023-11-20T07:01:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ea183e9b0 con 0x564ea1a79160 2023-11-20T07:01:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 10 client.0 _ll_register_callbacks cb 0x564ea1a1a330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-20T07:01:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02cbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a33d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02cbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a33d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37536/0 (socket says 172.21.15.88:37536) 2023-11-20T07:01:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02cbfff640 1 -- 172.21.15.88:0/3644110987 learned_addr learned my addr 172.21.15.88:0/3644110987 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02d37fe640 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a2ebf0 0x564ea1a78290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02d3fff640 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a79160 0x564ea1a342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02cbfff640 1 -- 172.21.15.88:0/3644110987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a79160 msgr2=0x564ea1a342c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02cbfff640 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a79160 0x564ea1a342c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02cbfff640 1 -- 172.21.15.88:0/3644110987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a2ebf0 msgr2=0x564ea1a78290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:29.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02cbfff640 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a2ebf0 0x564ea1a78290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02cbfff640 1 -- 172.21.15.88:0/3644110987 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d40ce260 con 0x564ea1a78840 2023-11-20T07:01:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02cbfff640 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a33d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02bc012570 tx=0x7f02bc012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94faac07d68036ac server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-11-20T07:01:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02b27fc640 1 -- 172.21.15.88:0/3644110987 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc01a030 con 0x564ea1a78840 2023-11-20T07:01:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02b27fc640 1 -- 172.21.15.88:0/3644110987 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02bc01b070 con 0x564ea1a78840 2023-11-20T07:01:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 1 -- 172.21.15.88:0/3644110987 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ea1833370 con 0x564ea1a78840 2023-11-20T07:01:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02b27fc640 1 -- 172.21.15.88:0/3644110987 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02bc005320 con 0x564ea1a78840 2023-11-20T07:01:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 10 client.4830 fetch_fsmap learned FSMap version 9 2023-11-20T07:01:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 1 -- 172.21.15.88:0/3644110987 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x564ea1841460 con 0x564ea1a78840 2023-11-20T07:01:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02b27fc640 1 -- 172.21.15.88:0/3644110987 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc025020 con 0x564ea1a78840 2023-11-20T07:01:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02b27fc640 1 -- 172.21.15.88:0/3644110987 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f02bc007030 con 0x564ea1a78840 2023-11-20T07:01:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 10 client.4830 fetch_fsmap finished waiting for FSMap version 9 2023-11-20T07:01:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 10 client.4830 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-20T07:01:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 20 client.4830 populate_metadata read hostname 'smithi088' 2023-11-20T07:01:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x564ea1a3b0b0 0x564ea1a8ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 4 client.4830 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-20T07:01:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02dd195000 1 -- 172.21.15.88:0/3644110987 --> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ea18192d0 con 0x564ea1a3b0b0 2023-11-20T07:01:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02d37fe640 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x564ea1a3b0b0 0x564ea1a8ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02d37fe640 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x564ea1a3b0b0 0x564ea1a8ab00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdee65f5e5192b1f server_cookie=25d3f02d632b1e1b in_seq=0 out_seq=0 2023-11-20T07:01:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.266+0000 7f02b27fc640 10 client.4830 ms_handle_connect on v2:172.21.15.175:6835/3413113678 2023-11-20T07:01:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02b27fc640 1 -- 172.21.15.88:0/3644110987 <== mds.0 v2:172.21.15.175:6835/3413113678 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564ea18192d0 con 0x564ea1a3b0b0 2023-11-20T07:01:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02b27fc640 10 client.4830 handle_command_reply: tid=0 2023-11-20T07:01:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02dd195000 1 client.4830 shutdown 2023-11-20T07:01:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02dd195000 1 -- 172.21.15.88:0/3644110987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 msgr2=0x564ea1a33d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02dd195000 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a33d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02bc012570 tx=0x7f02bc012a30 comp rx=0 tx=0).stop 2023-11-20T07:01:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02dd195000 1 -- 172.21.15.88:0/3644110987 shutdown_connections 2023-11-20T07:01:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02dd195000 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x564ea1a3b0b0 0x564ea1a8ab00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02dd195000 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a79160 0x564ea1a342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02dd195000 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a33d80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02dd195000 1 --2- 172.21.15.88:0/3644110987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a2ebf0 0x564ea1a78290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02dd195000 1 -- 172.21.15.88:0/3644110987 >> 172.21.15.88:0/3644110987 conn(0x564ea1a25f60 msgr2=0x564ea1a2d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02b27fc640 0 client.4830 ms_handle_reset on v2:172.21.15.175:6835/3413113678 2023-11-20T07:01:29.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02dd195000 1 -- 172.21.15.88:0/3644110987 shutdown_connections 2023-11-20T07:01:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02dd195000 1 -- 172.21.15.88:0/3644110987 wait complete. 2023-11-20T07:01:29.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.270+0000 7f02dd195000 20 client.4830 trim_cache size 0 max 16384 2023-11-20T07:01:29.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.282+0000 7f02dd195000 1 Processor -- start 2023-11-20T07:01:29.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.282+0000 7f02dd195000 1 -- start start 2023-11-20T07:01:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a2ebf0 0x564ea1a8bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a8c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a79160 0x564ea1a73270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea1539940 con 0x564ea1a78840 2023-11-20T07:01:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea1879a00 con 0x564ea1a2ebf0 2023-11-20T07:01:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ea187e590 con 0x564ea1a79160 2023-11-20T07:01:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02cbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a8c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02cbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a8c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37538/0 (socket says 172.21.15.88:37538) 2023-11-20T07:01:29.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02cbfff640 1 -- 172.21.15.88:0/1960574426 learned_addr learned my addr 172.21.15.88:0/1960574426 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:29.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02cbfff640 1 -- 172.21.15.88:0/1960574426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a79160 msgr2=0x564ea1a73270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:29.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02d3fff640 1 --2- 172.21.15.88:0/1960574426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a79160 0x564ea1a73270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02d37fe640 1 --2- 172.21.15.88:0/1960574426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a2ebf0 0x564ea1a8bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02cbfff640 1 --2- 172.21.15.88:0/1960574426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a79160 0x564ea1a73270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02cbfff640 1 -- 172.21.15.88:0/1960574426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a2ebf0 msgr2=0x564ea1a8bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:29.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02cbfff640 1 --2- 172.21.15.88:0/1960574426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a2ebf0 0x564ea1a8bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02cbfff640 1 -- 172.21.15.88:0/1960574426 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ea1827760 con 0x564ea1a78840 2023-11-20T07:01:29.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02d3fff640 1 --2- 172.21.15.88:0/1960574426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a79160 0x564ea1a73270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:29.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02d37fe640 1 --2- 172.21.15.88:0/1960574426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a2ebf0 0x564ea1a8bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:29.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02cbfff640 1 --2- 172.21.15.88:0/1960574426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a8c050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009010 tx=0x7f02bc00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853c03fe396675a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02c9ffb640 1 -- 172.21.15.88:0/1960574426 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc01a070 con 0x564ea1a78840 2023-11-20T07:01:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02c9ffb640 1 -- 172.21.15.88:0/1960574426 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc025070 con 0x564ea1a78840 2023-11-20T07:01:29.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02c9ffb640 1 -- 172.21.15.88:0/1960574426 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc001b90 con 0x564ea1a78840 2023-11-20T07:01:29.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 -- 172.21.15.88:0/1960574426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 msgr2=0x564ea1a8c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 --2- 172.21.15.88:0/1960574426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a8c050 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009010 tx=0x7f02bc00c000 comp rx=0 tx=0).stop 2023-11-20T07:01:29.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 -- 172.21.15.88:0/1960574426 shutdown_connections 2023-11-20T07:01:29.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 --2- 172.21.15.88:0/1960574426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a79160 0x564ea1a73270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 --2- 172.21.15.88:0/1960574426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a78840 0x564ea1a8c050 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 --2- 172.21.15.88:0/1960574426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a2ebf0 0x564ea1a8bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 -- 172.21.15.88:0/1960574426 >> 172.21.15.88:0/1960574426 conn(0x564ea1a25f60 msgr2=0x564ea1a85e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 -- 172.21.15.88:0/1960574426 shutdown_connections 2023-11-20T07:01:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 -- 172.21.15.88:0/1960574426 wait complete. 2023-11-20T07:01:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 -- start start 2023-11-20T07:01:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.286+0000 7f02dd195000 1 Processor -- start 2023-11-20T07:01:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a2ebf0 0x564ea1ad72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a78840 0x564ea1ad7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a79160 0x564ea1a75f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea18c0b40 con 0x564ea1a79160 2023-11-20T07:01:29.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ea18559d0 con 0x564ea1a78840 2023-11-20T07:01:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ea1a322e0 con 0x564ea1a2ebf0 2023-11-20T07:01:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 10 client.0 _ll_register_callbacks cb 0x7f02c40096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-20T07:01:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a79160 0x564ea1a75f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a79160 0x564ea1a75f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37542/0 (socket says 172.21.15.88:37542) 2023-11-20T07:01:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02d3fff640 1 -- 172.21.15.88:0/620663816 learned_addr learned my addr 172.21.15.88:0/620663816 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02cbfff640 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a78840 0x564ea1ad7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02d37fe640 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a2ebf0 0x564ea1ad72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02d3fff640 1 -- 172.21.15.88:0/620663816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a2ebf0 msgr2=0x564ea1ad72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02d3fff640 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a2ebf0 0x564ea1ad72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02d3fff640 1 -- 172.21.15.88:0/620663816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a78840 msgr2=0x564ea1ad7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02d3fff640 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a78840 0x564ea1ad7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02d3fff640 1 -- 172.21.15.88:0/620663816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ea1841460 con 0x564ea1a79160 2023-11-20T07:01:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02d3fff640 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a79160 0x564ea1a75f00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00ef90 tx=0x7f02cc0522c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae98514669db886 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-11-20T07:01:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02b27fc640 1 -- 172.21.15.88:0/620663816 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc05dc10 con 0x564ea1a79160 2023-11-20T07:01:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02b27fc640 1 -- 172.21.15.88:0/620663816 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02cc05dd70 con 0x564ea1a79160 2023-11-20T07:01:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 -- 172.21.15.88:0/620663816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ea18176f0 con 0x564ea1a79160 2023-11-20T07:01:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02b27fc640 1 -- 172.21.15.88:0/620663816 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02cc069af0 con 0x564ea1a79160 2023-11-20T07:01:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 10 client.4836 fetch_fsmap learned FSMap version 9 2023-11-20T07:01:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 -- 172.21.15.88:0/620663816 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x564ea1578cc0 con 0x564ea1a79160 2023-11-20T07:01:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02b27fc640 1 -- 172.21.15.88:0/620663816 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc077070 con 0x564ea1a79160 2023-11-20T07:01:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02b27fc640 1 -- 172.21.15.88:0/620663816 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f02cc024020 con 0x564ea1a79160 2023-11-20T07:01:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 10 client.4836 fetch_fsmap finished waiting for FSMap version 9 2023-11-20T07:01:29.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 10 client.4836 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-20T07:01:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 20 client.4836 populate_metadata read hostname 'smithi088' 2023-11-20T07:01:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x564ea1ade1c0 0x564ea1ae05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 4 client.4836 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-20T07:01:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 -- 172.21.15.88:0/620663816 --> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564ea18786e0 con 0x564ea1ade1c0 2023-11-20T07:01:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02d37fe640 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x564ea1ade1c0 0x564ea1ae05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02b27fc640 10 client.4836 ms_handle_connect on v2:172.21.15.175:6835/3413113678 2023-11-20T07:01:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02d37fe640 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x564ea1ade1c0 0x564ea1ae05b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca88e16816ecc04d server_cookie=37cbb36d5db467b in_seq=0 out_seq=0 2023-11-20T07:01:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02b27fc640 1 -- 172.21.15.88:0/620663816 <== mds.0 v2:172.21.15.175:6835/3413113678 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x564ea18786e0 con 0x564ea1ade1c0 2023-11-20T07:01:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02b27fc640 10 client.4836 handle_command_reply: tid=0 2023-11-20T07:01:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 client.4836 shutdown 2023-11-20T07:01:29.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 -- 172.21.15.88:0/620663816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a79160 msgr2=0x564ea1a75f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a79160 0x564ea1a75f00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00ef90 tx=0x7f02cc0522c0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 -- 172.21.15.88:0/620663816 shutdown_connections 2023-11-20T07:01:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.175:6835/3413113678,v1:172.21.15.175:6837/3413113678] conn(0x564ea1ade1c0 0x564ea1ae05b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x564ea1a79160 0x564ea1a75f00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564ea1a78840 0x564ea1ad7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 --2- 172.21.15.88:0/620663816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x564ea1a2ebf0 0x564ea1ad72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 -- 172.21.15.88:0/620663816 >> 172.21.15.88:0/620663816 conn(0x564ea1a25f60 msgr2=0x564ea1a8ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02b27fc640 0 client.4836 ms_handle_reset on v2:172.21.15.175:6835/3413113678 2023-11-20T07:01:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 -- 172.21.15.88:0/620663816 shutdown_connections 2023-11-20T07:01:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.290+0000 7f02dd195000 1 -- 172.21.15.88:0/620663816 wait complete. 2023-11-20T07:01:29.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02dd195000 20 client.4836 trim_cache size 0 max 16384 2023-11-20T07:01:29.299 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:01:29.299 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "81254148-3aea-4f86-927e-f8c4e1bfa591", 2023-11-20T07:01:29.299 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-11-20T07:01:29.299 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4272, 2023-11-20T07:01:29.299 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-11-20T07:01:29.299 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-11-20T07:01:29.299 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-11-20T07:01:29.299 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 34.638365573000002, 2023-11-20T07:01:29.300 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 9, 2023-11-20T07:01:29.300 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 24, 2023-11-20T07:01:29.300 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 24, 2023-11-20T07:01:29.300 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 41.957051982000003 2023-11-20T07:01:29.300 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:01:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02d9e09640 1 -- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f02b40664d0 msgr2=0x7f02b4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02d9e09640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f02b40664d0 0x7f02b4068990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02c40af000 tx=0x7f02c40a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02d9e09640 1 -- 172.21.15.88:0/661804142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02d415ca70 msgr2=0x7f02d4155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02d9e09640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02d415ca70 0x7f02d4155370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00efc0 tx=0x7f02cc00c490 comp rx=0 tx=0).stop 2023-11-20T07:01:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02d9e09640 1 -- 172.21.15.88:0/661804142 shutdown_connections 2023-11-20T07:01:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02d9e09640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f02b40664d0 0x7f02b4068990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02d9e09640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02d40d3550 0x7f02d414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02d9e09640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02d415ca70 0x7f02d4155370 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02d9e09640 1 --2- 172.21.15.88:0/661804142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02d40cf7a0 0x7f02d4153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02d9e09640 1 -- 172.21.15.88:0/661804142 >> 172.21.15.88:0/661804142 conn(0x7f02d409bc50 msgr2=0x7f02d40c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:29.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02d9e09640 1 -- 172.21.15.88:0/661804142 shutdown_connections 2023-11-20T07:01:29.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.294+0000 7f02d9e09640 1 -- 172.21.15.88:0/661804142 wait complete. 2023-11-20T07:01:29.312 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-20T07:01:29.323 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-20T07:01:29.323 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-20T07:01:29.324 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-20T07:01:29.324 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-20T07:01:29.324 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-20T07:01:29.324 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-20T07:01:29.324 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-20T07:01:29.324 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-20T07:01:29.324 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-20T07:01:29.324 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-20T07:01:29.324 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-20T07:01:29.324 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-20T07:01:29.325 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-20T07:01:29.325 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-20T07:01:29.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:29.325 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-11-20T07:01:29.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:29.336 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2023-11-20T07:01:29.407 INFO:teuthology.orchestra.run.smithi175.stderr:Cannot find device "ceph-brx" 2023-11-20T07:01:29.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T07:01:29.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:29.410 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-11-20T07:01:29.420 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-11-20T07:01:29.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:29.420 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-11-20T07:01:29.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:29.481 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-11-20T07:01:29.735 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-20T07:01:29.735 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-20T07:01:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb4974c9640 1 Processor -- start 2023-11-20T07:01:29.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb4974c9640 1 -- start start 2023-11-20T07:01:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb4974c9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb49015a800 0x7fb4900cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb4974c9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4900b21c0 0x7fb4900b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb4974c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb49006fda0 0x7fb490070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb4974c9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4900b2b70 con 0x7fb49015a800 2023-11-20T07:01:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb4974c9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4900c7110 con 0x7fb4900b21c0 2023-11-20T07:01:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb4974c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4900cf820 con 0x7fb49006fda0 2023-11-20T07:01:29.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb495265640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb49015a800 0x7fb4900cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb495265640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb49015a800 0x7fb4900cfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37556/0 (socket says 172.21.15.88:37556) 2023-11-20T07:01:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb495265640 1 -- 172.21.15.88:0/725011096 learned_addr learned my addr 172.21.15.88:0/725011096 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb495a66640 1 --2- 172.21.15.88:0/725011096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb49006fda0 0x7fb490070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.874+0000 7fb494a64640 1 --2- 172.21.15.88:0/725011096 >> v2:172.21.15.175:3300/0 conn(0x7fb4900b21c0 0x7fb4900b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb495265640 1 -- 172.21.15.88:0/725011096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb49006fda0 msgr2=0x7fb490070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:29.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb495265640 1 --2- 172.21.15.88:0/725011096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb49006fda0 0x7fb490070230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb495265640 1 -- 172.21.15.88:0/725011096 >> v2:172.21.15.175:3300/0 conn(0x7fb4900b21c0 msgr2=0x7fb4900b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:29.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb495265640 1 --2- 172.21.15.88:0/725011096 >> v2:172.21.15.175:3300/0 conn(0x7fb4900b21c0 0x7fb4900b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb495265640 1 -- 172.21.15.88:0/725011096 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4900ce780 con 0x7fb49015a800 2023-11-20T07:01:29.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb494a64640 1 --2- 172.21.15.88:0/725011096 >> v2:172.21.15.175:3300/0 conn(0x7fb4900b21c0 0x7fb4900b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:29.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb495265640 1 --2- 172.21.15.88:0/725011096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb49015a800 0x7fb4900cfdb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb49006f470 tx=0x7fb48c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114c03c8e5e9467f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:29.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb487fff640 1 -- 172.21.15.88:0/725011096 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0aa5f0 con 0x7fb49015a800 2023-11-20T07:01:29.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb487fff640 1 -- 172.21.15.88:0/725011096 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c0aa750 con 0x7fb49015a800 2023-11-20T07:01:29.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb487fff640 1 -- 172.21.15.88:0/725011096 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0aaae0 con 0x7fb49015a800 2023-11-20T07:01:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb4974c9640 1 -- 172.21.15.88:0/725011096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb49015a800 msgr2=0x7fb4900cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb4974c9640 1 --2- 172.21.15.88:0/725011096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb49015a800 0x7fb4900cfdb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb49006f470 tx=0x7fb48c01c4d0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb4974c9640 1 -- 172.21.15.88:0/725011096 shutdown_connections 2023-11-20T07:01:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb4974c9640 1 --2- 172.21.15.88:0/725011096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb49006fda0 0x7fb490070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb4974c9640 1 --2- 172.21.15.88:0/725011096 >> v2:172.21.15.175:3300/0 conn(0x7fb4900b21c0 0x7fb4900b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb4974c9640 1 --2- 172.21.15.88:0/725011096 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb49015a800 0x7fb4900cfdb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.878+0000 7fb4974c9640 1 -- 172.21.15.88:0/725011096 >> 172.21.15.88:0/725011096 conn(0x7fb4900cd1c0 msgr2=0x7fb4900cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb4974c9640 1 -- 172.21.15.88:0/725011096 shutdown_connections 2023-11-20T07:01:29.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb4974c9640 1 -- 172.21.15.88:0/725011096 wait complete. 2023-11-20T07:01:29.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb4974c9640 1 Processor -- start 2023-11-20T07:01:29.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb4974c9640 1 -- start start 2023-11-20T07:01:29.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb4974c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb49006fda0 0x7fb49014ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb4974c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4900b21c0 0x7fb4901554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb4974c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb49015a800 0x7fb49006c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb4974c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4901541e0 con 0x7fb49015a800 2023-11-20T07:01:29.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb4974c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb490155020 con 0x7fb49006fda0 2023-11-20T07:01:29.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb4974c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb490158250 con 0x7fb4900b21c0 2023-11-20T07:01:29.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb495a66640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb49015a800 0x7fb49006c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb495a66640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb49015a800 0x7fb49006c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37572/0 (socket says 172.21.15.88:37572) 2023-11-20T07:01:29.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb495a66640 1 -- 172.21.15.88:0/594516948 learned_addr learned my addr 172.21.15.88:0/594516948 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:29.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb494a64640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4900b21c0 0x7fb4901554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb495265640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb49006fda0 0x7fb49014ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb495a66640 1 -- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4900b21c0 msgr2=0x7fb4901554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb495a66640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4900b21c0 0x7fb4901554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb495a66640 1 -- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb49006fda0 msgr2=0x7fb49014ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:29.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb495a66640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb49006fda0 0x7fb49014ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:29.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb495a66640 1 -- 172.21.15.88:0/594516948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c0094d0 con 0x7fb49015a800 2023-11-20T07:01:29.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb494a64640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4900b21c0 0x7fb4901554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:29.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb495a66640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb49015a800 0x7fb49006c710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb488007e60 tx=0x7fb48800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:29.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb485ffb640 1 -- 172.21.15.88:0/594516948 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488014420 con 0x7fb49015a800 2023-11-20T07:01:29.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb485ffb640 1 -- 172.21.15.88:0/594516948 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4880145a0 con 0x7fb49015a800 2023-11-20T07:01:29.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb485ffb640 1 -- 172.21.15.88:0/594516948 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488014950 con 0x7fb49015a800 2023-11-20T07:01:29.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.882+0000 7fb4974c9640 1 -- 172.21.15.88:0/594516948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb490154410 con 0x7fb49015a800 2023-11-20T07:01:29.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.886+0000 7fb4974c9640 1 -- 172.21.15.88:0/594516948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4901549d0 con 0x7fb49015a800 2023-11-20T07:01:29.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.886+0000 7fb4974c9640 1 -- 172.21.15.88:0/594516948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb490155190 con 0x7fb49015a800 2023-11-20T07:01:29.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.886+0000 7fb485ffb640 1 -- 172.21.15.88:0/594516948 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb488014ab0 con 0x7fb49015a800 2023-11-20T07:01:29.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.886+0000 7fb485ffb640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb4740664a0 0x7fb474068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:29.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.886+0000 7fb485ffb640 1 -- 172.21.15.88:0/594516948 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb488084960 con 0x7fb49015a800 2023-11-20T07:01:29.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.886+0000 7fb495265640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb4740664a0 0x7fb474068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:29.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.890+0000 7fb495265640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb4740664a0 0x7fb474068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0ae000 tx=0x7fb48c0b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:29.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:29.890+0000 7fb485ffb640 1 -- 172.21.15.88:0/594516948 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb488051b80 con 0x7fb49015a800 2023-11-20T07:01:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 -- 172.21.15.88:0/594516948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb490074010 con 0x7fb49015a800 2023-11-20T07:01:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb485ffb640 1 -- 172.21.15.88:0/594516948 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb4880551a0 con 0x7fb49015a800 2023-11-20T07:01:30.074 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-20T07:01:30.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 -- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb4740664a0 msgr2=0x7fb474068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:30.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb4740664a0 0x7fb474068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0ae000 tx=0x7fb48c0b5040 comp rx=0 tx=0).stop 2023-11-20T07:01:30.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 -- 172.21.15.88:0/594516948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb49015a800 msgr2=0x7fb49006c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:30.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb49015a800 0x7fb49006c710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb488007e60 tx=0x7fb48800e4b0 comp rx=0 tx=0).stop 2023-11-20T07:01:30.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 -- 172.21.15.88:0/594516948 shutdown_connections 2023-11-20T07:01:30.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb4740664a0 0x7fb474068960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:30.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4900b21c0 0x7fb4901554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:30.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb49015a800 0x7fb49006c710 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:30.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 --2- 172.21.15.88:0/594516948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb49006fda0 0x7fb49014ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:30.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 -- 172.21.15.88:0/594516948 >> 172.21.15.88:0/594516948 conn(0x7fb4900cd1c0 msgr2=0x7fb4900d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:30.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 -- 172.21.15.88:0/594516948 shutdown_connections 2023-11-20T07:01:30.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:30.074+0000 7fb4974c9640 1 -- 172.21.15.88:0/594516948 wait complete. 2023-11-20T07:01:30.094 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-20T07:01:30.094 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-20T07:01:30.094 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-11-20T07:01:30.094 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-20T07:01:30.094 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-20T07:01:30.095 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-20T07:01:30.095 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-20T07:01:30.095 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-20T07:01:30.095 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-20T07:01:30.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:30.095 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-11-20T07:01:30.104 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T07:01:30.104 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T07:01:30.104 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T07:01:30.104 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:30.104 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-20T07:01:30.105 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42383sec preferred_lft 42383sec 2023-11-20T07:01:30.106 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-11-20T07:01:30.106 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:30.106 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-20T07:01:30.106 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:1c:fd:c7:b2 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:30.106 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-20T07:01:30.106 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:30.107 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-20T07:01:30.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:30.107 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:30.107 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:30.107 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2023-11-20T07:01:30.107 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2023-11-20T07:01:30.107 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2023-11-20T07:01:30.107 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-20T07:01:30.108 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:30.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:30.218 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-20T07:01:30.238 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-11-20T07:01:30.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:30.240 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-11-20T07:01:30.291 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-11-20T07:01:30.291 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-20T07:01:30.292 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-20T07:01:30.292 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-20T07:01:30.292 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-20T07:01:30.292 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-20T07:01:30.292 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:30.292 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:30.292 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:30.292 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-20T07:01:30.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:30.293 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:30.293 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:30.293 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-20T07:01:30.293 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-20T07:01:30.293 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-20T07:01:30.293 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:30.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:30.383 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-11-20T07:01:30.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:30.393 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-11-20T07:01:30.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:30.445 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:30.445 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:30.446 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:01:30.446 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-20T07:01:30.446 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:30.529 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-20T07:01:30.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:30.530 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:30.530 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:30.530 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-20T07:01:30.530 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-20T07:01:30.530 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-20T07:01:30.530 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-20T07:01:30.530 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-20T07:01:30.530 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:30.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:30.674 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:30.674 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:30.674 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-11-20T07:01:30.674 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2023-11-20T07:01:30.674 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:30.714 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-20T07:01:30.714 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T07:01:30.714 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-20T07:01:30.769 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-20T07:01:30.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T07:01:30.769 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-20T07:01:30.820 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-20T07:01:30.885 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:01:30.938 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-20T07:01:30.938 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-20T07:01:30.938 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-20T07:01:30.938 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-20T07:01:30.938 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-20T07:01:30.938 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-20T07:01:30.938 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-20T07:01:30.938 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-20T07:01:30.939 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2023-11-20T07:01:30.939 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-20T07:01:30.939 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-20T07:01:30.939 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-20T07:01:30.939 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:01:30.939 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-20T07:01:30.939 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-20T07:01:30.939 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-20T07:01:30.939 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-20T07:01:30.939 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2023-11-20T07:01:30.939 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-20T07:01:30.939 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-20T07:01:30.940 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:01:30.940 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2023-11-20T07:01:30.940 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-20T07:01:30.940 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-20T07:01:30.940 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T07:01:30.940 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T07:01:30.940 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T07:01:30.940 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T07:01:30.940 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-20T07:01:30.940 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:01:30.940 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:01:30.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:30.941 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-20T07:01:30.996 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-20T07:01:30.997 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-20T07:01:31.043 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-20T07:01:31.065 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:01:31.118 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-20T07:01:31.118 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-20T07:01:31.118 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-20T07:01:31.119 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-20T07:01:31.119 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-20T07:01:31.119 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-20T07:01:31.119 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-20T07:01:31.119 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-20T07:01:31.119 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2023-11-20T07:01:31.119 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-20T07:01:31.119 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-20T07:01:31.119 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-20T07:01:31.119 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:01:31.119 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-20T07:01:31.119 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T07:01:31.120 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T07:01:31.121 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-20T07:01:31.121 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:01:31.121 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:01:31.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:31.122 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-20T07:01:31.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:2023-11-20T07:01:31.138+0000 7f116742e580 -1 init, newargv = 0x5621b8631d20 newargc=15 2023-11-20T07:01:31.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[46292]: starting ceph client 2023-11-20T07:01:31.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[46292]: starting fuse 2023-11-20T07:01:31.147 INFO:teuthology.orchestra.run.smithi088.stdout:43 2023-11-20T07:01:31.147 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-20T07:01:31.147 DEBUG:teuthology.orchestra.run.smithi088:> sudo stdin-killer -- python3 -c ' 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> import re 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> import os 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2023-11-20T07:01:31.148 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> return f 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.0")) 2023-11-20T07:01:31.149 DEBUG:teuthology.orchestra.run.smithi088:> ' 2023-11-20T07:01:31.268 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.0.46292.asok 2023-11-20T07:01:31.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-20T07:01:31.279 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46292.asok 2023-11-20T07:01:31.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:31.280 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46292.asok status 2023-11-20T07:01:31.449 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:01:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2023-11-20T07:01:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-20T07:01:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-20T07:01:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "0", 2023-11-20T07:01:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2023-11-20T07:01:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-20T07:01:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "46292", 2023-11-20T07:01:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2023-11-20T07:01:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:01:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2023-11-20T07:01:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2023-11-20T07:01:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4848, 2023-11-20T07:01:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2023-11-20T07:01:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2023-11-20T07:01:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2023-11-20T07:01:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4848 2023-11-20T07:01:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:01:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-11-20T07:01:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 447465699 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 447465699 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.4848 192.168.0.1:0/447465699", 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "192.168.0.1:0/447465699", 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2023-11-20T07:01:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 9, 2023-11-20T07:01:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 24, 2023-11-20T07:01:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2023-11-20T07:01:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2023-11-20T07:01:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2023-11-20T07:01:31.452 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:01:31.464 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-20T07:01:31.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d6ad0f640 1 Processor -- start 2023-11-20T07:01:31.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d6ad0f640 1 -- start start 2023-11-20T07:01:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d6ad0f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d6415ca50 0x7f9d6406c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d6ad0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d6415ce30 0x7f9d640cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d6ad0f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d640b21c0 0x7f9d640b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d6ad0f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d640b2b50 con 0x7f9d6415ca50 2023-11-20T07:01:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d6ad0f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d641607e0 con 0x7f9d640b21c0 2023-11-20T07:01:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d6ad0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640cf060 con 0x7f9d6415ce30 2023-11-20T07:01:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d68aab640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d6415ca50 0x7f9d6406c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d68aab640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d6415ca50 0x7f9d6406c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37582/0 (socket says 172.21.15.88:37582) 2023-11-20T07:01:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d68aab640 1 -- 172.21.15.88:0/3998434962 learned_addr learned my addr 172.21.15.88:0/3998434962 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d5bfff640 1 --2- 172.21.15.88:0/3998434962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d6415ce30 0x7f9d640cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d692ac640 1 --2- 172.21.15.88:0/3998434962 >> v2:172.21.15.175:3300/0 conn(0x7f9d640b21c0 0x7f9d640b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d68aab640 1 -- 172.21.15.88:0/3998434962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d6415ce30 msgr2=0x7f9d640cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d68aab640 1 --2- 172.21.15.88:0/3998434962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d6415ce30 0x7f9d640cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d68aab640 1 -- 172.21.15.88:0/3998434962 >> v2:172.21.15.175:3300/0 conn(0x7f9d640b21c0 msgr2=0x7f9d640b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:31.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d68aab640 1 --2- 172.21.15.88:0/3998434962 >> v2:172.21.15.175:3300/0 conn(0x7f9d640b21c0 0x7f9d640b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.602+0000 7f9d68aab640 1 -- 172.21.15.88:0/3998434962 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d64070210 con 0x7f9d6415ca50 2023-11-20T07:01:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d68aab640 1 --2- 172.21.15.88:0/3998434962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d6415ca50 0x7f9d6406c980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9d640723a0 tx=0x7f9d6001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9318f93bccc421c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d5b7fe640 1 -- 172.21.15.88:0/3998434962 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600aa5f0 con 0x7f9d6415ca50 2023-11-20T07:01:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d5b7fe640 1 -- 172.21.15.88:0/3998434962 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d600aa750 con 0x7f9d6415ca50 2023-11-20T07:01:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d5b7fe640 1 -- 172.21.15.88:0/3998434962 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600aaae0 con 0x7f9d6415ca50 2023-11-20T07:01:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3998434962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d6415ca50 msgr2=0x7f9d6406c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d6ad0f640 1 --2- 172.21.15.88:0/3998434962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d6415ca50 0x7f9d6406c980 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9d640723a0 tx=0x7f9d6001c4d0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3998434962 shutdown_connections 2023-11-20T07:01:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d6ad0f640 1 --2- 172.21.15.88:0/3998434962 >> v2:172.21.15.175:3300/0 conn(0x7f9d640b21c0 0x7f9d640b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d6ad0f640 1 --2- 172.21.15.88:0/3998434962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d6415ce30 0x7f9d640cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d6ad0f640 1 --2- 172.21.15.88:0/3998434962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d6415ca50 0x7f9d6406c980 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3998434962 >> 172.21.15.88:0/3998434962 conn(0x7f9d640cd1c0 msgr2=0x7f9d640cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3998434962 shutdown_connections 2023-11-20T07:01:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.606+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3998434962 wait complete. 2023-11-20T07:01:31.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d6ad0f640 1 Processor -- start 2023-11-20T07:01:31.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d6ad0f640 1 -- start start 2023-11-20T07:01:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d6ad0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d640b21c0 0x7f9d641567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d6ad0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d6415ca50 0x7f9d640c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d6ad0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d6415ce30 0x7f9d640c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d6ad0f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640c8260 con 0x7f9d6415ce30 2023-11-20T07:01:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d6ad0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640c8540 con 0x7f9d640b21c0 2023-11-20T07:01:31.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d6ad0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d640c8820 con 0x7f9d6415ca50 2023-11-20T07:01:31.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d692ac640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d6415ce30 0x7f9d640c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:31.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d692ac640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d6415ce30 0x7f9d640c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37588/0 (socket says 172.21.15.88:37588) 2023-11-20T07:01:31.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d692ac640 1 -- 172.21.15.88:0/3635803334 learned_addr learned my addr 172.21.15.88:0/3635803334 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:31.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d5bfff640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d6415ca50 0x7f9d640c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:31.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d68aab640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d640b21c0 0x7f9d641567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:31.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d692ac640 1 -- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d6415ca50 msgr2=0x7f9d640c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:31.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d692ac640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d6415ca50 0x7f9d640c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d692ac640 1 -- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d640b21c0 msgr2=0x7f9d641567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:31.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d692ac640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d640b21c0 0x7f9d641567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d692ac640 1 -- 172.21.15.88:0/3635803334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d600094d0 con 0x7f9d6415ce30 2023-11-20T07:01:31.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d5bfff640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d6415ca50 0x7f9d640c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:31.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d692ac640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d6415ce30 0x7f9d640c9300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c007e60 tx=0x7f9d5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:31.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d597fa640 1 -- 172.21.15.88:0/3635803334 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c014420 con 0x7f9d6415ce30 2023-11-20T07:01:31.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d597fa640 1 -- 172.21.15.88:0/3635803334 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c0145a0 con 0x7f9d6415ce30 2023-11-20T07:01:31.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3635803334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d640c8b00 con 0x7f9d6415ce30 2023-11-20T07:01:31.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d597fa640 1 -- 172.21.15.88:0/3635803334 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c014950 con 0x7f9d6415ce30 2023-11-20T07:01:31.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.610+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3635803334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d640c37c0 con 0x7f9d6415ce30 2023-11-20T07:01:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.614+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3635803334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d64074010 con 0x7f9d6415ce30 2023-11-20T07:01:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.614+0000 7f9d597fa640 1 -- 172.21.15.88:0/3635803334 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9d5c014ab0 con 0x7f9d6415ce30 2023-11-20T07:01:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.614+0000 7f9d597fa640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9d500664d0 0x7f9d50068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.614+0000 7f9d597fa640 1 -- 172.21.15.88:0/3635803334 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d5c084a40 con 0x7f9d6415ce30 2023-11-20T07:01:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.614+0000 7f9d68aab640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9d500664d0 0x7f9d50068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:31.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.614+0000 7f9d68aab640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9d500664d0 0x7f9d50068990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d600ae000 tx=0x7f9d600b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:31.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.618+0000 7f9d597fa640 1 -- 172.21.15.88:0/3635803334 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9d5c051b30 con 0x7f9d6415ce30 2023-11-20T07:01:31.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3635803334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9d640c8fb0 con 0x7f9d6415ce30 2023-11-20T07:01:31.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d597fa640 1 -- 172.21.15.88:0/3635803334 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9d5c055150 con 0x7f9d6415ce30 2023-11-20T07:01:31.802 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-20T07:01:31.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9d500664d0 msgr2=0x7f9d50068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:31.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9d500664d0 0x7f9d50068990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d600ae000 tx=0x7f9d600b5040 comp rx=0 tx=0).stop 2023-11-20T07:01:31.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3635803334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d6415ce30 msgr2=0x7f9d640c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:31.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d6415ce30 0x7f9d640c9300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c007e60 tx=0x7f9d5c00e4b0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3635803334 shutdown_connections 2023-11-20T07:01:31.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9d500664d0 0x7f9d50068990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d6415ca50 0x7f9d640c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d6415ce30 0x7f9d640c9300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 --2- 172.21.15.88:0/3635803334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d640b21c0 0x7f9d641567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3635803334 >> 172.21.15.88:0/3635803334 conn(0x7f9d640cd1c0 msgr2=0x7f9d640b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3635803334 shutdown_connections 2023-11-20T07:01:31.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:31.802+0000 7f9d6ad0f640 1 -- 172.21.15.88:0/3635803334 wait complete. 2023-11-20T07:01:31.824 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-20T07:01:31.824 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-20T07:01:31.824 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-11-20T07:01:31.824 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-20T07:01:31.824 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-20T07:01:31.824 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-20T07:01:31.824 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-20T07:01:31.824 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-20T07:01:31.824 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-20T07:01:31.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:31.825 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-11-20T07:01:31.833 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T07:01:31.834 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T07:01:31.834 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T07:01:31.834 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:31.834 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-11-20T07:01:31.834 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:31.834 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:31.834 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:31.834 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-11-20T07:01:31.834 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:31.834 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:31.835 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-11-20T07:01:31.835 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:31.835 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:31.835 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-20T07:01:31.835 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:31.835 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-20T07:01:31.835 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42381sec preferred_lft 42381sec 2023-11-20T07:01:31.836 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-11-20T07:01:31.836 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:31.836 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-20T07:01:31.836 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:1c:fd:c7:b2 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:31.836 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-20T07:01:31.837 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:31.837 INFO:teuthology.orchestra.run.smithi088.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T07:01:31.837 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:31.837 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-20T07:01:31.837 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:31.837 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-20T07:01:31.838 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:31.838 INFO:teuthology.orchestra.run.smithi088.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-20T07:01:31.838 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:01:31.838 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-20T07:01:31.838 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:31.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:31.839 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-20T07:01:31.899 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-11-20T07:01:31.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:31.901 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-11-20T07:01:31.956 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-11-20T07:01:31.956 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-20T07:01:31.956 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-20T07:01:31.956 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-20T07:01:31.956 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-20T07:01:31.956 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-20T07:01:31.956 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:31.956 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:31.956 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:31.956 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-20T07:01:31.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:31.957 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:31.957 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:31.957 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-20T07:01:31.957 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-20T07:01:31.957 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-20T07:01:31.957 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:32.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:32.051 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-11-20T07:01:32.060 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-20T07:01:32.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:32.061 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-11-20T07:01:32.112 INFO:teuthology.orchestra.run.smithi088.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-20T07:01:32.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:32.113 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:32.113 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:32.114 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T07:01:32.114 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-20T07:01:32.114 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:32.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:32.200 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-20T07:01:32.265 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T07:01:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T07:01:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T07:01:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-11-20T07:01:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:32.265 INFO:teuthology.orchestra.run.smithi088.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T07:01:32.265 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether f6:66:e7:91:38:31 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-20T07:01:32.266 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-20T07:01:32.266 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:32.266 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::f466:e7ff:fe91:3831/64 scope link tentative 2023-11-20T07:01:32.266 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:32.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:32.267 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-20T07:01:32.333 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T07:01:32.333 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T07:01:32.333 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T07:01:32.333 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:32.333 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-11-20T07:01:32.333 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:32.333 INFO:teuthology.orchestra.run.smithi088.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T07:01:32.333 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether f6:66:e7:91:38:31 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-20T07:01:32.334 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-20T07:01:32.334 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:32.334 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::f466:e7ff:fe91:3831/64 scope link tentative 2023-11-20T07:01:32.334 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:32.335 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-20T07:01:32.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:32.335 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:32.335 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:32.335 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-20T07:01:32.335 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-20T07:01:32.336 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-20T07:01:32.336 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-20T07:01:32.336 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-20T07:01:32.336 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:32.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:32.478 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:01:32.478 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:01:32.478 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.1 up 2023-11-20T07:01:32.478 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.1 master ceph-brx 2023-11-20T07:01:32.478 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:01:32.518 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-20T07:01:32.518 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T07:01:32.518 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-20T07:01:32.573 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-20T07:01:32.573 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T07:01:32.573 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-20T07:01:32.624 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-20T07:01:32.685 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:01:32.738 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-20T07:01:32.738 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-20T07:01:32.738 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-20T07:01:32.739 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-20T07:01:32.739 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-20T07:01:32.739 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-20T07:01:32.739 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-20T07:01:32.739 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-20T07:01:32.739 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2023-11-20T07:01:32.739 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-20T07:01:32.739 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-20T07:01:32.739 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-20T07:01:32.740 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:01:32.740 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-20T07:01:32.740 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-20T07:01:32.740 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-20T07:01:32.740 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-20T07:01:32.740 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2023-11-20T07:01:32.740 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-20T07:01:32.740 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-20T07:01:32.740 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:01:32.741 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2023-11-20T07:01:32.741 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-20T07:01:32.741 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-20T07:01:32.741 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T07:01:32.741 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T07:01:32.741 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T07:01:32.741 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T07:01:32.741 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-20T07:01:32.741 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:01:32.742 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:01:32.742 INFO:teuthology.orchestra.run.smithi088.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-20T07:01:32.742 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T07:01:32.742 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T07:01:32.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:32.743 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-20T07:01:32.792 INFO:teuthology.orchestra.run.smithi088.stdout:43 2023-11-20T07:01:32.793 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-20T07:01:32.793 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-20T07:01:32.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-20T07:01:32.861 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:01:32.914 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-20T07:01:32.914 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-20T07:01:32.914 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-20T07:01:32.914 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-20T07:01:32.915 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-20T07:01:32.915 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-20T07:01:32.915 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-20T07:01:32.915 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-20T07:01:32.915 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2023-11-20T07:01:32.915 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-20T07:01:32.915 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-20T07:01:32.915 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-20T07:01:32.915 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:01:32.916 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-20T07:01:32.916 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-20T07:01:32.916 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-20T07:01:32.916 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-20T07:01:32.916 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2023-11-20T07:01:32.916 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-20T07:01:32.916 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-20T07:01:32.916 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:01:32.916 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2023-11-20T07:01:32.916 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-20T07:01:32.916 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-20T07:01:32.917 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T07:01:32.917 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T07:01:32.917 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T07:01:32.917 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T07:01:32.917 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-20T07:01:32.917 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:01:32.917 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:01:32.917 INFO:teuthology.orchestra.run.smithi088.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-20T07:01:32.917 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T07:01:32.917 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T07:01:32.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:32.918 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-20T07:01:32.934 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi088.stderr:2023-11-20T07:01:32.934+0000 7f42e0101580 -1 init, newargv = 0x562cf8893c60 newargc=15 2023-11-20T07:01:32.935 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi088.stderr:ceph-fuse[46427]: starting ceph client 2023-11-20T07:01:32.942 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi088.stderr:ceph-fuse[46427]: starting fuse 2023-11-20T07:01:32.943 INFO:teuthology.orchestra.run.smithi088.stdout:43 2023-11-20T07:01:32.943 INFO:teuthology.orchestra.run.smithi088.stdout:44 2023-11-20T07:01:32.944 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-20T07:01:32.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo stdin-killer -- python3 -c ' 2023-11-20T07:01:32.944 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2023-11-20T07:01:32.944 DEBUG:teuthology.orchestra.run.smithi088:> import re 2023-11-20T07:01:32.944 DEBUG:teuthology.orchestra.run.smithi088:> import os 2023-11-20T07:01:32.944 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2023-11-20T07:01:32.944 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:01:32.944 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2023-11-20T07:01:32.944 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-20T07:01:32.945 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2023-11-20T07:01:32.946 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2023-11-20T07:01:32.946 DEBUG:teuthology.orchestra.run.smithi088:> return f 2023-11-20T07:01:32.946 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-20T07:01:32.946 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:01:32.946 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.2")) 2023-11-20T07:01:32.946 DEBUG:teuthology.orchestra.run.smithi088:> ' 2023-11-20T07:01:33.069 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.2.46427.asok 2023-11-20T07:01:33.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-20T07:01:33.080 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46427.asok 2023-11-20T07:01:33.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:33.080 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46427.asok status 2023-11-20T07:01:33.251 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:01:33.251 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2023-11-20T07:01:33.252 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-20T07:01:33.252 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-20T07:01:33.252 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "2", 2023-11-20T07:01:33.252 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2023-11-20T07:01:33.252 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-20T07:01:33.252 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "46427", 2023-11-20T07:01:33.252 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2023-11-20T07:01:33.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:01:33.253 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2023-11-20T07:01:33.253 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2023-11-20T07:01:33.253 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4860, 2023-11-20T07:01:33.253 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2023-11-20T07:01:33.253 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2023-11-20T07:01:33.253 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2023-11-20T07:01:33.253 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4860 2023-11-20T07:01:33.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:01:33.254 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-11-20T07:01:33.254 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-11-20T07:01:33.254 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:0", 2023-11-20T07:01:33.254 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 2804844987 2023-11-20T07:01:33.254 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:01:33.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:01:33.254 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-11-20T07:01:33.254 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-11-20T07:01:33.255 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:0", 2023-11-20T07:01:33.255 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 2804844987 2023-11-20T07:01:33.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:01:33.255 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.4860 172.21.15.88:0/2804844987", 2023-11-20T07:01:33.255 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "172.21.15.88:0/2804844987", 2023-11-20T07:01:33.255 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2023-11-20T07:01:33.255 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 9, 2023-11-20T07:01:33.256 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 24, 2023-11-20T07:01:33.256 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2023-11-20T07:01:33.256 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2023-11-20T07:01:33.256 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2023-11-20T07:01:33.256 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:01:33.267 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-20T07:01:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.402+0000 7f917269c640 1 Processor -- start 2023-11-20T07:01:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.402+0000 7f917269c640 1 -- start start 2023-11-20T07:01:33.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f917269c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f916c070c40 0x7f916c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:33.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f917269c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f916c0b4020 0x7f916c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f917269c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c15be60 con 0x7f916c0b0620 2023-11-20T07:01:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f917269c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916c15b3b0 con 0x7f916c0b4020 2023-11-20T07:01:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f917269c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c0b0a90 con 0x7f916c070c40 2023-11-20T07:01:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f916b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f916c0b4020 0x7f916c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f916b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f916c0b4020 0x7f916c0b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37590/0 (socket says 172.21.15.88:37590) 2023-11-20T07:01:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f9170c39640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f916c0b0620 0x7f916c15c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37754/0 (socket says 172.21.15.88:37754) 2023-11-20T07:01:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f916b7fe640 1 -- 172.21.15.88:0/3085597288 learned_addr learned my addr 172.21.15.88:0/3085597288 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f916bfff640 1 --2- 172.21.15.88:0/3085597288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f916c070c40 0x7f916c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f916b7fe640 1 -- 172.21.15.88:0/3085597288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f916c070c40 msgr2=0x7f916c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:33.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f916b7fe640 1 --2- 172.21.15.88:0/3085597288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f916c070c40 0x7f916c15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:33.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f916b7fe640 1 -- 172.21.15.88:0/3085597288 >> v1:172.21.15.88:6789/0 conn(0x7f916c0b0620 legacy=0x7f916c15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:33.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f916b7fe640 1 -- 172.21.15.88:0/3085597288 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c15c1f0 con 0x7f916c0b4020 2023-11-20T07:01:33.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f916bfff640 1 --2- 172.21.15.88:0/3085597288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f916c070c40 0x7f916c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:33.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.406+0000 7f916affd640 1 -- 172.21.15.88:0/3085597288 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009478547 0 0) 0x7f916c15be60 con 0x7f916c0b0620 2023-11-20T07:01:33.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f916b7fe640 1 --2- 172.21.15.88:0/3085597288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f916c0b4020 0x7f916c0b00e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9160009870 tx=0x7f916001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599031d02d2d7a3d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:33.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f916affd640 1 -- 172.21.15.88:0/3085597288 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600aa610 con 0x7f916c0b4020 2023-11-20T07:01:33.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f916affd640 1 -- 172.21.15.88:0/3085597288 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91600a6040 con 0x7f916c0b4020 2023-11-20T07:01:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f916affd640 1 -- 172.21.15.88:0/3085597288 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600aa990 con 0x7f916c0b4020 2023-11-20T07:01:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f917269c640 1 -- 172.21.15.88:0/3085597288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f916c0b4020 msgr2=0x7f916c0b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:33.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f917269c640 1 --2- 172.21.15.88:0/3085597288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f916c0b4020 0x7f916c0b00e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9160009870 tx=0x7f916001c4b0 comp rx=0 tx=0).stop 2023-11-20T07:01:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f917269c640 1 -- 172.21.15.88:0/3085597288 shutdown_connections 2023-11-20T07:01:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f917269c640 1 --2- 172.21.15.88:0/3085597288 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f916c0b4020 0x7f916c0b00e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f917269c640 1 --2- 172.21.15.88:0/3085597288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f916c070c40 0x7f916c15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f917269c640 1 -- 172.21.15.88:0/3085597288 >> 172.21.15.88:0/3085597288 conn(0x7f916c06c190 msgr2=0x7f916c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f917269c640 1 -- 172.21.15.88:0/3085597288 shutdown_connections 2023-11-20T07:01:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f917269c640 1 -- 172.21.15.88:0/3085597288 wait complete. 2023-11-20T07:01:33.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f917269c640 1 Processor -- start 2023-11-20T07:01:33.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.410+0000 7f917269c640 1 -- start start 2023-11-20T07:01:33.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f917269c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f916c070c40 0x7f916c155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:33.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f917269c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f916c0b0620 0x7f916c0c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f917269c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f916c0b4020 0x7f916c0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f917269c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c158160 con 0x7f916c0b0620 2023-11-20T07:01:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f917269c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c158440 con 0x7f916c0b4020 2023-11-20T07:01:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f917269c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c158720 con 0x7f916c070c40 2023-11-20T07:01:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f916b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f916c0b0620 0x7f916c0c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f916b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f916c0b0620 0x7f916c0c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37606/0 (socket says 172.21.15.88:37606) 2023-11-20T07:01:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f916bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f916c070c40 0x7f916c155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f916b7fe640 1 -- 172.21.15.88:0/1447669159 learned_addr learned my addr 172.21.15.88:0/1447669159 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:33.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f9170c39640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f916c0b4020 0x7f916c0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:33.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f916b7fe640 1 -- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f916c070c40 msgr2=0x7f916c155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:33.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f916b7fe640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f916c070c40 0x7f916c155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:33.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f916b7fe640 1 -- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f916c0b4020 msgr2=0x7f916c0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:33.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f916b7fe640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f916c0b4020 0x7f916c0c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:33.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f916b7fe640 1 -- 172.21.15.88:0/1447669159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91600094d0 con 0x7f916c0b0620 2023-11-20T07:01:33.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f9170c39640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f916c0b4020 0x7f916c0c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:33.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f916b7fe640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f916c0b0620 0x7f916c0c3780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91600ac040 tx=0x7f916001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:33.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f9168ff9640 1 -- 172.21.15.88:0/1447669159 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600b3800 con 0x7f916c0b0620 2023-11-20T07:01:33.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f9168ff9640 1 -- 172.21.15.88:0/1447669159 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91600b3980 con 0x7f916c0b0620 2023-11-20T07:01:33.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f9168ff9640 1 -- 172.21.15.88:0/1447669159 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600b3d30 con 0x7f916c0b0620 2023-11-20T07:01:33.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f917269c640 1 -- 172.21.15.88:0/1447669159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c158a00 con 0x7f916c0b0620 2023-11-20T07:01:33.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f917269c640 1 -- 172.21.15.88:0/1447669159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c1564f0 con 0x7f916c0b0620 2023-11-20T07:01:33.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f917269c640 1 -- 172.21.15.88:0/1447669159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916c074010 con 0x7f916c0b0620 2023-11-20T07:01:33.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.414+0000 7f9168ff9640 1 -- 172.21.15.88:0/1447669159 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f91600b2380 con 0x7f916c0b0620 2023-11-20T07:01:33.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.418+0000 7f9168ff9640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f91580664a0 0x7f9158068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:33.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.418+0000 7f9168ff9640 1 -- 172.21.15.88:0/1447669159 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f916011e630 con 0x7f916c0b0620 2023-11-20T07:01:33.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.418+0000 7f916bfff640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f91580664a0 0x7f9158068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:33.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.418+0000 7f916bfff640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f91580664a0 0x7f9158068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f915c00ab60 tx=0x7f915c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:33.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.422+0000 7f9168ff9640 1 -- 172.21.15.88:0/1447669159 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f91600eb860 con 0x7f916c0b0620 2023-11-20T07:01:33.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 -- 172.21.15.88:0/1447669159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f916c158860 con 0x7f916c0b0620 2023-11-20T07:01:33.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f9168ff9640 1 -- 172.21.15.88:0/1447669159 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f916c158860 con 0x7f916c0b0620 2023-11-20T07:01:33.606 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-20T07:01:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 -- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f91580664a0 msgr2=0x7f9158068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f91580664a0 0x7f9158068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f915c00ab60 tx=0x7f915c008040 comp rx=0 tx=0).stop 2023-11-20T07:01:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 -- 172.21.15.88:0/1447669159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f916c0b0620 msgr2=0x7f916c0c3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f916c0b0620 0x7f916c0c3780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91600ac040 tx=0x7f916001acf0 comp rx=0 tx=0).stop 2023-11-20T07:01:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 -- 172.21.15.88:0/1447669159 shutdown_connections 2023-11-20T07:01:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f91580664a0 0x7f9158068960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f916c0b4020 0x7f916c0c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f916c0b0620 0x7f916c0c3780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:33.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 --2- 172.21.15.88:0/1447669159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f916c070c40 0x7f916c155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:33.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 -- 172.21.15.88:0/1447669159 >> 172.21.15.88:0/1447669159 conn(0x7f916c06c190 msgr2=0x7f916c0adb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:33.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 -- 172.21.15.88:0/1447669159 shutdown_connections 2023-11-20T07:01:33.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:33.606+0000 7f917269c640 1 -- 172.21.15.88:0/1447669159 wait complete. 2023-11-20T07:01:33.626 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-20T07:01:33.626 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-20T07:01:33.626 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2023-11-20T07:01:33.626 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-20T07:01:33.626 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-20T07:01:33.627 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-20T07:01:33.627 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-20T07:01:33.627 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-20T07:01:33.627 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-20T07:01:33.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:33.627 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2023-11-20T07:01:33.637 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T07:01:33.637 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T07:01:33.637 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T07:01:33.637 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:33.638 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-11-20T07:01:33.638 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:33.638 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:33.638 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:33.638 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2023-11-20T07:01:33.638 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:33.638 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:33.638 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2023-11-20T07:01:33.638 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:33.638 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:33.638 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-20T07:01:33.639 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:33.639 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-20T07:01:33.639 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42368sec preferred_lft 42368sec 2023-11-20T07:01:33.639 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2023-11-20T07:01:33.639 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:33.639 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-20T07:01:33.639 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:cf:c0:e5:b5 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:33.639 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-20T07:01:33.639 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:33.640 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-20T07:01:33.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:33.640 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-20T07:01:33.640 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-20T07:01:33.640 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add name ceph-brx type bridge 2023-11-20T07:01:33.641 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr flush dev ceph-brx 2023-11-20T07:01:33.641 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set ceph-brx up 2023-11-20T07:01:33.641 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-20T07:01:33.641 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-20T07:01:33.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:33.758 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-20T07:01:33.777 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-11-20T07:01:33.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:33.780 DEBUG:teuthology.orchestra.run.smithi175:> route 2023-11-20T07:01:33.853 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2023-11-20T07:01:33.853 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-20T07:01:33.853 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-20T07:01:33.853 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-20T07:01:33.853 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-20T07:01:33.853 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-20T07:01:33.853 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:33.853 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:33.853 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:33.854 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-20T07:01:33.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:33.854 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-20T07:01:33.854 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-20T07:01:33.854 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-20T07:01:33.854 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-20T07:01:33.854 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-20T07:01:33.854 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-20T07:01:33.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:33.950 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-11-20T07:01:33.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:33.960 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2023-11-20T07:01:34.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:34.011 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-20T07:01:34.011 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-20T07:01:34.012 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T07:01:34.012 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-20T07:01:34.012 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-20T07:01:34.095 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-20T07:01:34.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:34.095 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-20T07:01:34.095 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-20T07:01:34.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-20T07:01:34.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-20T07:01:34.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-20T07:01:34.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-20T07:01:34.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-20T07:01:34.096 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-20T07:01:34.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:34.268 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-20T07:01:34.268 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-20T07:01:34.268 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2023-11-20T07:01:34.268 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.0 master ceph-brx 2023-11-20T07:01:34.268 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-20T07:01:34.320 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-20T07:01:34.320 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T07:01:34.321 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-20T07:01:34.329 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-20T07:01:34.330 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T07:01:34.330 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-20T07:01:34.382 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-20T07:01:34.447 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:01:34.500 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-20T07:01:34.500 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-20T07:01:34.500 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-20T07:01:34.500 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-20T07:01:34.500 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/run/lock 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/bpf 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-20T07:01:34.501 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/fs/nfsd 2023-11-20T07:01:34.502 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-20T07:01:34.502 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-20T07:01:34.502 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:01:34.502 INFO:teuthology.orchestra.run.smithi175.stdout:/run/rpc_pipefs 2023-11-20T07:01:34.502 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-20T07:01:34.502 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-20T07:01:34.502 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-20T07:01:34.502 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-20T07:01:34.502 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-20T07:01:34.502 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-20T07:01:34.502 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-20T07:01:34.502 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T07:01:34.503 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T07:01:34.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:34.504 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-20T07:01:34.554 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-20T07:01:34.555 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-20T07:01:34.601 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-20T07:01:34.622 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:01:34.676 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-20T07:01:34.676 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-20T07:01:34.676 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/run/lock 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/bpf 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-20T07:01:34.677 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-20T07:01:34.678 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-20T07:01:34.678 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/fs/nfsd 2023-11-20T07:01:34.678 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-20T07:01:34.678 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-20T07:01:34.678 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:01:34.678 INFO:teuthology.orchestra.run.smithi175.stdout:/run/rpc_pipefs 2023-11-20T07:01:34.678 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-20T07:01:34.678 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-20T07:01:34.678 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-20T07:01:34.678 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-20T07:01:34.678 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-20T07:01:34.678 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-20T07:01:34.679 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-20T07:01:34.679 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T07:01:34.679 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T07:01:34.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:34.680 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-20T07:01:34.706 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:2023-11-20T07:01:34.700+0000 7f24d85d4580 -1 init, newargv = 0x562628382840 newargc=15 2023-11-20T07:01:34.706 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[44237]: starting ceph client 2023-11-20T07:01:34.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[44237]: starting fuse 2023-11-20T07:01:34.715 INFO:teuthology.orchestra.run.smithi175.stdout:43 2023-11-20T07:01:34.715 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-20T07:01:34.715 DEBUG:teuthology.orchestra.run.smithi175:> sudo stdin-killer -- python3 -c ' 2023-11-20T07:01:34.715 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2023-11-20T07:01:34.715 DEBUG:teuthology.orchestra.run.smithi175:> import re 2023-11-20T07:01:34.715 DEBUG:teuthology.orchestra.run.smithi175:> import os 2023-11-20T07:01:34.715 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2023-11-20T07:01:34.715 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-20T07:01:34.715 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-20T07:01:34.716 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2023-11-20T07:01:34.717 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2023-11-20T07:01:34.717 DEBUG:teuthology.orchestra.run.smithi175:> return f 2023-11-20T07:01:34.717 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-20T07:01:34.717 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-20T07:01:34.717 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.1")) 2023-11-20T07:01:34.717 DEBUG:teuthology.orchestra.run.smithi175:> ' 2023-11-20T07:01:34.839 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.1.44237.asok 2023-11-20T07:01:34.842 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:01:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-20T07:01:34.850 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44237.asok 2023-11-20T07:01:34.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:34.851 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44237.asok status 2023-11-20T07:01:35.026 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-11-20T07:01:35.026 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2023-11-20T07:01:35.026 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-20T07:01:35.026 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-20T07:01:35.026 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "1", 2023-11-20T07:01:35.026 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2023-11-20T07:01:35.026 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "44237", 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 4777, 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 4777 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-20T07:01:35.027 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 314961096 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 314961096 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.4777 192.168.0.1:0/314961096", 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.1:0/314961096", 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2023-11-20T07:01:35.028 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 9, 2023-11-20T07:01:35.029 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 25, 2023-11-20T07:01:35.029 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2023-11-20T07:01:35.029 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2023-11-20T07:01:35.029 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2023-11-20T07:01:35.029 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-11-20T07:01:35.041 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-20T07:01:35.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa721e6b640 1 Processor -- start 2023-11-20T07:01:35.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa721e6b640 1 -- start start 2023-11-20T07:01:35.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa721e6b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa71c0d15d0 0x7fa71c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:35.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa721e6b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa71c0d3010 0x7fa71c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:35.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa721e6b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c0ce770 con 0x7fa71c15cb90 2023-11-20T07:01:35.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa721e6b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71c0d0600 con 0x7fa71c0d3010 2023-11-20T07:01:35.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa721e6b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0c6450 con 0x7fa71c0d15d0 2023-11-20T07:01:35.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa71affd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa71c0d15d0 0x7fa71c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:35.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa71bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa71c0d3010 0x7fa71c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:35.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa71b7fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa71c15cb90 0x7fa71c0d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:60904/0 (socket says 172.21.15.88:60904) 2023-11-20T07:01:35.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa71b7fe640 1 -- 172.21.15.88:0/4255956682 learned_addr learned my addr 172.21.15.88:0/4255956682 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:35.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa71affd640 1 -- 172.21.15.88:0/4255956682 >> v2:172.21.15.175:3300/0 conn(0x7fa71c0d3010 msgr2=0x7fa71c0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:35.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa71affd640 1 --2- 172.21.15.88:0/4255956682 >> v2:172.21.15.175:3300/0 conn(0x7fa71c0d3010 0x7fa71c0c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:35.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa71affd640 1 -- 172.21.15.88:0/4255956682 >> v1:172.21.15.175:6789/0 conn(0x7fa71c15cb90 legacy=0x7fa71c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:35.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa71affd640 1 -- 172.21.15.88:0/4255956682 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c0d08a0 con 0x7fa71c0d15d0 2023-11-20T07:01:35.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.190+0000 7fa71a7fc640 1 -- 172.21.15.88:0/4255956682 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897344508 0 0) 0x7fa71c0ce770 con 0x7fa71c15cb90 2023-11-20T07:01:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.194+0000 7fa71affd640 1 --2- 172.21.15.88:0/4255956682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa71c0d15d0 0x7fa71c0cfb10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7100097c0 tx=0x7fa71001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=650194a201858cae server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:35.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.194+0000 7fa71a7fc640 1 -- 172.21.15.88:0/4255956682 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7100ac620 con 0x7fa71c0d15d0 2023-11-20T07:01:35.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.194+0000 7fa71a7fc640 1 -- 172.21.15.88:0/4255956682 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7100ac780 con 0x7fa71c0d15d0 2023-11-20T07:01:35.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.194+0000 7fa71a7fc640 1 -- 172.21.15.88:0/4255956682 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7100acb10 con 0x7fa71c0d15d0 2023-11-20T07:01:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.194+0000 7fa721e6b640 1 -- 172.21.15.88:0/4255956682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa71c0d15d0 msgr2=0x7fa71c0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.194+0000 7fa721e6b640 1 --2- 172.21.15.88:0/4255956682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa71c0d15d0 0x7fa71c0cfb10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa7100097c0 tx=0x7fa71001c3c0 comp rx=0 tx=0).stop 2023-11-20T07:01:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.194+0000 7fa721e6b640 1 -- 172.21.15.88:0/4255956682 shutdown_connections 2023-11-20T07:01:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.194+0000 7fa721e6b640 1 --2- 172.21.15.88:0/4255956682 >> v2:172.21.15.175:3300/0 conn(0x7fa71c0d3010 0x7fa71c0c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.194+0000 7fa721e6b640 1 --2- 172.21.15.88:0/4255956682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa71c0d15d0 0x7fa71c0cfb10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.194+0000 7fa721e6b640 1 -- 172.21.15.88:0/4255956682 >> 172.21.15.88:0/4255956682 conn(0x7fa71c09bc50 msgr2=0x7fa71c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.194+0000 7fa721e6b640 1 -- 172.21.15.88:0/4255956682 shutdown_connections 2023-11-20T07:01:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.194+0000 7fa721e6b640 1 -- 172.21.15.88:0/4255956682 wait complete. 2023-11-20T07:01:35.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa721e6b640 1 Processor -- start 2023-11-20T07:01:35.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa721e6b640 1 -- start start 2023-11-20T07:01:35.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa721e6b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa71c0d15d0 0x7fa71c0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:35.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa721e6b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa71c0d3010 0x7fa71c0b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:35.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa721e6b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa71c15cb90 0x7fa71c0b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:35.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa721e6b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c1f6fc0 con 0x7fa71c0d15d0 2023-11-20T07:01:35.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa721e6b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c1f60f0 con 0x7fa71c15cb90 2023-11-20T07:01:35.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa721e6b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c1f6340 con 0x7fa71c0d3010 2023-11-20T07:01:35.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa71b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa71c0d15d0 0x7fa71c0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:35.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa71b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa71c0d15d0 0x7fa71c0c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37622/0 (socket says 172.21.15.88:37622) 2023-11-20T07:01:35.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa71b7fe640 1 -- 172.21.15.88:0/4092828941 learned_addr learned my addr 172.21.15.88:0/4092828941 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:35.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa71bfff640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa71c15cb90 0x7fa71c0b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:35.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa71affd640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa71c0d3010 0x7fa71c0b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:35.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa71b7fe640 1 -- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa71c0d3010 msgr2=0x7fa71c0b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:35.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa71b7fe640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa71c0d3010 0x7fa71c0b74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:35.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa71b7fe640 1 -- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa71c15cb90 msgr2=0x7fa71c0b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:35.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa71b7fe640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa71c15cb90 0x7fa71c0b7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:35.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa71b7fe640 1 -- 172.21.15.88:0/4092828941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa710009420 con 0x7fa71c0d15d0 2023-11-20T07:01:35.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa71b7fe640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa71c0d15d0 0x7fa71c0c99d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00c430 tx=0x7fa70c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:35.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa703fff640 1 -- 172.21.15.88:0/4092828941 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c0074e0 con 0x7fa71c0d15d0 2023-11-20T07:01:35.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa703fff640 1 -- 172.21.15.88:0/4092828941 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70c007640 con 0x7fa71c0d15d0 2023-11-20T07:01:35.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa721e6b640 1 -- 172.21.15.88:0/4092828941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c1f6620 con 0x7fa71c0d15d0 2023-11-20T07:01:35.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa703fff640 1 -- 172.21.15.88:0/4092828941 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c004a40 con 0x7fa71c0d15d0 2023-11-20T07:01:35.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.198+0000 7fa721e6b640 1 -- 172.21.15.88:0/4092828941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c1f6be0 con 0x7fa71c0d15d0 2023-11-20T07:01:35.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.202+0000 7fa721e6b640 1 -- 172.21.15.88:0/4092828941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c1f7100 con 0x7fa71c0d15d0 2023-11-20T07:01:35.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.202+0000 7fa703fff640 1 -- 172.21.15.88:0/4092828941 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa70c004ba0 con 0x7fa71c0d15d0 2023-11-20T07:01:35.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.202+0000 7fa703fff640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa7080664a0 0x7fa708068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:35.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.202+0000 7fa703fff640 1 -- 172.21.15.88:0/4092828941 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa70c083f30 con 0x7fa71c0d15d0 2023-11-20T07:01:35.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.202+0000 7fa71affd640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa7080664a0 0x7fa708068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:35.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.202+0000 7fa71affd640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa7080664a0 0x7fa708068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa7100ae000 tx=0x7fa7100a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:35.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.206+0000 7fa703fff640 1 -- 172.21.15.88:0/4092828941 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa71c1f7100 con 0x7fa71c0d15d0 2023-11-20T07:01:35.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.398+0000 7fa721e6b640 1 -- 172.21.15.88:0/4092828941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa71c1f7100 con 0x7fa71c0d15d0 2023-11-20T07:01:35.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.398+0000 7fa703fff640 1 -- 172.21.15.88:0/4092828941 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa71c1f7100 con 0x7fa71c0d15d0 2023-11-20T07:01:35.399 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-11-20T07:01:35.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.402+0000 7fa721e6b640 1 -- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa7080664a0 msgr2=0x7fa708068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:35.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.402+0000 7fa721e6b640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa7080664a0 0x7fa708068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa7100ae000 tx=0x7fa7100a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:35.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.402+0000 7fa721e6b640 1 -- 172.21.15.88:0/4092828941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa71c0d15d0 msgr2=0x7fa71c0c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:35.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.402+0000 7fa721e6b640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa71c0d15d0 0x7fa71c0c99d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00c430 tx=0x7fa70c00c8f0 comp rx=0 tx=0).stop 2023-11-20T07:01:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.402+0000 7fa721e6b640 1 -- 172.21.15.88:0/4092828941 shutdown_connections 2023-11-20T07:01:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.402+0000 7fa721e6b640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa7080664a0 0x7fa708068960 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.402+0000 7fa721e6b640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa71c0d3010 0x7fa71c0b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.402+0000 7fa721e6b640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa71c15cb90 0x7fa71c0b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.402+0000 7fa721e6b640 1 --2- 172.21.15.88:0/4092828941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa71c0d15d0 0x7fa71c0c99d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.402+0000 7fa721e6b640 1 -- 172.21.15.88:0/4092828941 >> 172.21.15.88:0/4092828941 conn(0x7fa71c09bc50 msgr2=0x7fa71c06b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.402+0000 7fa721e6b640 1 -- 172.21.15.88:0/4092828941 shutdown_connections 2023-11-20T07:01:35.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:35.402+0000 7fa721e6b640 1 -- 172.21.15.88:0/4092828941 wait complete. 2023-11-20T07:01:35.419 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-20T07:01:35.419 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-20T07:01:35.420 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2023-11-20T07:01:35.420 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-20T07:01:35.420 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-20T07:01:35.420 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-20T07:01:35.420 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-20T07:01:35.420 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-20T07:01:35.420 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-20T07:01:35.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:35.420 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2023-11-20T07:01:35.430 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T07:01:35.430 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T07:01:35.430 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T07:01:35.430 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.430 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-11-20T07:01:35.430 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.430 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:35.431 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:35.431 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2023-11-20T07:01:35.431 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:35.431 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:35.431 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2023-11-20T07:01:35.431 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:01:35.431 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:35.431 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-20T07:01:35.431 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:35.431 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-20T07:01:35.431 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42367sec preferred_lft 42367sec 2023-11-20T07:01:35.431 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2023-11-20T07:01:35.432 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.432 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-20T07:01:35.432 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:cf:c0:e5:b5 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:35.432 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-20T07:01:35.432 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.432 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T07:01:35.432 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-20T07:01:35.432 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-20T07:01:35.432 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.432 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-20T07:01:35.432 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.432 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-20T07:01:35.433 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T07:01:35.433 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-20T07:01:35.433 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:35.434 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-20T07:01:35.493 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-11-20T07:01:35.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:35.495 DEBUG:teuthology.orchestra.run.smithi175:> route 2023-11-20T07:01:35.553 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2023-11-20T07:01:35.553 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-20T07:01:35.553 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-20T07:01:35.553 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-20T07:01:35.553 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-20T07:01:35.554 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-20T07:01:35.554 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:35.554 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:35.554 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:01:35.554 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-20T07:01:35.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:35.554 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-20T07:01:35.554 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-20T07:01:35.554 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-20T07:01:35.555 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-20T07:01:35.555 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-20T07:01:35.555 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-20T07:01:35.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:35.645 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-11-20T07:01:35.654 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-20T07:01:35.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:35.654 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2023-11-20T07:01:35.708 INFO:teuthology.orchestra.run.smithi175.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-20T07:01:35.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:35.709 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-20T07:01:35.709 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-20T07:01:35.709 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-20T07:01:35.709 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-20T07:01:35.709 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-20T07:01:35.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:35.788 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-20T07:01:35.855 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T07:01:35.855 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T07:01:35.855 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T07:01:35.855 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.855 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-11-20T07:01:35.855 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.855 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T07:01:35.855 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether b6:94:5d:63:9f:ec brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-20T07:01:35.855 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-20T07:01:35.856 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.856 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::b494:5dff:fe63:9fec/64 scope link 2023-11-20T07:01:35.856 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:35.857 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-20T07:01:35.918 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T07:01:35.919 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T07:01:35.919 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T07:01:35.919 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.919 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-11-20T07:01:35.919 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.919 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T07:01:35.919 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether b6:94:5d:63:9f:ec brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-20T07:01:35.919 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-20T07:01:35.919 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.919 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::b494:5dff:fe63:9fec/64 scope link 2023-11-20T07:01:35.920 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:01:35.920 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-20T07:01:35.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:35.921 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-20T07:01:35.921 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-20T07:01:35.921 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-20T07:01:35.921 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-20T07:01:35.921 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-20T07:01:35.921 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-20T07:01:35.921 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-20T07:01:35.922 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-20T07:01:36.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:36.062 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-20T07:01:36.062 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-20T07:01:36.062 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.1 up 2023-11-20T07:01:36.062 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.1 master ceph-brx 2023-11-20T07:01:36.062 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-20T07:01:36.102 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-20T07:01:36.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T07:01:36.102 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-20T07:01:36.158 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-20T07:01:36.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T07:01:36.159 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-20T07:01:36.210 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-20T07:01:36.280 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:01:36.339 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-20T07:01:36.339 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-20T07:01:36.339 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-20T07:01:36.339 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-20T07:01:36.339 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-20T07:01:36.339 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-20T07:01:36.339 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-20T07:01:36.340 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-20T07:01:36.340 INFO:teuthology.orchestra.run.smithi175.stdout:/run/lock 2023-11-20T07:01:36.340 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-20T07:01:36.340 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-20T07:01:36.340 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/bpf 2023-11-20T07:01:36.340 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:01:36.340 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-20T07:01:36.340 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-20T07:01:36.340 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-20T07:01:36.340 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-20T07:01:36.341 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/fs/nfsd 2023-11-20T07:01:36.341 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-20T07:01:36.341 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-20T07:01:36.341 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:01:36.341 INFO:teuthology.orchestra.run.smithi175.stdout:/run/rpc_pipefs 2023-11-20T07:01:36.341 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-20T07:01:36.341 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-20T07:01:36.341 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-20T07:01:36.341 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-20T07:01:36.341 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-20T07:01:36.341 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-20T07:01:36.341 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-20T07:01:36.342 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T07:01:36.342 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T07:01:36.342 INFO:teuthology.orchestra.run.smithi175.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-20T07:01:36.342 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-20T07:01:36.342 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-20T07:01:36.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:36.343 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-20T07:01:36.396 INFO:teuthology.orchestra.run.smithi175.stdout:43 2023-11-20T07:01:36.396 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-20T07:01:36.397 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-20T07:01:36.450 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-20T07:01:36.473 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:01:36.533 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-20T07:01:36.533 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-20T07:01:36.533 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-20T07:01:36.533 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-20T07:01:36.533 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-20T07:01:36.533 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-20T07:01:36.533 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-20T07:01:36.534 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-20T07:01:36.534 INFO:teuthology.orchestra.run.smithi175.stdout:/run/lock 2023-11-20T07:01:36.534 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-20T07:01:36.534 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-20T07:01:36.534 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/bpf 2023-11-20T07:01:36.534 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:01:36.534 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-20T07:01:36.534 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-20T07:01:36.534 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-20T07:01:36.534 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-20T07:01:36.534 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/fs/nfsd 2023-11-20T07:01:36.535 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-20T07:01:36.535 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-20T07:01:36.535 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:01:36.535 INFO:teuthology.orchestra.run.smithi175.stdout:/run/rpc_pipefs 2023-11-20T07:01:36.535 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-20T07:01:36.535 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-20T07:01:36.535 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-20T07:01:36.535 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-20T07:01:36.535 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-20T07:01:36.535 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-20T07:01:36.535 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-20T07:01:36.536 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T07:01:36.536 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T07:01:36.536 INFO:teuthology.orchestra.run.smithi175.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-20T07:01:36.536 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-20T07:01:36.536 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-20T07:01:36.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:36.537 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-20T07:01:36.544 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:2023-11-20T07:01:36.540+0000 7f89db23a580 -1 init, newargv = 0x55b317d54be0 newargc=15 2023-11-20T07:01:36.544 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:ceph-fuse[44345]: starting ceph client 2023-11-20T07:01:36.551 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:ceph-fuse[44345]: starting fuse 2023-11-20T07:01:36.555 INFO:teuthology.orchestra.run.smithi175.stdout:43 2023-11-20T07:01:36.555 INFO:teuthology.orchestra.run.smithi175.stdout:44 2023-11-20T07:01:36.555 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-20T07:01:36.555 DEBUG:teuthology.orchestra.run.smithi175:> sudo stdin-killer -- python3 -c ' 2023-11-20T07:01:36.555 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2023-11-20T07:01:36.555 DEBUG:teuthology.orchestra.run.smithi175:> import re 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> import os 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2023-11-20T07:01:36.556 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-20T07:01:36.557 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2023-11-20T07:01:36.557 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-20T07:01:36.557 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-20T07:01:36.557 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-20T07:01:36.557 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2023-11-20T07:01:36.557 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2023-11-20T07:01:36.557 DEBUG:teuthology.orchestra.run.smithi175:> return f 2023-11-20T07:01:36.557 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-20T07:01:36.557 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-20T07:01:36.557 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.3")) 2023-11-20T07:01:36.557 DEBUG:teuthology.orchestra.run.smithi175:> ' 2023-11-20T07:01:36.684 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.3.44345.asok 2023-11-20T07:01:36.688 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-20T07:01:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-20T07:01:36.695 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44345.asok 2023-11-20T07:01:36.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:36.696 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44345.asok status 2023-11-20T07:01:36.870 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-11-20T07:01:36.871 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2023-11-20T07:01:36.871 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-20T07:01:36.871 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-20T07:01:36.871 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "3", 2023-11-20T07:01:36.871 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2023-11-20T07:01:36.871 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-20T07:01:36.871 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "44345", 2023-11-20T07:01:36.871 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2023-11-20T07:01:36.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-20T07:01:36.872 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2023-11-20T07:01:36.872 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2023-11-20T07:01:36.872 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 4789, 2023-11-20T07:01:36.872 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2023-11-20T07:01:36.872 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2023-11-20T07:01:36.872 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2023-11-20T07:01:36.872 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 4789 2023-11-20T07:01:36.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-20T07:01:36.872 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-20T07:01:36.872 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-20T07:01:36.872 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.2:0", 2023-11-20T07:01:36.872 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 1808966596 2023-11-20T07:01:36.873 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-11-20T07:01:36.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-20T07:01:36.873 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-20T07:01:36.873 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-20T07:01:36.873 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.2:0", 2023-11-20T07:01:36.873 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 1808966596 2023-11-20T07:01:36.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-20T07:01:36.873 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.4789 192.168.0.2:0/1808966596", 2023-11-20T07:01:36.873 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.2:0/1808966596", 2023-11-20T07:01:36.873 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2023-11-20T07:01:36.874 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 9, 2023-11-20T07:01:36.874 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 26, 2023-11-20T07:01:36.874 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2023-11-20T07:01:36.874 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2023-11-20T07:01:36.874 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2023-11-20T07:01:36.874 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-11-20T07:01:36.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:36.885 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2023-11-20T07:01:36.886 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-20T07:01:36.896 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2023-11-20T07:01:36.896 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-20T07:01:36.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:36.897 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-20T07:01:36.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:36.967 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2023-11-20T07:01:36.967 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-20T07:01:37.018 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2023-11-20T07:01:37.018 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-20T07:01:37.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:37.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-20T07:01:37.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:37.082 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2023-11-20T07:01:37.082 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-20T07:01:37.091 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2023-11-20T07:01:37.091 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-20T07:01:37.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:37.092 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-20T07:01:37.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:37.154 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2023-11-20T07:01:37.157 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-20T07:01:37.211 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2023-11-20T07:01:37.211 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-20T07:01:37.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:37.211 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-20T07:01:37.279 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-20T07:01:37.337 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:37.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb9a5b8640 1 Processor -- start 2023-11-20T07:01:37.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb9a5b8640 1 -- start start 2023-11-20T07:01:37.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb9a5b8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb9415cb90 0x7fdb940cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:37.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb9a5b8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb940d3010 0x7fdb940d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:37.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb9a5b8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb940ce770 con 0x7fdb940d1400 2023-11-20T07:01:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb9a5b8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb940d1890 con 0x7fdb940d3010 2023-11-20T07:01:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb9a5b8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940d0600 con 0x7fdb9415cb90 2023-11-20T07:01:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb937fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb940d3010 0x7fdb940d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb98b55640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdb940d1400 0x7fdb940cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34612/0 (socket says 172.21.15.88:34612) 2023-11-20T07:01:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb98b55640 1 -- 172.21.15.88:0/2380370510 learned_addr learned my addr 172.21.15.88:0/2380370510 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb937fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdb940d3010 0x7fdb940d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38452/0 (socket says 172.21.15.88:38452) 2023-11-20T07:01:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb93fff640 1 --2- 172.21.15.88:0/2380370510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb9415cb90 0x7fdb940cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb937fe640 1 -- 172.21.15.88:0/2380370510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb9415cb90 msgr2=0x7fdb940cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb937fe640 1 --2- 172.21.15.88:0/2380370510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb9415cb90 0x7fdb940cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb937fe640 1 -- 172.21.15.88:0/2380370510 >> v1:172.21.15.88:6789/0 conn(0x7fdb940d1400 legacy=0x7fdb940cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb937fe640 1 -- 172.21.15.88:0/2380370510 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb940c6450 con 0x7fdb940d3010 2023-11-20T07:01:37.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb92ffd640 1 -- 172.21.15.88:0/2380370510 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418520068 0 0) 0x7fdb940ce770 con 0x7fdb940d1400 2023-11-20T07:01:37.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.486+0000 7fdb93fff640 1 --2- 172.21.15.88:0/2380370510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb9415cb90 0x7fdb940cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.490+0000 7fdb937fe640 1 --2- 172.21.15.88:0/2380370510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb940d3010 0x7fdb940d0ec0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb880097c0 tx=0x7fdb8801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3d25f3f4193326 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.490+0000 7fdb92ffd640 1 -- 172.21.15.88:0/2380370510 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb880ac620 con 0x7fdb940d3010 2023-11-20T07:01:37.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.490+0000 7fdb92ffd640 1 -- 172.21.15.88:0/2380370510 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb880ac780 con 0x7fdb940d3010 2023-11-20T07:01:37.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.490+0000 7fdb92ffd640 1 -- 172.21.15.88:0/2380370510 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb880acb10 con 0x7fdb940d3010 2023-11-20T07:01:37.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.490+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/2380370510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb940d3010 msgr2=0x7fdb940d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:37.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.490+0000 7fdb9a5b8640 1 --2- 172.21.15.88:0/2380370510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb940d3010 0x7fdb940d0ec0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb880097c0 tx=0x7fdb8801c3c0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.490+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/2380370510 shutdown_connections 2023-11-20T07:01:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.490+0000 7fdb9a5b8640 1 --2- 172.21.15.88:0/2380370510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb940d3010 0x7fdb940d0ec0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.490+0000 7fdb9a5b8640 1 --2- 172.21.15.88:0/2380370510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb9415cb90 0x7fdb940cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.490+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/2380370510 >> 172.21.15.88:0/2380370510 conn(0x7fdb9409bc50 msgr2=0x7fdb940d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.490+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/2380370510 shutdown_connections 2023-11-20T07:01:37.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.490+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/2380370510 wait complete. 2023-11-20T07:01:37.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb9a5b8640 1 Processor -- start 2023-11-20T07:01:37.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb9a5b8640 1 -- start start 2023-11-20T07:01:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb9a5b8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb940d1400 0x7fdb940b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb9a5b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb940d3010 0x7fdb940b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb9a5b8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb9415cb90 0x7fdb94153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb9a5b8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940c9f90 con 0x7fdb940d3010 2023-11-20T07:01:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb9a5b8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940ca270 con 0x7fdb9415cb90 2023-11-20T07:01:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb9a5b8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb940ca550 con 0x7fdb940d1400 2023-11-20T07:01:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb937fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb940d3010 0x7fdb940b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb937fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb940d3010 0x7fdb940b4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38460/0 (socket says 172.21.15.88:38460) 2023-11-20T07:01:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb937fe640 1 -- 172.21.15.88:0/1371356796 learned_addr learned my addr 172.21.15.88:0/1371356796 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:37.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb98b55640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb9415cb90 0x7fdb94153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:37.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb93fff640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb940d1400 0x7fdb940b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:37.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb937fe640 1 -- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb940d1400 msgr2=0x7fdb940b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:37.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb937fe640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb940d1400 0x7fdb940b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb937fe640 1 -- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb9415cb90 msgr2=0x7fdb94153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:37.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb937fe640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb9415cb90 0x7fdb94153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb937fe640 1 -- 172.21.15.88:0/1371356796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb88009420 con 0x7fdb940d3010 2023-11-20T07:01:37.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb937fe640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb940d3010 0x7fdb940b4430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdb880af040 tx=0x7fdb88019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:37.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb90ff9640 1 -- 172.21.15.88:0/1371356796 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb880b5410 con 0x7fdb940d3010 2023-11-20T07:01:37.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb90ff9640 1 -- 172.21.15.88:0/1371356796 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb880b5570 con 0x7fdb940d3010 2023-11-20T07:01:37.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/1371356796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb940ca830 con 0x7fdb940d3010 2023-11-20T07:01:37.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb90ff9640 1 -- 172.21.15.88:0/1371356796 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb880b5920 con 0x7fdb940d3010 2023-11-20T07:01:37.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.494+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/1371356796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb940b4c50 con 0x7fdb940d3010 2023-11-20T07:01:37.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.498+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/1371356796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb94074010 con 0x7fdb940d3010 2023-11-20T07:01:37.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.498+0000 7fdb90ff9640 1 -- 172.21.15.88:0/1371356796 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdb880b3040 con 0x7fdb940d3010 2023-11-20T07:01:37.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.498+0000 7fdb90ff9640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdb800664a0 0x7fdb80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:37.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.498+0000 7fdb90ff9640 1 -- 172.21.15.88:0/1371356796 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdb8811e2e0 con 0x7fdb940d3010 2023-11-20T07:01:37.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.498+0000 7fdb93fff640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdb800664a0 0x7fdb80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:37.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.498+0000 7fdb93fff640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdb800664a0 0x7fdb80068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdb94073090 tx=0x7fdb84008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:37.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.502+0000 7fdb90ff9640 1 -- 172.21.15.88:0/1371356796 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdb880eb440 con 0x7fdb940d3010 2023-11-20T07:01:37.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.654+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/1371356796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb940ca0d0 con 0x7fdb940d3010 2023-11-20T07:01:37.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.654+0000 7fdb90ff9640 1 -- 172.21.15.88:0/1371356796 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7fdb940ca0d0 con 0x7fdb940d3010 2023-11-20T07:01:37.656 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:37.656 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:37.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.658+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdb800664a0 msgr2=0x7fdb80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.658+0000 7fdb9a5b8640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdb800664a0 0x7fdb80068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdb94073090 tx=0x7fdb84008040 comp rx=0 tx=0).stop 2023-11-20T07:01:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.658+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/1371356796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb940d3010 msgr2=0x7fdb940b4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.658+0000 7fdb9a5b8640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb940d3010 0x7fdb940b4430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdb880af040 tx=0x7fdb88019160 comp rx=0 tx=0).stop 2023-11-20T07:01:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.658+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/1371356796 shutdown_connections 2023-11-20T07:01:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.658+0000 7fdb9a5b8640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdb800664a0 0x7fdb80068960 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.658+0000 7fdb9a5b8640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb9415cb90 0x7fdb94153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.658+0000 7fdb9a5b8640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdb940d3010 0x7fdb940b4430 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.658+0000 7fdb9a5b8640 1 --2- 172.21.15.88:0/1371356796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb940d1400 0x7fdb940b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.658+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/1371356796 >> 172.21.15.88:0/1371356796 conn(0x7fdb9409bc50 msgr2=0x7fdb9406b110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.658+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/1371356796 shutdown_connections 2023-11-20T07:01:37.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.658+0000 7fdb9a5b8640 1 -- 172.21.15.88:0/1371356796 wait complete. 2023-11-20T07:01:37.678 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:37.679 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:37.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.818+0000 7fcd14816640 1 Processor -- start 2023-11-20T07:01:37.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.818+0000 7fcd14816640 1 -- start start 2023-11-20T07:01:37.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd14816640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd100cf210 0x7fcd100cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:37.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd14816640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcd100d3320 0x7fcd100ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:37.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd14816640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd100cfb30 con 0x7fcd1015cdc0 2023-11-20T07:01:37.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd14816640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd100cea10 con 0x7fcd100d3320 2023-11-20T07:01:37.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd14816640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd100d0880 con 0x7fcd100cf210 2023-11-20T07:01:37.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd0f59e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcd100d3320 0x7fcd100ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:37.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd0f59e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcd100d3320 0x7fcd100ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38464/0 (socket says 172.21.15.88:38464) 2023-11-20T07:01:37.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd0f59e640 1 -- 172.21.15.88:0/396876638 learned_addr learned my addr 172.21.15.88:0/396876638 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:37.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd0ed9d640 1 --2- 172.21.15.88:0/396876638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd100cf210 0x7fcd100cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd0f59e640 1 -- 172.21.15.88:0/396876638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd100cf210 msgr2=0x7fcd100cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd0f59e640 1 --2- 172.21.15.88:0/396876638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd100cf210 0x7fcd100cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd0f59e640 1 -- 172.21.15.88:0/396876638 >> v1:172.21.15.175:6789/0 conn(0x7fcd1015cdc0 legacy=0x7fcd100b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.822+0000 7fcd0f59e640 1 -- 172.21.15.88:0/396876638 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd100b1c00 con 0x7fcd100d3320 2023-11-20T07:01:37.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd0f59e640 1 --2- 172.21.15.88:0/396876638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd100d3320 0x7fcd100ce4d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009e50 tx=0x7fcd0801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc2ab5697f420dd server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd0e59c640 1 -- 172.21.15.88:0/396876638 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd080a58a0 con 0x7fcd100d3320 2023-11-20T07:01:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd0e59c640 1 -- 172.21.15.88:0/396876638 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd080a5a00 con 0x7fcd100d3320 2023-11-20T07:01:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd0e59c640 1 -- 172.21.15.88:0/396876638 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd080a5d90 con 0x7fcd100d3320 2023-11-20T07:01:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd14816640 1 -- 172.21.15.88:0/396876638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd100d3320 msgr2=0x7fcd100ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd14816640 1 --2- 172.21.15.88:0/396876638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd100d3320 0x7fcd100ce4d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009e50 tx=0x7fcd0801c9e0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd14816640 1 -- 172.21.15.88:0/396876638 shutdown_connections 2023-11-20T07:01:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd14816640 1 --2- 172.21.15.88:0/396876638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd100d3320 0x7fcd100ce4d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd14816640 1 --2- 172.21.15.88:0/396876638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd100cf210 0x7fcd100cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd14816640 1 -- 172.21.15.88:0/396876638 >> 172.21.15.88:0/396876638 conn(0x7fcd100d2800 msgr2=0x7fcd100d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd14816640 1 -- 172.21.15.88:0/396876638 shutdown_connections 2023-11-20T07:01:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd14816640 1 -- 172.21.15.88:0/396876638 wait complete. 2023-11-20T07:01:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd14816640 1 Processor -- start 2023-11-20T07:01:37.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.826+0000 7fcd14816640 1 -- start start 2023-11-20T07:01:37.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd14816640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd100cf210 0x7fcd101425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:37.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd14816640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd100d3320 0x7fcd1015efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:37.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd14816640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd1015cdc0 0x7fcd1015f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:37.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd14816640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1015eb50 con 0x7fcd100cf210 2023-11-20T07:01:37.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd14816640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1015e290 con 0x7fcd100d3320 2023-11-20T07:01:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd14816640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1015e500 con 0x7fcd1015cdc0 2023-11-20T07:01:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd0ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd100cf210 0x7fcd101425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd0ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd100cf210 0x7fcd101425e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38476/0 (socket says 172.21.15.88:38476) 2023-11-20T07:01:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd0ed9d640 1 -- 172.21.15.88:0/894343033 learned_addr learned my addr 172.21.15.88:0/894343033 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd0f59e640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd1015cdc0 0x7fcd1015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd07fff640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd100d3320 0x7fcd1015efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd0ed9d640 1 -- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd1015cdc0 msgr2=0x7fcd1015f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd0ed9d640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd1015cdc0 0x7fcd1015f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd0ed9d640 1 -- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd100d3320 msgr2=0x7fcd1015efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd0ed9d640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd100d3320 0x7fcd1015efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd0ed9d640 1 -- 172.21.15.88:0/894343033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd08009b30 con 0x7fcd100cf210 2023-11-20T07:01:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd0ed9d640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd100cf210 0x7fcd101425e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000e9b0 tx=0x7fcd0000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd077fe640 1 -- 172.21.15.88:0/894343033 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00009670 con 0x7fcd100cf210 2023-11-20T07:01:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd077fe640 1 -- 172.21.15.88:0/894343033 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0000c9a0 con 0x7fcd100cf210 2023-11-20T07:01:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd077fe640 1 -- 172.21.15.88:0/894343033 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000cd10 con 0x7fcd100cf210 2023-11-20T07:01:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd14816640 1 -- 172.21.15.88:0/894343033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1015e7e0 con 0x7fcd100cf210 2023-11-20T07:01:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd14816640 1 -- 172.21.15.88:0/894343033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd100cc880 con 0x7fcd100cf210 2023-11-20T07:01:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd14816640 1 -- 172.21.15.88:0/894343033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1004e9c0 con 0x7fcd100cf210 2023-11-20T07:01:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.830+0000 7fcd077fe640 1 -- 172.21.15.88:0/894343033 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcd00013470 con 0x7fcd100cf210 2023-11-20T07:01:37.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.834+0000 7fcd077fe640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fccf00664d0 0x7fccf0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:37.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.834+0000 7fcd077fe640 1 -- 172.21.15.88:0/894343033 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcd000847b0 con 0x7fcd100cf210 2023-11-20T07:01:37.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.834+0000 7fcd07fff640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fccf00664d0 0x7fccf0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:37.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.834+0000 7fcd07fff640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fccf00664d0 0x7fccf0068990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcd10145790 tx=0x7fccf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:37.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.838+0000 7fcd077fe640 1 -- 172.21.15.88:0/894343033 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcd00051880 con 0x7fcd100cf210 2023-11-20T07:01:37.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 -- 172.21.15.88:0/894343033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd100d0bc0 con 0x7fcd100cf210 2023-11-20T07:01:37.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd077fe640 1 -- 172.21.15.88:0/894343033 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd00017020 con 0x7fcd100cf210 2023-11-20T07:01:37.987 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:37.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 -- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fccf00664d0 msgr2=0x7fccf0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:37.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fccf00664d0 0x7fccf0068990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcd10145790 tx=0x7fccf8009040 comp rx=0 tx=0).stop 2023-11-20T07:01:37.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 -- 172.21.15.88:0/894343033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd100cf210 msgr2=0x7fcd101425e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:37.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd100cf210 0x7fcd101425e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000e9b0 tx=0x7fcd0000ee70 comp rx=0 tx=0).stop 2023-11-20T07:01:37.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 -- 172.21.15.88:0/894343033 shutdown_connections 2023-11-20T07:01:37.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fccf00664d0 0x7fccf0068990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd1015cdc0 0x7fcd1015f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd100d3320 0x7fcd1015efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 --2- 172.21.15.88:0/894343033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcd100cf210 0x7fcd101425e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:37.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 -- 172.21.15.88:0/894343033 >> 172.21.15.88:0/894343033 conn(0x7fcd100d2800 msgr2=0x7fcd1006c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:37.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 -- 172.21.15.88:0/894343033 shutdown_connections 2023-11-20T07:01:37.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:37.986+0000 7fcd14816640 1 -- 172.21.15.88:0/894343033 wait complete. 2023-11-20T07:01:38.008 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:38.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.146+0000 7f609f38d640 1 Processor -- start 2023-11-20T07:01:38.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.146+0000 7f609f38d640 1 -- start start 2023-11-20T07:01:38.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609f38d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f60980d0210 0x7f60980d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609f38d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60980b84e0 0x7f60980b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609f38d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60980d1670 con 0x7f609815cba0 2023-11-20T07:01:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609f38d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60980d1460 con 0x7f60980d0210 2023-11-20T07:01:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609f38d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60980d1950 con 0x7f60980b84e0 2023-11-20T07:01:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609d129640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f609815cba0 0x7f60980cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34620/0 (socket says 172.21.15.88:34620) 2023-11-20T07:01:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609d129640 1 -- 172.21.15.88:0/2596092691 learned_addr learned my addr 172.21.15.88:0/2596092691 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609d92a640 1 --2- 172.21.15.88:0/2596092691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60980b84e0 0x7f60980b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609c928640 1 --2- 172.21.15.88:0/2596092691 >> v2:172.21.15.175:3300/0 conn(0x7f60980d0210 0x7f60980d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f608ffff640 1 -- 172.21.15.88:0/2596092691 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813695187 0 0) 0x7f60980d1670 con 0x7f609815cba0 2023-11-20T07:01:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f608ffff640 1 -- 172.21.15.88:0/2596092691 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6084003530 con 0x7f609815cba0 2023-11-20T07:01:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609d92a640 1 -- 172.21.15.88:0/2596092691 >> v2:172.21.15.175:3300/0 conn(0x7f60980d0210 msgr2=0x7f60980d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609d92a640 1 --2- 172.21.15.88:0/2596092691 >> v2:172.21.15.175:3300/0 conn(0x7f60980d0210 0x7f60980d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609d92a640 1 -- 172.21.15.88:0/2596092691 >> v1:172.21.15.88:6789/0 conn(0x7f609815cba0 legacy=0x7f60980cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f608ffff640 1 -- 172.21.15.88:0/2596092691 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1859147970 0 0) 0x7f6084003530 con 0x7f609815cba0 2023-11-20T07:01:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609d92a640 1 -- 172.21.15.88:0/2596092691 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60980d1c30 con 0x7f60980b84e0 2023-11-20T07:01:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.150+0000 7f609c928640 1 --2- 172.21.15.88:0/2596092691 >> v2:172.21.15.175:3300/0 conn(0x7f60980d0210 0x7f60980d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:38.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f609d92a640 1 --2- 172.21.15.88:0/2596092691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60980b84e0 0x7f60980b5cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6090009d90 tx=0x7f609001c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=954ad73573c4faa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:38.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f608ffff640 1 -- 172.21.15.88:0/2596092691 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094001680 con 0x7f60980b84e0 2023-11-20T07:01:38.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f608ffff640 1 -- 172.21.15.88:0/2596092691 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60900a5670 con 0x7f60980b84e0 2023-11-20T07:01:38.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f608ffff640 1 -- 172.21.15.88:0/2596092691 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60900a5a00 con 0x7f60980b84e0 2023-11-20T07:01:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f609f38d640 1 -- 172.21.15.88:0/2596092691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60980b84e0 msgr2=0x7f60980b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f609f38d640 1 --2- 172.21.15.88:0/2596092691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60980b84e0 0x7f60980b5cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6090009d90 tx=0x7f609001c870 comp rx=0 tx=0).stop 2023-11-20T07:01:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f609f38d640 1 -- 172.21.15.88:0/2596092691 shutdown_connections 2023-11-20T07:01:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f609f38d640 1 --2- 172.21.15.88:0/2596092691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60980b84e0 0x7f60980b5cf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f609f38d640 1 --2- 172.21.15.88:0/2596092691 >> v2:172.21.15.175:3300/0 conn(0x7f60980d0210 0x7f60980d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f609f38d640 1 -- 172.21.15.88:0/2596092691 >> 172.21.15.88:0/2596092691 conn(0x7f60980719c0 msgr2=0x7f6098071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f609f38d640 1 -- 172.21.15.88:0/2596092691 shutdown_connections 2023-11-20T07:01:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f609f38d640 1 -- 172.21.15.88:0/2596092691 wait complete. 2023-11-20T07:01:38.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f609f38d640 1 Processor -- start 2023-11-20T07:01:38.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.154+0000 7f609f38d640 1 -- start start 2023-11-20T07:01:38.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609f38d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60980b84e0 0x7f60981550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609f38d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60980d0210 0x7f6098148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609f38d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609815cba0 0x7f6098148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609f38d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60980ca8e0 con 0x7f609815cba0 2023-11-20T07:01:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609f38d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6098148880 con 0x7f60980d0210 2023-11-20T07:01:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609f38d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60980cbbc0 con 0x7f60980b84e0 2023-11-20T07:01:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609d92a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609815cba0 0x7f6098148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609d92a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609815cba0 0x7f6098148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38492/0 (socket says 172.21.15.88:38492) 2023-11-20T07:01:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609d92a640 1 -- 172.21.15.88:0/2595888008 learned_addr learned my addr 172.21.15.88:0/2595888008 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609c928640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60980d0210 0x7f6098148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609d92a640 1 -- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60980b84e0 msgr2=0x7f60981550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609d129640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60980b84e0 0x7f60981550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609d92a640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60980b84e0 0x7f60981550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609d92a640 1 -- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60980d0210 msgr2=0x7f6098148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609d92a640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60980d0210 0x7f6098148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609d92a640 1 -- 172.21.15.88:0/2595888008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6088009420 con 0x7f609815cba0 2023-11-20T07:01:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609c928640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60980d0210 0x7f6098148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609d129640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60980b84e0 0x7f60981550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:38.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609d92a640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609815cba0 0x7f6098148f80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f60900b0040 tx=0x7f6090019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:38.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f608dffb640 1 -- 172.21.15.88:0/2595888008 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60900ad850 con 0x7f609815cba0 2023-11-20T07:01:38.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f608dffb640 1 -- 172.21.15.88:0/2595888008 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60900ad9b0 con 0x7f609815cba0 2023-11-20T07:01:38.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609f38d640 1 -- 172.21.15.88:0/2595888008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6090009a70 con 0x7f609815cba0 2023-11-20T07:01:38.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f608dffb640 1 -- 172.21.15.88:0/2595888008 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60900add60 con 0x7f609815cba0 2023-11-20T07:01:38.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609f38d640 1 -- 172.21.15.88:0/2595888008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609815aa60 con 0x7f609815cba0 2023-11-20T07:01:38.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f609f38d640 1 -- 172.21.15.88:0/2595888008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609804e170 con 0x7f609815cba0 2023-11-20T07:01:38.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.158+0000 7f608dffb640 1 -- 172.21.15.88:0/2595888008 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f60900b4050 con 0x7f609815cba0 2023-11-20T07:01:38.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.162+0000 7f608dffb640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f607c0664d0 0x7f607c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.162+0000 7f608dffb640 1 -- 172.21.15.88:0/2595888008 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f609011ec30 con 0x7f609815cba0 2023-11-20T07:01:38.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.162+0000 7f609d129640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f607c0664d0 0x7f607c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.162+0000 7f609d129640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f607c0664d0 0x7f607c068990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6094005890 tx=0x7f6094009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:38.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.166+0000 7f608dffb640 1 -- 172.21.15.88:0/2595888008 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f60900ebce0 con 0x7f609815cba0 2023-11-20T07:01:38.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.314+0000 7f609f38d640 1 -- 172.21.15.88:0/2595888008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f60980cbe10 con 0x7f609815cba0 2023-11-20T07:01:38.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.314+0000 7f608dffb640 1 -- 172.21.15.88:0/2595888008 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f60900b2020 con 0x7f609815cba0 2023-11-20T07:01:38.315 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:38.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.314+0000 7f609f38d640 1 -- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f607c0664d0 msgr2=0x7f607c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.314+0000 7f609f38d640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f607c0664d0 0x7f607c068990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6094005890 tx=0x7f6094009040 comp rx=0 tx=0).stop 2023-11-20T07:01:38.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.314+0000 7f609f38d640 1 -- 172.21.15.88:0/2595888008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609815cba0 msgr2=0x7f6098148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.314+0000 7f609f38d640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609815cba0 0x7f6098148f80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f60900b0040 tx=0x7f6090019610 comp rx=0 tx=0).stop 2023-11-20T07:01:38.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.314+0000 7f609f38d640 1 -- 172.21.15.88:0/2595888008 shutdown_connections 2023-11-20T07:01:38.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.314+0000 7f609f38d640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f607c0664d0 0x7f607c068990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.314+0000 7f609f38d640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609815cba0 0x7f6098148f80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.314+0000 7f609f38d640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60980d0210 0x7f6098148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.314+0000 7f609f38d640 1 --2- 172.21.15.88:0/2595888008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60980b84e0 0x7f60981550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.314+0000 7f609f38d640 1 -- 172.21.15.88:0/2595888008 >> 172.21.15.88:0/2595888008 conn(0x7f60980719c0 msgr2=0x7f60980728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:38.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.318+0000 7f609f38d640 1 -- 172.21.15.88:0/2595888008 shutdown_connections 2023-11-20T07:01:38.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.318+0000 7f609f38d640 1 -- 172.21.15.88:0/2595888008 wait complete. 2023-11-20T07:01:38.337 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:38.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f652abf5640 1 Processor -- start 2023-11-20T07:01:38.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f652abf5640 1 -- start start 2023-11-20T07:01:38.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f652abf5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652415cba0 0x7f65240d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f652abf5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65240b84e0 0x7f65240cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f652abf5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f65240d0040 0x7f65240d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f652abf5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65240d1460 con 0x7f65240b84e0 2023-11-20T07:01:38.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f652abf5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65240d04b0 con 0x7f65240d0040 2023-11-20T07:01:38.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f652abf5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65240d1670 con 0x7f652415cba0 2023-11-20T07:01:38.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f6523fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65240b84e0 0x7f65240cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f6523fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65240b84e0 0x7f65240cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38506/0 (socket says 172.21.15.88:38506) 2023-11-20T07:01:38.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f6523fff640 1 -- 172.21.15.88:0/1256111778 learned_addr learned my addr 172.21.15.88:0/1256111778 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:38.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f6528991640 1 --2- 172.21.15.88:0/1256111778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652415cba0 0x7f65240d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f6529192640 1 --2- 172.21.15.88:0/1256111778 >> v2:172.21.15.175:3300/0 conn(0x7f65240d0040 0x7f65240d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f6523fff640 1 -- 172.21.15.88:0/1256111778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652415cba0 msgr2=0x7f65240d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:38.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f6523fff640 1 --2- 172.21.15.88:0/1256111778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652415cba0 0x7f65240d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f6523fff640 1 -- 172.21.15.88:0/1256111778 >> v2:172.21.15.175:3300/0 conn(0x7f65240d0040 msgr2=0x7f65240d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:38.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f6523fff640 1 --2- 172.21.15.88:0/1256111778 >> v2:172.21.15.175:3300/0 conn(0x7f65240d0040 0x7f65240d2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.478+0000 7f6523fff640 1 -- 172.21.15.88:0/1256111778 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65240d1950 con 0x7f65240b84e0 2023-11-20T07:01:38.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f6523fff640 1 --2- 172.21.15.88:0/1256111778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65240b84e0 0x7f65240cfb00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f65240cf040 tx=0x7f651001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e15699da76ec3b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:38.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f65237fe640 1 -- 172.21.15.88:0/1256111778 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65100ab600 con 0x7f65240b84e0 2023-11-20T07:01:38.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f65237fe640 1 -- 172.21.15.88:0/1256111778 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65100a7050 con 0x7f65240b84e0 2023-11-20T07:01:38.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f65237fe640 1 -- 172.21.15.88:0/1256111778 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65100ab980 con 0x7f65240b84e0 2023-11-20T07:01:38.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f652abf5640 1 -- 172.21.15.88:0/1256111778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65240b84e0 msgr2=0x7f65240cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f652abf5640 1 --2- 172.21.15.88:0/1256111778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65240b84e0 0x7f65240cfb00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f65240cf040 tx=0x7f651001c240 comp rx=0 tx=0).stop 2023-11-20T07:01:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f652abf5640 1 -- 172.21.15.88:0/1256111778 shutdown_connections 2023-11-20T07:01:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f652abf5640 1 --2- 172.21.15.88:0/1256111778 >> v2:172.21.15.175:3300/0 conn(0x7f65240d0040 0x7f65240d2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f652abf5640 1 --2- 172.21.15.88:0/1256111778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65240b84e0 0x7f65240cfb00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f652abf5640 1 --2- 172.21.15.88:0/1256111778 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652415cba0 0x7f65240d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f652abf5640 1 -- 172.21.15.88:0/1256111778 >> 172.21.15.88:0/1256111778 conn(0x7f65240719c0 msgr2=0x7f6524071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f652abf5640 1 -- 172.21.15.88:0/1256111778 shutdown_connections 2023-11-20T07:01:38.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.482+0000 7f652abf5640 1 -- 172.21.15.88:0/1256111778 wait complete. 2023-11-20T07:01:38.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f652abf5640 1 Processor -- start 2023-11-20T07:01:38.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f652abf5640 1 -- start start 2023-11-20T07:01:38.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f652abf5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65240b84e0 0x7f65240c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f652abf5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65240d0040 0x7f6524151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f652abf5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652415cba0 0x7f65240c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f652abf5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652415f450 con 0x7f65240b84e0 2023-11-20T07:01:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f652abf5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652415f730 con 0x7f65240d0040 2023-11-20T07:01:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f652abf5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652415fa10 con 0x7f652415cba0 2023-11-20T07:01:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f6528991640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65240b84e0 0x7f65240c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f6528991640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65240b84e0 0x7f65240c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38508/0 (socket says 172.21.15.88:38508) 2023-11-20T07:01:38.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f6528991640 1 -- 172.21.15.88:0/2041482659 learned_addr learned my addr 172.21.15.88:0/2041482659 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f6523fff640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65240d0040 0x7f6524151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f6529192640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652415cba0 0x7f65240c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f6528991640 1 -- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652415cba0 msgr2=0x7f65240c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f6528991640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652415cba0 0x7f65240c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f6528991640 1 -- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65240d0040 msgr2=0x7f6524151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f6528991640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65240d0040 0x7f6524151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f6528991640 1 -- 172.21.15.88:0/2041482659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65100094d0 con 0x7f65240b84e0 2023-11-20T07:01:38.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f6528991640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65240b84e0 0x7f65240c5390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f651800efc0 tx=0x7f651800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:38.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f65217fa640 1 -- 172.21.15.88:0/2041482659 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6518009b80 con 0x7f65240b84e0 2023-11-20T07:01:38.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f65217fa640 1 -- 172.21.15.88:0/2041482659 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651800f040 con 0x7f65240b84e0 2023-11-20T07:01:38.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f652abf5640 1 -- 172.21.15.88:0/2041482659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652415fcf0 con 0x7f65240b84e0 2023-11-20T07:01:38.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f65217fa640 1 -- 172.21.15.88:0/2041482659 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65180146a0 con 0x7f65240b84e0 2023-11-20T07:01:38.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f652abf5640 1 -- 172.21.15.88:0/2041482659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652415ffd0 con 0x7f65240b84e0 2023-11-20T07:01:38.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.486+0000 7f652abf5640 1 -- 172.21.15.88:0/2041482659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652404e170 con 0x7f65240b84e0 2023-11-20T07:01:38.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.490+0000 7f65217fa640 1 -- 172.21.15.88:0/2041482659 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6518014800 con 0x7f65240b84e0 2023-11-20T07:01:38.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.490+0000 7f65217fa640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f65080664a0 0x7f6508068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.490+0000 7f65217fa640 1 -- 172.21.15.88:0/2041482659 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6518084ce0 con 0x7f65240b84e0 2023-11-20T07:01:38.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.490+0000 7f6523fff640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f65080664a0 0x7f6508068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.490+0000 7f6523fff640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f65080664a0 0x7f6508068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f65100ad000 tx=0x7f6510008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:38.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.494+0000 7f65217fa640 1 -- 172.21.15.88:0/2041482659 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6518051db0 con 0x7f65240b84e0 2023-11-20T07:01:38.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.646+0000 7f652abf5640 1 -- 172.21.15.88:0/2041482659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65240b7c40 con 0x7f65240b84e0 2023-11-20T07:01:38.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.646+0000 7f65217fa640 1 -- 172.21.15.88:0/2041482659 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65180553d0 con 0x7f65240b84e0 2023-11-20T07:01:38.649 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:38.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.650+0000 7f652abf5640 1 -- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f65080664a0 msgr2=0x7f6508068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.650+0000 7f652abf5640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f65080664a0 0x7f6508068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f65100ad000 tx=0x7f6510008040 comp rx=0 tx=0).stop 2023-11-20T07:01:38.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.650+0000 7f652abf5640 1 -- 172.21.15.88:0/2041482659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65240b84e0 msgr2=0x7f65240c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.650+0000 7f652abf5640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65240b84e0 0x7f65240c5390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f651800efc0 tx=0x7f651800c490 comp rx=0 tx=0).stop 2023-11-20T07:01:38.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.650+0000 7f652abf5640 1 -- 172.21.15.88:0/2041482659 shutdown_connections 2023-11-20T07:01:38.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.650+0000 7f652abf5640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f65080664a0 0x7f6508068960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.650+0000 7f652abf5640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652415cba0 0x7f65240c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.650+0000 7f652abf5640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65240d0040 0x7f6524151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.650+0000 7f652abf5640 1 --2- 172.21.15.88:0/2041482659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65240b84e0 0x7f65240c5390 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.650+0000 7f652abf5640 1 -- 172.21.15.88:0/2041482659 >> 172.21.15.88:0/2041482659 conn(0x7f65240719c0 msgr2=0x7f6524157490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:38.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.650+0000 7f652abf5640 1 -- 172.21.15.88:0/2041482659 shutdown_connections 2023-11-20T07:01:38.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.650+0000 7f652abf5640 1 -- 172.21.15.88:0/2041482659 wait complete. 2023-11-20T07:01:38.670 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:38.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6902ad6640 1 Processor -- start 2023-11-20T07:01:38.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6902ad6640 1 -- start start 2023-11-20T07:01:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6902ad6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f68fc15cba0 0x7f68fc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6902ad6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0d0210 0x7f68fc0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6902ad6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc0d1670 con 0x7f68fc0b84e0 2023-11-20T07:01:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6902ad6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc0d1460 con 0x7f68fc15cba0 2023-11-20T07:01:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6902ad6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0d1950 con 0x7f68fc0d0210 2023-11-20T07:01:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6900872640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f68fc15cba0 0x7f68fc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6901073640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0d0210 0x7f68fc0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f68f3fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f68fc0b84e0 0x7f68fc0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:38818/0 (socket says 172.21.15.88:38818) 2023-11-20T07:01:38.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f68f3fff640 1 -- 172.21.15.88:0/370835805 learned_addr learned my addr 172.21.15.88:0/370835805 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:38.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f68f37fe640 1 -- 172.21.15.88:0/370835805 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421124607 0 0) 0x7f68fc0d1670 con 0x7f68fc0b84e0 2023-11-20T07:01:38.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f68f37fe640 1 -- 172.21.15.88:0/370835805 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e4003530 con 0x7f68fc0b84e0 2023-11-20T07:01:38.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6900872640 1 -- 172.21.15.88:0/370835805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0d0210 msgr2=0x7f68fc0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6900872640 1 --2- 172.21.15.88:0/370835805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0d0210 0x7f68fc0b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6900872640 1 -- 172.21.15.88:0/370835805 >> v1:172.21.15.175:6789/0 conn(0x7f68fc0b84e0 legacy=0x7f68fc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6900872640 1 -- 172.21.15.88:0/370835805 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc0d1c30 con 0x7f68fc15cba0 2023-11-20T07:01:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.810+0000 7f6901073640 1 --2- 172.21.15.88:0/370835805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0d0210 0x7f68fc0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:38.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.814+0000 7f6900872640 1 --2- 172.21.15.88:0/370835805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc15cba0 0x7f68fc0d0f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f68f80097c0 tx=0x7f68f801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3328d54aaf1dced server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:38.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.814+0000 7f68f37fe640 1 -- 172.21.15.88:0/370835805 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f80ab680 con 0x7f68fc15cba0 2023-11-20T07:01:38.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.814+0000 7f68f37fe640 1 -- 172.21.15.88:0/370835805 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f80ab7e0 con 0x7f68fc15cba0 2023-11-20T07:01:38.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.814+0000 7f68f37fe640 1 -- 172.21.15.88:0/370835805 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f80abb70 con 0x7f68fc15cba0 2023-11-20T07:01:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.814+0000 7f6902ad6640 1 -- 172.21.15.88:0/370835805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc15cba0 msgr2=0x7f68fc0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.814+0000 7f6902ad6640 1 --2- 172.21.15.88:0/370835805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc15cba0 0x7f68fc0d0f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f68f80097c0 tx=0x7f68f801c480 comp rx=0 tx=0).stop 2023-11-20T07:01:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.814+0000 7f6902ad6640 1 -- 172.21.15.88:0/370835805 shutdown_connections 2023-11-20T07:01:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.814+0000 7f6902ad6640 1 --2- 172.21.15.88:0/370835805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0d0210 0x7f68fc0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.814+0000 7f6902ad6640 1 --2- 172.21.15.88:0/370835805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc15cba0 0x7f68fc0d0f20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.814+0000 7f6902ad6640 1 -- 172.21.15.88:0/370835805 >> 172.21.15.88:0/370835805 conn(0x7f68fc0719c0 msgr2=0x7f68fc071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.814+0000 7f6902ad6640 1 -- 172.21.15.88:0/370835805 shutdown_connections 2023-11-20T07:01:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.814+0000 7f6902ad6640 1 -- 172.21.15.88:0/370835805 wait complete. 2023-11-20T07:01:38.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6902ad6640 1 Processor -- start 2023-11-20T07:01:38.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6902ad6640 1 -- start start 2023-11-20T07:01:38.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6902ad6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0b84e0 0x7f68fc156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6902ad6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68fc0d0210 0x7f68fc06b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6902ad6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc15cba0 0x7f68fc14fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6902ad6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc156ef0 con 0x7f68fc0d0210 2023-11-20T07:01:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6902ad6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0c6dc0 con 0x7f68fc15cba0 2023-11-20T07:01:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6902ad6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0c70a0 con 0x7f68fc0b84e0 2023-11-20T07:01:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f68f3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68fc0d0210 0x7f68fc06b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f68f3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68fc0d0210 0x7f68fc06b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38510/0 (socket says 172.21.15.88:38510) 2023-11-20T07:01:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f68f3fff640 1 -- 172.21.15.88:0/2400954623 learned_addr learned my addr 172.21.15.88:0/2400954623 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:38.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6901073640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc15cba0 0x7f68fc14fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6900872640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0b84e0 0x7f68fc156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f68f3fff640 1 -- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0b84e0 msgr2=0x7f68fc156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f68f3fff640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0b84e0 0x7f68fc156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f68f3fff640 1 -- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc15cba0 msgr2=0x7f68fc14fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f68f3fff640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc15cba0 0x7f68fc14fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f68f3fff640 1 -- 172.21.15.88:0/2400954623 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f4009a70 con 0x7f68fc0d0210 2023-11-20T07:01:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6900872640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0b84e0 0x7f68fc156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f68f3fff640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68fc0d0210 0x7f68fc06b550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c4d0 tx=0x7f68ec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f68f17fa640 1 -- 172.21.15.88:0/2400954623 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec005cf0 con 0x7f68fc0d0210 2023-11-20T07:01:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f68f17fa640 1 -- 172.21.15.88:0/2400954623 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec005e50 con 0x7f68fc0d0210 2023-11-20T07:01:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f68f17fa640 1 -- 172.21.15.88:0/2400954623 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec007270 con 0x7f68fc0d0210 2023-11-20T07:01:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6902ad6640 1 -- 172.21.15.88:0/2400954623 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f8009420 con 0x7f68fc0d0210 2023-11-20T07:01:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.818+0000 7f6902ad6640 1 -- 172.21.15.88:0/2400954623 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc0c7660 con 0x7f68fc0d0210 2023-11-20T07:01:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.822+0000 7f6902ad6640 1 -- 172.21.15.88:0/2400954623 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc0c7850 con 0x7f68fc0d0210 2023-11-20T07:01:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.822+0000 7f68f17fa640 1 -- 172.21.15.88:0/2400954623 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f68ec0073d0 con 0x7f68fc0d0210 2023-11-20T07:01:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.822+0000 7f68f17fa640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f68e80664a0 0x7f68e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.822+0000 7f68f17fa640 1 -- 172.21.15.88:0/2400954623 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f68ec083660 con 0x7f68fc0d0210 2023-11-20T07:01:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.822+0000 7f6900872640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f68e80664a0 0x7f68e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.822+0000 7f6900872640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f68e80664a0 0x7f68e8068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68f80af000 tx=0x7f68f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.826+0000 7f68f17fa640 1 -- 172.21.15.88:0/2400954623 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f68ec050860 con 0x7f68fc0d0210 2023-11-20T07:01:38.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 -- 172.21.15.88:0/2400954623 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f68fc04e170 con 0x7f68fc0d0210 2023-11-20T07:01:38.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f68f17fa640 1 -- 172.21.15.88:0/2400954623 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f68ec053e80 con 0x7f68fc0d0210 2023-11-20T07:01:38.974 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:38.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 -- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f68e80664a0 msgr2=0x7f68e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f68e80664a0 0x7f68e8068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68f80af000 tx=0x7f68f8008040 comp rx=0 tx=0).stop 2023-11-20T07:01:38.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 -- 172.21.15.88:0/2400954623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68fc0d0210 msgr2=0x7f68fc06b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:38.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68fc0d0210 0x7f68fc06b550 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c4d0 tx=0x7f68ec00c990 comp rx=0 tx=0).stop 2023-11-20T07:01:38.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 -- 172.21.15.88:0/2400954623 shutdown_connections 2023-11-20T07:01:38.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f68e80664a0 0x7f68e8068960 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68fc15cba0 0x7f68fc14fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68fc0d0210 0x7f68fc06b550 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 --2- 172.21.15.88:0/2400954623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68fc0b84e0 0x7f68fc156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:38.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 -- 172.21.15.88:0/2400954623 >> 172.21.15.88:0/2400954623 conn(0x7f68fc0719c0 msgr2=0x7f68fc0b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:38.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 -- 172.21.15.88:0/2400954623 shutdown_connections 2023-11-20T07:01:38.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:38.974+0000 7f6902ad6640 1 -- 172.21.15.88:0/2400954623 wait complete. 2023-11-20T07:01:38.995 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.130+0000 7fd822668640 1 Processor -- start 2023-11-20T07:01:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.130+0000 7fd822668640 1 -- start start 2023-11-20T07:01:39.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd822668640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd81c070c40 0x7fd81c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd822668640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd81c0b4020 0x7fd81c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd822668640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81c15be60 con 0x7fd81c0b0620 2023-11-20T07:01:39.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd822668640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81c15b3b0 con 0x7fd81c070c40 2023-11-20T07:01:39.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd822668640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81c15c1f0 con 0x7fd81c0b4020 2023-11-20T07:01:39.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd81bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd81c070c40 0x7fd81c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd81bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd81c070c40 0x7fd81c15ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38518/0 (socket says 172.21.15.88:38518) 2023-11-20T07:01:39.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd820c05640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd81c0b0620 0x7fd81c15c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34622/0 (socket says 172.21.15.88:34622) 2023-11-20T07:01:39.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd81bfff640 1 -- 172.21.15.88:0/1249124310 learned_addr learned my addr 172.21.15.88:0/1249124310 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:39.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd81b7fe640 1 --2- 172.21.15.88:0/1249124310 >> v2:172.21.15.175:3300/0 conn(0x7fd81c0b4020 0x7fd81c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd81bfff640 1 -- 172.21.15.88:0/1249124310 >> v2:172.21.15.175:3300/0 conn(0x7fd81c0b4020 msgr2=0x7fd81c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:39.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd81bfff640 1 --2- 172.21.15.88:0/1249124310 >> v2:172.21.15.175:3300/0 conn(0x7fd81c0b4020 0x7fd81c0b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd81bfff640 1 -- 172.21.15.88:0/1249124310 >> v1:172.21.15.88:6789/0 conn(0x7fd81c0b0620 legacy=0x7fd81c15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd81affd640 1 -- 172.21.15.88:0/1249124310 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100323112 0 0) 0x7fd81c15be60 con 0x7fd81c0b0620 2023-11-20T07:01:39.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.134+0000 7fd81bfff640 1 -- 172.21.15.88:0/1249124310 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c0b0a30 con 0x7fd81c070c40 2023-11-20T07:01:39.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd81bfff640 1 --2- 172.21.15.88:0/1249124310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd81c070c40 0x7fd81c15ae70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0cc1e0 tx=0x7fd80c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bd4bc8da802d84 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:39.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd81affd640 1 -- 172.21.15.88:0/1249124310 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0ab670 con 0x7fd81c070c40 2023-11-20T07:01:39.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd81affd640 1 -- 172.21.15.88:0/1249124310 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c0ab7d0 con 0x7fd81c070c40 2023-11-20T07:01:39.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd81affd640 1 -- 172.21.15.88:0/1249124310 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0abb60 con 0x7fd81c070c40 2023-11-20T07:01:39.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd822668640 1 -- 172.21.15.88:0/1249124310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd81c070c40 msgr2=0x7fd81c15ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd822668640 1 --2- 172.21.15.88:0/1249124310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd81c070c40 0x7fd81c15ae70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0cc1e0 tx=0x7fd80c01c470 comp rx=0 tx=0).stop 2023-11-20T07:01:39.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd822668640 1 -- 172.21.15.88:0/1249124310 shutdown_connections 2023-11-20T07:01:39.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd822668640 1 --2- 172.21.15.88:0/1249124310 >> v2:172.21.15.175:3300/0 conn(0x7fd81c0b4020 0x7fd81c0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd822668640 1 --2- 172.21.15.88:0/1249124310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd81c070c40 0x7fd81c15ae70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd822668640 1 -- 172.21.15.88:0/1249124310 >> 172.21.15.88:0/1249124310 conn(0x7fd81c06c190 msgr2=0x7fd81c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:39.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd822668640 1 -- 172.21.15.88:0/1249124310 shutdown_connections 2023-11-20T07:01:39.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd822668640 1 -- 172.21.15.88:0/1249124310 wait complete. 2023-11-20T07:01:39.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd822668640 1 Processor -- start 2023-11-20T07:01:39.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.138+0000 7fd822668640 1 -- start start 2023-11-20T07:01:39.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd822668640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd81c070c40 0x7fd81c0b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd822668640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd81c0b0620 0x7fd81c145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd822668640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd81c0b4020 0x7fd81c0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd822668640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c145ff0 con 0x7fd81c0b0620 2023-11-20T07:01:39.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd822668640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c0b3800 con 0x7fd81c0b4020 2023-11-20T07:01:39.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd822668640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c0c2620 con 0x7fd81c070c40 2023-11-20T07:01:39.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd81b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd81c0b0620 0x7fd81c145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd81b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd81c0b0620 0x7fd81c145ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38524/0 (socket says 172.21.15.88:38524) 2023-11-20T07:01:39.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd81b7fe640 1 -- 172.21.15.88:0/875185536 learned_addr learned my addr 172.21.15.88:0/875185536 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:39.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd81b7fe640 1 -- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd81c070c40 msgr2=0x7fd81c0b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd81b7fe640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd81c070c40 0x7fd81c0b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd820c05640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd81c0b4020 0x7fd81c0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd81b7fe640 1 -- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd81c0b4020 msgr2=0x7fd81c0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd81b7fe640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd81c0b4020 0x7fd81c0b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd81b7fe640 1 -- 172.21.15.88:0/875185536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c0094d0 con 0x7fd81c0b0620 2023-11-20T07:01:39.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd820c05640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd81c0b4020 0x7fd81c0b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd81b7fe640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd81c0b0620 0x7fd81c145ab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd81000d5f0 tx=0x7fd81000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd818ff9640 1 -- 172.21.15.88:0/875185536 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8100125f0 con 0x7fd81c0b0620 2023-11-20T07:01:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd818ff9640 1 -- 172.21.15.88:0/875185536 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd810012750 con 0x7fd81c0b0620 2023-11-20T07:01:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd822668640 1 -- 172.21.15.88:0/875185536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81c0c2900 con 0x7fd81c0b0620 2023-11-20T07:01:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd818ff9640 1 -- 172.21.15.88:0/875185536 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd810012ae0 con 0x7fd81c0b0620 2023-11-20T07:01:39.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd822668640 1 -- 172.21.15.88:0/875185536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81c146210 con 0x7fd81c0b0620 2023-11-20T07:01:39.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd822668640 1 -- 172.21.15.88:0/875185536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81c074010 con 0x7fd81c0b0620 2023-11-20T07:01:39.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.142+0000 7fd818ff9640 1 -- 172.21.15.88:0/875185536 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd810012c40 con 0x7fd81c0b0620 2023-11-20T07:01:39.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.146+0000 7fd818ff9640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd8080664a0 0x7fd808068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.146+0000 7fd818ff9640 1 -- 172.21.15.88:0/875185536 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd8100847c0 con 0x7fd81c0b0620 2023-11-20T07:01:39.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.146+0000 7fd81bfff640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd8080664a0 0x7fd808068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.146+0000 7fd81bfff640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd8080664a0 0x7fd808068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0af000 tx=0x7fd80c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:39.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.150+0000 7fd818ff9640 1 -- 172.21.15.88:0/875185536 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8100517e0 con 0x7fd81c0b0620 2023-11-20T07:01:39.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.298+0000 7fd822668640 1 -- 172.21.15.88:0/875185536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd81c165280 con 0x7fd81c0b0620 2023-11-20T07:01:39.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd818ff9640 1 -- 172.21.15.88:0/875185536 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7fd810007380 con 0x7fd81c0b0620 2023-11-20T07:01:39.302 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:39.302 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:39.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd822668640 1 -- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd8080664a0 msgr2=0x7fd808068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd822668640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd8080664a0 0x7fd808068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0af000 tx=0x7fd80c008040 comp rx=0 tx=0).stop 2023-11-20T07:01:39.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd822668640 1 -- 172.21.15.88:0/875185536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd81c0b0620 msgr2=0x7fd81c145ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd822668640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd81c0b0620 0x7fd81c145ab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd81000d5f0 tx=0x7fd81000dab0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd822668640 1 -- 172.21.15.88:0/875185536 shutdown_connections 2023-11-20T07:01:39.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd822668640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd8080664a0 0x7fd808068960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd822668640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd81c0b4020 0x7fd81c0b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd822668640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd81c0b0620 0x7fd81c145ab0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd822668640 1 --2- 172.21.15.88:0/875185536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd81c070c40 0x7fd81c0b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd822668640 1 -- 172.21.15.88:0/875185536 >> 172.21.15.88:0/875185536 conn(0x7fd81c06c190 msgr2=0x7fd81c154a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:39.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd822668640 1 -- 172.21.15.88:0/875185536 shutdown_connections 2023-11-20T07:01:39.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.302+0000 7fd822668640 1 -- 172.21.15.88:0/875185536 wait complete. 2023-11-20T07:01:39.323 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:39.324 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.462+0000 7f28a68d6640 1 Processor -- start 2023-11-20T07:01:39.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.462+0000 7f28a68d6640 1 -- start start 2023-11-20T07:01:39.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.466+0000 7f28a68d6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28a006a5a0 0x7f28a006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.466+0000 7f28a68d6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a00b4370 con 0x7f28a00b3f00 2023-11-20T07:01:39.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.466+0000 7f28a68d6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a00b4600 con 0x7f28a0159900 2023-11-20T07:01:39.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.466+0000 7f28a68d6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a00cd740 con 0x7f28a006a5a0 2023-11-20T07:01:39.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.466+0000 7f289f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28a006a5a0 0x7f28a006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.466+0000 7f289f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28a006a5a0 0x7f28a006e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38532/0 (socket says 172.21.15.88:38532) 2023-11-20T07:01:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.466+0000 7f289f7fe640 1 -- 172.21.15.88:0/1384516492 learned_addr learned my addr 172.21.15.88:0/1384516492 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.466+0000 7f28a4e73640 1 --1- 172.21.15.88:0/1384516492 >> v1:172.21.15.88:6789/0 conn(0x7f28a00b3f00 0x7f28a00c9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34628/0 (socket says 172.21.15.88:34628) 2023-11-20T07:01:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.466+0000 7f289f7fe640 1 -- 172.21.15.88:0/1384516492 >> v1:172.21.15.175:6789/0 conn(0x7f28a0159900 legacy=0x7f28a0069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.466+0000 7f289f7fe640 1 -- 172.21.15.88:0/1384516492 >> v1:172.21.15.88:6789/0 conn(0x7f28a00b3f00 legacy=0x7f28a00c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.466+0000 7f289effd640 1 -- 172.21.15.88:0/1384516492 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171362097 0 0) 0x7f28a00b4370 con 0x7f28a00b3f00 2023-11-20T07:01:39.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.466+0000 7f289f7fe640 1 -- 172.21.15.88:0/1384516492 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a00c8dd0 con 0x7f28a006a5a0 2023-11-20T07:01:39.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f289f7fe640 1 --2- 172.21.15.88:0/1384516492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28a006a5a0 0x7f28a006e260 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2894009870 tx=0x7f289401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627bf92c685937fb server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:39.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f289effd640 1 -- 172.21.15.88:0/1384516492 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28940aa670 con 0x7f28a006a5a0 2023-11-20T07:01:39.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f289effd640 1 -- 172.21.15.88:0/1384516492 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28940aa7d0 con 0x7f28a006a5a0 2023-11-20T07:01:39.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f289effd640 1 -- 172.21.15.88:0/1384516492 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28940aab60 con 0x7f28a006a5a0 2023-11-20T07:01:39.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f28a68d6640 1 -- 172.21.15.88:0/1384516492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28a006a5a0 msgr2=0x7f28a006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f28a68d6640 1 --2- 172.21.15.88:0/1384516492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28a006a5a0 0x7f28a006e260 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2894009870 tx=0x7f289401c510 comp rx=0 tx=0).stop 2023-11-20T07:01:39.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f28a68d6640 1 -- 172.21.15.88:0/1384516492 shutdown_connections 2023-11-20T07:01:39.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f28a68d6640 1 --2- 172.21.15.88:0/1384516492 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28a006a5a0 0x7f28a006e260 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f28a68d6640 1 -- 172.21.15.88:0/1384516492 >> 172.21.15.88:0/1384516492 conn(0x7f28a00b0da0 msgr2=0x7f28a00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:39.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f28a68d6640 1 -- 172.21.15.88:0/1384516492 shutdown_connections 2023-11-20T07:01:39.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f28a68d6640 1 -- 172.21.15.88:0/1384516492 wait complete. 2023-11-20T07:01:39.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f28a68d6640 1 Processor -- start 2023-11-20T07:01:39.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.469+0000 7f28a68d6640 1 -- start start 2023-11-20T07:01:39.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f28a68d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28a006a5a0 0x7f28a0156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f28a68d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28a00b3f00 0x7f28a00b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f28a68d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28a0159900 0x7f28a01f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f28a68d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00b1960 con 0x7f28a006a5a0 2023-11-20T07:01:39.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f28a68d6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00b2710 con 0x7f28a00b3f00 2023-11-20T07:01:39.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f28a68d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00b1b90 con 0x7f28a0159900 2023-11-20T07:01:39.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28a006a5a0 0x7f28a0156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28a006a5a0 0x7f28a0156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38538/0 (socket says 172.21.15.88:38538) 2023-11-20T07:01:39.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289ffff640 1 -- 172.21.15.88:0/1096905669 learned_addr learned my addr 172.21.15.88:0/1096905669 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:39.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289f7fe640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28a00b3f00 0x7f28a00b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f28a4e73640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28a0159900 0x7f28a01f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289ffff640 1 -- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28a0159900 msgr2=0x7f28a01f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289ffff640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28a0159900 0x7f28a01f4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289ffff640 1 -- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28a00b3f00 msgr2=0x7f28a00b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289ffff640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28a00b3f00 0x7f28a00b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289ffff640 1 -- 172.21.15.88:0/1096905669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28940094d0 con 0x7f28a006a5a0 2023-11-20T07:01:39.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289ffff640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28a006a5a0 0x7f28a0156f90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f289000c3c0 tx=0x7f289000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:39.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289cff9640 1 -- 172.21.15.88:0/1096905669 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28900052d0 con 0x7f28a006a5a0 2023-11-20T07:01:39.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289cff9640 1 -- 172.21.15.88:0/1096905669 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2890005430 con 0x7f28a006a5a0 2023-11-20T07:01:39.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289cff9640 1 -- 172.21.15.88:0/1096905669 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890003840 con 0x7f28a006a5a0 2023-11-20T07:01:39.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f28a68d6640 1 -- 172.21.15.88:0/1096905669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a00b1e70 con 0x7f28a006a5a0 2023-11-20T07:01:39.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f28a68d6640 1 -- 172.21.15.88:0/1096905669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a00b2430 con 0x7f28a006a5a0 2023-11-20T07:01:39.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f28a68d6640 1 -- 172.21.15.88:0/1096905669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a004e170 con 0x7f28a006a5a0 2023-11-20T07:01:39.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.473+0000 7f289cff9640 1 -- 172.21.15.88:0/1096905669 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f28900039a0 con 0x7f28a006a5a0 2023-11-20T07:01:39.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.477+0000 7f289cff9640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f288c0664a0 0x7f288c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.477+0000 7f289cff9640 1 -- 172.21.15.88:0/1096905669 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2890083810 con 0x7f28a006a5a0 2023-11-20T07:01:39.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.477+0000 7f289f7fe640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f288c0664a0 0x7f288c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.477+0000 7f289f7fe640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f288c0664a0 0x7f288c068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f28940ae000 tx=0x7f28940b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:39.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.481+0000 7f289cff9640 1 -- 172.21.15.88:0/1096905669 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2890050850 con 0x7f28a006a5a0 2023-11-20T07:01:39.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.629+0000 7f28a68d6640 1 -- 172.21.15.88:0/1096905669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28a006d330 con 0x7f28a006a5a0 2023-11-20T07:01:39.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.629+0000 7f289cff9640 1 -- 172.21.15.88:0/1096905669 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2890017020 con 0x7f28a006a5a0 2023-11-20T07:01:39.631 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:39.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.633+0000 7f28a68d6640 1 -- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f288c0664a0 msgr2=0x7f288c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.633+0000 7f28a68d6640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f288c0664a0 0x7f288c068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f28940ae000 tx=0x7f28940b5040 comp rx=0 tx=0).stop 2023-11-20T07:01:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.633+0000 7f28a68d6640 1 -- 172.21.15.88:0/1096905669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28a006a5a0 msgr2=0x7f28a0156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.633+0000 7f28a68d6640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28a006a5a0 0x7f28a0156f90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f289000c3c0 tx=0x7f289000c880 comp rx=0 tx=0).stop 2023-11-20T07:01:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.633+0000 7f28a68d6640 1 -- 172.21.15.88:0/1096905669 shutdown_connections 2023-11-20T07:01:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.633+0000 7f28a68d6640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f288c0664a0 0x7f288c068960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.633+0000 7f28a68d6640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28a0159900 0x7f28a01f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.633+0000 7f28a68d6640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28a00b3f00 0x7f28a00b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.633+0000 7f28a68d6640 1 --2- 172.21.15.88:0/1096905669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28a006a5a0 0x7f28a0156f90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.633+0000 7f28a68d6640 1 -- 172.21.15.88:0/1096905669 >> 172.21.15.88:0/1096905669 conn(0x7f28a00b0da0 msgr2=0x7f28a00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:39.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.633+0000 7f28a68d6640 1 -- 172.21.15.88:0/1096905669 shutdown_connections 2023-11-20T07:01:39.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.633+0000 7f28a68d6640 1 -- 172.21.15.88:0/1096905669 wait complete. 2023-11-20T07:01:39.654 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:39.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1906c68640 1 Processor -- start 2023-11-20T07:01:39.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1906c68640 1 -- start start 2023-11-20T07:01:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1906c68640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f190015cba0 0x7f19000d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1906c68640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f19000d0210 0x7f19000b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1906c68640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19000d1670 con 0x7f19000b84e0 2023-11-20T07:01:39.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1906c68640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19000d1460 con 0x7f19000d0210 2023-11-20T07:01:39.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1906c68640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19000d1950 con 0x7f190015cba0 2023-11-20T07:01:39.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1905205640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f19000d0210 0x7f19000b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1905205640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f19000d0210 0x7f19000b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38554/0 (socket says 172.21.15.88:38554) 2023-11-20T07:01:39.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1905205640 1 -- 172.21.15.88:0/1169058395 learned_addr learned my addr 172.21.15.88:0/1169058395 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:39.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1904a04640 1 --2- 172.21.15.88:0/1169058395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f190015cba0 0x7f19000d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1905205640 1 -- 172.21.15.88:0/1169058395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f190015cba0 msgr2=0x7f19000d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1905205640 1 --2- 172.21.15.88:0/1169058395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f190015cba0 0x7f19000d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1905205640 1 -- 172.21.15.88:0/1169058395 >> v1:172.21.15.175:6789/0 conn(0x7f19000b84e0 legacy=0x7f19000cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.793+0000 7f1905205640 1 -- 172.21.15.88:0/1169058395 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000d1c30 con 0x7f19000d0210 2023-11-20T07:01:39.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.797+0000 7f1905205640 1 --2- 172.21.15.88:0/1169058395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19000d0210 0x7f19000b5cf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009e50 tx=0x7f18f801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d0e1747dc32286 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:39.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.797+0000 7f18f77fe640 1 -- 172.21.15.88:0/1169058395 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80a58e0 con 0x7f19000d0210 2023-11-20T07:01:39.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.797+0000 7f18f77fe640 1 -- 172.21.15.88:0/1169058395 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f80a5a40 con 0x7f19000d0210 2023-11-20T07:01:39.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.797+0000 7f18f77fe640 1 -- 172.21.15.88:0/1169058395 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80a5dd0 con 0x7f19000d0210 2023-11-20T07:01:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.797+0000 7f1906c68640 1 -- 172.21.15.88:0/1169058395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19000d0210 msgr2=0x7f19000b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.797+0000 7f1906c68640 1 --2- 172.21.15.88:0/1169058395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19000d0210 0x7f19000b5cf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009e50 tx=0x7f18f801ca10 comp rx=0 tx=0).stop 2023-11-20T07:01:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.797+0000 7f1906c68640 1 -- 172.21.15.88:0/1169058395 shutdown_connections 2023-11-20T07:01:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.797+0000 7f1906c68640 1 --2- 172.21.15.88:0/1169058395 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19000d0210 0x7f19000b5cf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.797+0000 7f1906c68640 1 --2- 172.21.15.88:0/1169058395 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f190015cba0 0x7f19000d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.797+0000 7f1906c68640 1 -- 172.21.15.88:0/1169058395 >> 172.21.15.88:0/1169058395 conn(0x7f19000719c0 msgr2=0x7f1900071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.797+0000 7f1906c68640 1 -- 172.21.15.88:0/1169058395 shutdown_connections 2023-11-20T07:01:39.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.797+0000 7f1906c68640 1 -- 172.21.15.88:0/1169058395 wait complete. 2023-11-20T07:01:39.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1906c68640 1 Processor -- start 2023-11-20T07:01:39.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1906c68640 1 -- start start 2023-11-20T07:01:39.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1906c68640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19000b84e0 0x7f1900156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1906c68640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19000d0210 0x7f19000c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1906c68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f190015cba0 0x7f190014a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1906c68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000ca160 con 0x7f190015cba0 2023-11-20T07:01:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1906c68640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000cafa0 con 0x7f19000d0210 2023-11-20T07:01:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1906c68640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19000ca390 con 0x7f19000b84e0 2023-11-20T07:01:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1905205640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f190015cba0 0x7f190014a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1905205640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f190015cba0 0x7f190014a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38570/0 (socket says 172.21.15.88:38570) 2023-11-20T07:01:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1905205640 1 -- 172.21.15.88:0/898368707 learned_addr learned my addr 172.21.15.88:0/898368707 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1904a04640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19000b84e0 0x7f1900156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f18f7fff640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19000d0210 0x7f19000c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1905205640 1 -- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19000b84e0 msgr2=0x7f1900156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1905205640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19000b84e0 0x7f1900156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1905205640 1 -- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19000d0210 msgr2=0x7f19000c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1905205640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19000d0210 0x7f19000c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1905205640 1 -- 172.21.15.88:0/898368707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f8009b30 con 0x7f190015cba0 2023-11-20T07:01:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1905205640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f190015cba0 0x7f190014a310 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f18f801a640 tx=0x7f18f80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f18f57fa640 1 -- 172.21.15.88:0/898368707 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80b8640 con 0x7f190015cba0 2023-11-20T07:01:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f18f57fa640 1 -- 172.21.15.88:0/898368707 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f80b87c0 con 0x7f190015cba0 2023-11-20T07:01:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1906c68640 1 -- 172.21.15.88:0/898368707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19000ca670 con 0x7f190015cba0 2023-11-20T07:01:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f18f57fa640 1 -- 172.21.15.88:0/898368707 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80b8b70 con 0x7f190015cba0 2023-11-20T07:01:39.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.801+0000 7f1906c68640 1 -- 172.21.15.88:0/898368707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19000cac30 con 0x7f190015cba0 2023-11-20T07:01:39.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.805+0000 7f1906c68640 1 -- 172.21.15.88:0/898368707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19000cb110 con 0x7f190015cba0 2023-11-20T07:01:39.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.805+0000 7f18f57fa640 1 -- 172.21.15.88:0/898368707 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f18f80b8cd0 con 0x7f190015cba0 2023-11-20T07:01:39.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.805+0000 7f18f57fa640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f18ec0664a0 0x7f18ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:39.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.805+0000 7f18f57fa640 1 -- 172.21.15.88:0/898368707 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f18f811f3d0 con 0x7f190015cba0 2023-11-20T07:01:39.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.805+0000 7f1904a04640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f18ec0664a0 0x7f18ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:39.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.805+0000 7f1904a04640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f18ec0664a0 0x7f18ec068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0079c0 tx=0x7f18fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:39.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.809+0000 7f18f57fa640 1 -- 172.21.15.88:0/898368707 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f18f80ec4b0 con 0x7f190015cba0 2023-11-20T07:01:39.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.957+0000 7f1906c68640 1 -- 172.21.15.88:0/898368707 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f190004e170 con 0x7f190015cba0 2023-11-20T07:01:39.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.957+0000 7f18f57fa640 1 -- 172.21.15.88:0/898368707 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f18f80efad0 con 0x7f190015cba0 2023-11-20T07:01:39.960 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:39.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.961+0000 7f1906c68640 1 -- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f18ec0664a0 msgr2=0x7f18ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.961+0000 7f1906c68640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f18ec0664a0 0x7f18ec068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0079c0 tx=0x7f18fc008040 comp rx=0 tx=0).stop 2023-11-20T07:01:39.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.961+0000 7f1906c68640 1 -- 172.21.15.88:0/898368707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f190015cba0 msgr2=0x7f190014a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:39.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.961+0000 7f1906c68640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f190015cba0 0x7f190014a310 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f18f801a640 tx=0x7f18f80197b0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.961+0000 7f1906c68640 1 -- 172.21.15.88:0/898368707 shutdown_connections 2023-11-20T07:01:39.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.961+0000 7f1906c68640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f18ec0664a0 0x7f18ec068960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.961+0000 7f1906c68640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f190015cba0 0x7f190014a310 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.961+0000 7f1906c68640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19000d0210 0x7f19000c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.961+0000 7f1906c68640 1 --2- 172.21.15.88:0/898368707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19000b84e0 0x7f1900156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:39.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.961+0000 7f1906c68640 1 -- 172.21.15.88:0/898368707 >> 172.21.15.88:0/898368707 conn(0x7f19000719c0 msgr2=0x7f19000b7360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:39.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.961+0000 7f1906c68640 1 -- 172.21.15.88:0/898368707 shutdown_connections 2023-11-20T07:01:39.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:39.961+0000 7f1906c68640 1 -- 172.21.15.88:0/898368707 wait complete. 2023-11-20T07:01:39.981 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:40.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ade2ea640 1 Processor -- start 2023-11-20T07:01:40.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ade2ea640 1 -- start start 2023-11-20T07:01:40.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ade2ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad80b84e0 0x7f9ad80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ade2ea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad80d1670 con 0x7f9ad80d0210 2023-11-20T07:01:40.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ade2ea640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad80d1950 con 0x7f9ad815cba0 2023-11-20T07:01:40.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ade2ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80d1460 con 0x7f9ad80b84e0 2023-11-20T07:01:40.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ad77fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9ad80d0210 0x7f9ad80b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34630/0 (socket says 172.21.15.88:34630) 2023-11-20T07:01:40.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ad77fe640 1 -- 172.21.15.88:0/1118134420 learned_addr learned my addr 172.21.15.88:0/1118134420 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:40.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9adc887640 1 --2- 172.21.15.88:0/1118134420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad80b84e0 0x7f9ad80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ad6ffd640 1 -- 172.21.15.88:0/1118134420 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945451807 0 0) 0x7f9ad80d1670 con 0x7f9ad80d0210 2023-11-20T07:01:40.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ad6ffd640 1 -- 172.21.15.88:0/1118134420 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ac0003530 con 0x7f9ad80d0210 2023-11-20T07:01:40.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ad6ffd640 1 -- 172.21.15.88:0/1118134420 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722031064 0 0) 0x7f9ad80d1950 con 0x7f9ad815cba0 2023-11-20T07:01:40.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ad6ffd640 1 -- 172.21.15.88:0/1118134420 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ad80d1670 con 0x7f9ad815cba0 2023-11-20T07:01:40.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9ad6ffd640 1 -- 172.21.15.88:0/1118134420 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 866471991 0 0) 0x7f9ac0003530 con 0x7f9ad80d0210 2023-11-20T07:01:40.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9adc887640 1 -- 172.21.15.88:0/1118134420 >> v1:172.21.15.175:6789/0 conn(0x7f9ad815cba0 legacy=0x7f9ad80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9adc887640 1 -- 172.21.15.88:0/1118134420 >> v1:172.21.15.88:6789/0 conn(0x7f9ad80d0210 legacy=0x7f9ad80b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.121+0000 7f9adc887640 1 -- 172.21.15.88:0/1118134420 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80d1c30 con 0x7f9ad80b84e0 2023-11-20T07:01:40.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.125+0000 7f9adc887640 1 --2- 172.21.15.88:0/1118134420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad80b84e0 0x7f9ad80d0f20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009dc0 tx=0x7f9ad001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e87c4b90ce9c89e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:40.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.125+0000 7f9ad6ffd640 1 -- 172.21.15.88:0/1118134420 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc001680 con 0x7f9ad80b84e0 2023-11-20T07:01:40.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.125+0000 7f9ad6ffd640 1 -- 172.21.15.88:0/1118134420 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad00a56d0 con 0x7f9ad80b84e0 2023-11-20T07:01:40.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.125+0000 7f9ad6ffd640 1 -- 172.21.15.88:0/1118134420 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00a5a60 con 0x7f9ad80b84e0 2023-11-20T07:01:40.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.125+0000 7f9ade2ea640 1 -- 172.21.15.88:0/1118134420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad80b84e0 msgr2=0x7f9ad80d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.125+0000 7f9ade2ea640 1 --2- 172.21.15.88:0/1118134420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad80b84e0 0x7f9ad80d0f20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009dc0 tx=0x7f9ad001c890 comp rx=0 tx=0).stop 2023-11-20T07:01:40.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.125+0000 7f9ade2ea640 1 -- 172.21.15.88:0/1118134420 shutdown_connections 2023-11-20T07:01:40.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.125+0000 7f9ade2ea640 1 --2- 172.21.15.88:0/1118134420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad80b84e0 0x7f9ad80d0f20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.125+0000 7f9ade2ea640 1 -- 172.21.15.88:0/1118134420 >> 172.21.15.88:0/1118134420 conn(0x7f9ad80719c0 msgr2=0x7f9ad8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:40.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.125+0000 7f9ade2ea640 1 -- 172.21.15.88:0/1118134420 shutdown_connections 2023-11-20T07:01:40.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.125+0000 7f9ade2ea640 1 -- 172.21.15.88:0/1118134420 wait complete. 2023-11-20T07:01:40.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ade2ea640 1 Processor -- start 2023-11-20T07:01:40.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ade2ea640 1 -- start start 2023-11-20T07:01:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ade2ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad80b84e0 0x7f9ad80cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ade2ea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad80d0210 0x7f9ad8152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ade2ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad815cba0 0x7f9ad80c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ade2ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad815d2b0 con 0x7f9ad815cba0 2023-11-20T07:01:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ade2ea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad815d4c0 con 0x7f9ad80d0210 2023-11-20T07:01:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ade2ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad815d7a0 con 0x7f9ad80b84e0 2023-11-20T07:01:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9adc887640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad815cba0 0x7f9ad80c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9adc887640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad815cba0 0x7f9ad80c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38572/0 (socket says 172.21.15.88:38572) 2023-11-20T07:01:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9adc887640 1 -- 172.21.15.88:0/890433990 learned_addr learned my addr 172.21.15.88:0/890433990 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ad77fe640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad80d0210 0x7f9ad8152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9adc887640 1 -- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad80b84e0 msgr2=0x7f9ad80cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ad7fff640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad80b84e0 0x7f9ad80cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9adc887640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad80b84e0 0x7f9ad80cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9adc887640 1 -- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad80d0210 msgr2=0x7f9ad8152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9adc887640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad80d0210 0x7f9ad8152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9adc887640 1 -- 172.21.15.88:0/890433990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad0009a70 con 0x7f9ad815cba0 2023-11-20T07:01:40.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ad77fe640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad80d0210 0x7f9ad8152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:40.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ad7fff640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad80b84e0 0x7f9ad80cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:40.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9adc887640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad815cba0 0x7f9ad80c61e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9ad001cd70 tx=0x7f9ad0019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:40.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ad4ff9640 1 -- 172.21.15.88:0/890433990 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00a5ea0 con 0x7f9ad815cba0 2023-11-20T07:01:40.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ad4ff9640 1 -- 172.21.15.88:0/890433990 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad00b9860 con 0x7f9ad815cba0 2023-11-20T07:01:40.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ade2ea640 1 -- 172.21.15.88:0/890433990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad815da80 con 0x7f9ad815cba0 2023-11-20T07:01:40.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ad4ff9640 1 -- 172.21.15.88:0/890433990 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00b9c10 con 0x7f9ad815cba0 2023-11-20T07:01:40.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.129+0000 7f9ade2ea640 1 -- 172.21.15.88:0/890433990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad815e040 con 0x7f9ad815cba0 2023-11-20T07:01:40.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.133+0000 7f9ade2ea640 1 -- 172.21.15.88:0/890433990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad815e230 con 0x7f9ad815cba0 2023-11-20T07:01:40.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.133+0000 7f9ad4ff9640 1 -- 172.21.15.88:0/890433990 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9ad00ad440 con 0x7f9ad815cba0 2023-11-20T07:01:40.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.133+0000 7f9ad4ff9640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ac40664a0 0x7f9ac4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.133+0000 7f9ad4ff9640 1 -- 172.21.15.88:0/890433990 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9ad011f350 con 0x7f9ad815cba0 2023-11-20T07:01:40.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.133+0000 7f9ad7fff640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ac40664a0 0x7f9ac4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.133+0000 7f9ad7fff640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ac40664a0 0x7f9ac4068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80011f0 tx=0x7f9ac8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:40.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.137+0000 7f9ad4ff9640 1 -- 172.21.15.88:0/890433990 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9ad00ec400 con 0x7f9ad815cba0 2023-11-20T07:01:40.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.285+0000 7f9ade2ea640 1 -- 172.21.15.88:0/890433990 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ad804e170 con 0x7f9ad815cba0 2023-11-20T07:01:40.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.285+0000 7f9ad4ff9640 1 -- 172.21.15.88:0/890433990 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ad0009450 con 0x7f9ad815cba0 2023-11-20T07:01:40.287 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:40.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.285+0000 7f9ade2ea640 1 -- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ac40664a0 msgr2=0x7f9ac4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.285+0000 7f9ade2ea640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ac40664a0 0x7f9ac4068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80011f0 tx=0x7f9ac8009040 comp rx=0 tx=0).stop 2023-11-20T07:01:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.285+0000 7f9ade2ea640 1 -- 172.21.15.88:0/890433990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad815cba0 msgr2=0x7f9ad80c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.285+0000 7f9ade2ea640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad815cba0 0x7f9ad80c61e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9ad001cd70 tx=0x7f9ad0019630 comp rx=0 tx=0).stop 2023-11-20T07:01:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.285+0000 7f9ade2ea640 1 -- 172.21.15.88:0/890433990 shutdown_connections 2023-11-20T07:01:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.285+0000 7f9ade2ea640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9ac40664a0 0x7f9ac4068960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.285+0000 7f9ade2ea640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ad815cba0 0x7f9ad80c61e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.285+0000 7f9ade2ea640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad80d0210 0x7f9ad8152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.285+0000 7f9ade2ea640 1 --2- 172.21.15.88:0/890433990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ad80b84e0 0x7f9ad80cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.285+0000 7f9ade2ea640 1 -- 172.21.15.88:0/890433990 >> 172.21.15.88:0/890433990 conn(0x7f9ad80719c0 msgr2=0x7f9ad80cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.289+0000 7f9ade2ea640 1 -- 172.21.15.88:0/890433990 shutdown_connections 2023-11-20T07:01:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.289+0000 7f9ade2ea640 1 -- 172.21.15.88:0/890433990 wait complete. 2023-11-20T07:01:40.308 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:40.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0eaf0f640 1 Processor -- start 2023-11-20T07:01:40.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0eaf0f640 1 -- start start 2023-11-20T07:01:40.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0eaf0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40d0210 0x7ff0e40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0eaf0f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff0e40b84e0 0x7ff0e40b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0eaf0f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e40d1670 con 0x7ff0e415cba0 2023-11-20T07:01:40.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0eaf0f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e40d1460 con 0x7ff0e40b84e0 2023-11-20T07:01:40.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0eaf0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40d1950 con 0x7ff0e40d0210 2023-11-20T07:01:40.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e8cab640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff0e415cba0 0x7ff0e40cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34638/0 (socket says 172.21.15.88:34638) 2023-11-20T07:01:40.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e8cab640 1 -- 172.21.15.88:0/2983175460 learned_addr learned my addr 172.21.15.88:0/2983175460 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:40.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957461063 0 0) 0x7ff0e40d1670 con 0x7ff0e415cba0 2023-11-20T07:01:40.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e3fff640 1 --2- 172.21.15.88:0/2983175460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40d0210 0x7ff0e40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e94ac640 1 --2- 172.21.15.88:0/2983175460 >> v2:172.21.15.175:3300/0 conn(0x7ff0e40b84e0 0x7ff0e40b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d4003530 con 0x7ff0e415cba0 2023-11-20T07:01:40.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 221730510 0 0) 0x7ff0d4003530 con 0x7ff0e415cba0 2023-11-20T07:01:40.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40d0210 msgr2=0x7ff0e40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:40.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 --2- 172.21.15.88:0/2983175460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40d0210 0x7ff0e40d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 >> v2:172.21.15.175:3300/0 conn(0x7ff0e40b84e0 msgr2=0x7ff0e40b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:40.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 --2- 172.21.15.88:0/2983175460 >> v2:172.21.15.175:3300/0 conn(0x7ff0e40b84e0 0x7ff0e40b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e40d1c30 con 0x7ff0e415cba0 2023-11-20T07:01:40.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7ff0d8001680 con 0x7ff0e415cba0 2023-11-20T07:01:40.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 >> v1:172.21.15.88:6789/0 conn(0x7ff0e415cba0 legacy=0x7ff0e40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 --2- 172.21.15.88:0/2983175460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d4003980 0x7ff0d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 --2- 172.21.15.88:0/2983175460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0d40047d0 0x7ff0d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 --2- 172.21.15.88:0/2983175460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40d0210 0x7ff0d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40d1460 con 0x7ff0d40047d0 2023-11-20T07:01:40.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40d1950 con 0x7ff0d4003980 2023-11-20T07:01:40.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d400b990 con 0x7ff0e40d0210 2023-11-20T07:01:40.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e3fff640 1 --2- 172.21.15.88:0/2983175460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0d40047d0 0x7ff0d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e8cab640 1 --2- 172.21.15.88:0/2983175460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d4003980 0x7ff0d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e94ac640 1 --2- 172.21.15.88:0/2983175460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40d0210 0x7ff0d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e3fff640 1 -- 172.21.15.88:0/2983175460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40d0210 msgr2=0x7ff0d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:40.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e3fff640 1 --2- 172.21.15.88:0/2983175460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40d0210 0x7ff0d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e3fff640 1 -- 172.21.15.88:0/2983175460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d4003980 msgr2=0x7ff0d4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:40.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e3fff640 1 --2- 172.21.15.88:0/2983175460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d4003980 0x7ff0d4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.449+0000 7ff0e3fff640 1 -- 172.21.15.88:0/2983175460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4003530 con 0x7ff0d40047d0 2023-11-20T07:01:40.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.453+0000 7ff0e3fff640 1 --2- 172.21.15.88:0/2983175460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0d40047d0 0x7ff0d4004c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009ae0 tx=0x7ff0d001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0de66282ea6605 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:40.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.453+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00a5560 con 0x7ff0d40047d0 2023-11-20T07:01:40.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.453+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d00a56c0 con 0x7ff0d40047d0 2023-11-20T07:01:40.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.453+0000 7ff0e37fe640 1 -- 172.21.15.88:0/2983175460 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00a5a70 con 0x7ff0d40047d0 2023-11-20T07:01:40.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.453+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/2983175460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0d40047d0 msgr2=0x7ff0d4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.453+0000 7ff0eaf0f640 1 --2- 172.21.15.88:0/2983175460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0d40047d0 0x7ff0d4004c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009ae0 tx=0x7ff0d001ca50 comp rx=0 tx=0).stop 2023-11-20T07:01:40.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.453+0000 7ff0e94ac640 1 -- 172.21.15.88:0/2983175460 reap_dead start 2023-11-20T07:01:40.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.453+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/2983175460 shutdown_connections 2023-11-20T07:01:40.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.453+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/2983175460 >> 172.21.15.88:0/2983175460 conn(0x7ff0e40719c0 msgr2=0x7ff0e4071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:40.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.453+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/2983175460 shutdown_connections 2023-11-20T07:01:40.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.453+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/2983175460 wait complete. 2023-11-20T07:01:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0eaf0f640 1 Processor -- start 2023-11-20T07:01:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0eaf0f640 1 -- start start 2023-11-20T07:01:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0eaf0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0d40047d0 0x7ff0e40cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0eaf0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40cb7a0 0x7ff0e40cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0eaf0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e40cc160 0x7ff0e4145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0eaf0f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40cb040 con 0x7ff0d40047d0 2023-11-20T07:01:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0eaf0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40cc5c0 con 0x7ff0e40cc160 2023-11-20T07:01:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0eaf0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e4146b20 con 0x7ff0e40cb7a0 2023-11-20T07:01:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e8cab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0d40047d0 0x7ff0e40cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e8cab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0d40047d0 0x7ff0e40cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38586/0 (socket says 172.21.15.88:38586) 2023-11-20T07:01:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e8cab640 1 -- 172.21.15.88:0/1278171892 learned_addr learned my addr 172.21.15.88:0/1278171892 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e94ac640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e40cc160 0x7ff0e4145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e8cab640 1 -- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40cb7a0 msgr2=0x7ff0e40cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e3fff640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40cb7a0 0x7ff0e40cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e8cab640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40cb7a0 0x7ff0e40cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e8cab640 1 -- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e40cc160 msgr2=0x7ff0e4145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e8cab640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e40cc160 0x7ff0e4145480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e8cab640 1 -- 172.21.15.88:0/1278171892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e4146e00 con 0x7ff0d40047d0 2023-11-20T07:01:40.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e94ac640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e40cc160 0x7ff0e4145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:40.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e3fff640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40cb7a0 0x7ff0e40cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:40.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e8cab640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0d40047d0 0x7ff0e40cb260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8012540 tx=0x7ff0d8012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:40.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e17fa640 1 -- 172.21.15.88:0/1278171892 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8014810 con 0x7ff0d40047d0 2023-11-20T07:01:40.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e17fa640 1 -- 172.21.15.88:0/1278171892 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d8014970 con 0x7ff0d40047d0 2023-11-20T07:01:40.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/1278171892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e41470e0 con 0x7ff0d40047d0 2023-11-20T07:01:40.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0e17fa640 1 -- 172.21.15.88:0/1278171892 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8014d20 con 0x7ff0d40047d0 2023-11-20T07:01:40.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.457+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/1278171892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e41476a0 con 0x7ff0d40047d0 2023-11-20T07:01:40.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.461+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/1278171892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e404e170 con 0x7ff0d40047d0 2023-11-20T07:01:40.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.461+0000 7ff0e17fa640 1 -- 172.21.15.88:0/1278171892 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff0d8016480 con 0x7ff0d40047d0 2023-11-20T07:01:40.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.461+0000 7ff0e17fa640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff0c80664a0 0x7ff0c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.461+0000 7ff0e17fa640 1 -- 172.21.15.88:0/1278171892 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff0d8087720 con 0x7ff0d40047d0 2023-11-20T07:01:40.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.461+0000 7ff0e3fff640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff0c80664a0 0x7ff0c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.461+0000 7ff0e3fff640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff0c80664a0 0x7ff0c8068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00af000 tx=0x7ff0d00046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:40.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.465+0000 7ff0e17fa640 1 -- 172.21.15.88:0/1278171892 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff0d8054800 con 0x7ff0d40047d0 2023-11-20T07:01:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.613+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/1278171892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff0e415b250 con 0x7ff0d40047d0 2023-11-20T07:01:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.613+0000 7ff0e17fa640 1 -- 172.21.15.88:0/1278171892 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff0d8057e20 con 0x7ff0d40047d0 2023-11-20T07:01:40.616 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.617+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff0c80664a0 msgr2=0x7ff0c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.617+0000 7ff0eaf0f640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff0c80664a0 0x7ff0c8068960 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00af000 tx=0x7ff0d00046d0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.617+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/1278171892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0d40047d0 msgr2=0x7ff0e40cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.617+0000 7ff0eaf0f640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0d40047d0 0x7ff0e40cb260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8012540 tx=0x7ff0d8012a00 comp rx=0 tx=0).stop 2023-11-20T07:01:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.617+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/1278171892 shutdown_connections 2023-11-20T07:01:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.617+0000 7ff0eaf0f640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff0c80664a0 0x7ff0c8068960 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.617+0000 7ff0eaf0f640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0e40cb7a0 0x7ff0e40cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.617+0000 7ff0eaf0f640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e40cc160 0x7ff0e4145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.617+0000 7ff0eaf0f640 1 --2- 172.21.15.88:0/1278171892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0d40047d0 0x7ff0e40cb260 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.617+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/1278171892 >> 172.21.15.88:0/1278171892 conn(0x7ff0e40719c0 msgr2=0x7ff0e40d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:40.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.617+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/1278171892 shutdown_connections 2023-11-20T07:01:40.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.617+0000 7ff0eaf0f640 1 -- 172.21.15.88:0/1278171892 wait complete. 2023-11-20T07:01:40.638 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:40.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35c5a32640 1 Processor -- start 2023-11-20T07:01:40.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35c5a32640 1 -- start start 2023-11-20T07:01:40.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35c5a32640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35c015cb90 0x7f35c00cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35c5a32640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35c00d3010 0x7f35c00d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35c5a32640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f35c00d1400 0x7f35c00cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35c5a32640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c00d1890 con 0x7f35c00d3010 2023-11-20T07:01:40.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35c5a32640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c00ce770 con 0x7f35c00d1400 2023-11-20T07:01:40.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35c5a32640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00d0600 con 0x7f35c015cb90 2023-11-20T07:01:40.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35b67fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35c00d3010 0x7f35c00d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35b67fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f35c00d3010 0x7f35c00d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38602/0 (socket says 172.21.15.88:38602) 2023-11-20T07:01:40.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35b67fc640 1 -- 172.21.15.88:0/2033628059 learned_addr learned my addr 172.21.15.88:0/2033628059 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:40.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35bf7fe640 1 --2- 172.21.15.88:0/2033628059 >> v2:172.21.15.175:3300/0 conn(0x7f35c00d1400 0x7f35c00cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.773+0000 7f35beffd640 1 --2- 172.21.15.88:0/2033628059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35c015cb90 0x7f35c00cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.777+0000 7f35b67fc640 1 -- 172.21.15.88:0/2033628059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35c015cb90 msgr2=0x7f35c00cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:40.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.777+0000 7f35b67fc640 1 --2- 172.21.15.88:0/2033628059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35c015cb90 0x7f35c00cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.777+0000 7f35b67fc640 1 -- 172.21.15.88:0/2033628059 >> v2:172.21.15.175:3300/0 conn(0x7f35c00d1400 msgr2=0x7f35c00cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:40.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.777+0000 7f35b67fc640 1 --2- 172.21.15.88:0/2033628059 >> v2:172.21.15.175:3300/0 conn(0x7f35c00d1400 0x7f35c00cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.777+0000 7f35b67fc640 1 -- 172.21.15.88:0/2033628059 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c00c6450 con 0x7f35c00d3010 2023-11-20T07:01:40.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.777+0000 7f35b67fc640 1 --2- 172.21.15.88:0/2033628059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c00d3010 0x7f35c00d0ec0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f35c00725c0 tx=0x7f35b001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57729443e8ff07f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:40.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.777+0000 7f35be7fc640 1 -- 172.21.15.88:0/2033628059 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00ab600 con 0x7f35c00d3010 2023-11-20T07:01:40.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.777+0000 7f35be7fc640 1 -- 172.21.15.88:0/2033628059 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b00ab760 con 0x7f35c00d3010 2023-11-20T07:01:40.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.777+0000 7f35be7fc640 1 -- 172.21.15.88:0/2033628059 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00abaf0 con 0x7f35c00d3010 2023-11-20T07:01:40.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 -- 172.21.15.88:0/2033628059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c00d3010 msgr2=0x7f35c00d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 --2- 172.21.15.88:0/2033628059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c00d3010 0x7f35c00d0ec0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f35c00725c0 tx=0x7f35b001c440 comp rx=0 tx=0).stop 2023-11-20T07:01:40.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 -- 172.21.15.88:0/2033628059 shutdown_connections 2023-11-20T07:01:40.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 --2- 172.21.15.88:0/2033628059 >> v2:172.21.15.175:3300/0 conn(0x7f35c00d1400 0x7f35c00cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 --2- 172.21.15.88:0/2033628059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c00d3010 0x7f35c00d0ec0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 --2- 172.21.15.88:0/2033628059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35c015cb90 0x7f35c00cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 -- 172.21.15.88:0/2033628059 >> 172.21.15.88:0/2033628059 conn(0x7f35c009bc50 msgr2=0x7f35c00d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:40.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 -- 172.21.15.88:0/2033628059 shutdown_connections 2023-11-20T07:01:40.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 -- 172.21.15.88:0/2033628059 wait complete. 2023-11-20T07:01:40.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 Processor -- start 2023-11-20T07:01:40.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 -- start start 2023-11-20T07:01:40.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c00d1400 0x7f35c015bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c00d3010 0x7f35c014b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35c015cb90 0x7f35c0149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c014be50 con 0x7f35c00d3010 2023-11-20T07:01:40.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00b64c0 con 0x7f35c00d1400 2023-11-20T07:01:40.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35c5a32640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c00b4cc0 con 0x7f35c015cb90 2023-11-20T07:01:40.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35b67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c00d3010 0x7f35c014b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35b67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c00d3010 0x7f35c014b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38610/0 (socket says 172.21.15.88:38610) 2023-11-20T07:01:40.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35b67fc640 1 -- 172.21.15.88:0/358802720 learned_addr learned my addr 172.21.15.88:0/358802720 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:40.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35beffd640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c00d1400 0x7f35c015bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35bf7fe640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35c015cb90 0x7f35c0149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35b67fc640 1 -- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35c015cb90 msgr2=0x7f35c0149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35b67fc640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35c015cb90 0x7f35c0149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35b67fc640 1 -- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c00d1400 msgr2=0x7f35c015bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35b67fc640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c00d1400 0x7f35c015bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.781+0000 7f35b67fc640 1 -- 172.21.15.88:0/358802720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b00094d0 con 0x7f35c00d3010 2023-11-20T07:01:40.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.785+0000 7f35b67fc640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c00d3010 0x7f35c014b660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f35b00ad040 tx=0x7f35b001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:40.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.785+0000 7f35bcff9640 1 -- 172.21.15.88:0/358802720 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00be5f0 con 0x7f35c00d3010 2023-11-20T07:01:40.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.785+0000 7f35bcff9640 1 -- 172.21.15.88:0/358802720 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b00be770 con 0x7f35c00d3010 2023-11-20T07:01:40.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.785+0000 7f35bcff9640 1 -- 172.21.15.88:0/358802720 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b00beb20 con 0x7f35c00d3010 2023-11-20T07:01:40.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.785+0000 7f35c5a32640 1 -- 172.21.15.88:0/358802720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c00b8050 con 0x7f35c00d3010 2023-11-20T07:01:40.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.785+0000 7f35c5a32640 1 -- 172.21.15.88:0/358802720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c00b8610 con 0x7f35c00d3010 2023-11-20T07:01:40.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.785+0000 7f35c5a32640 1 -- 172.21.15.88:0/358802720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c0074010 con 0x7f35c00d3010 2023-11-20T07:01:40.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.785+0000 7f35bcff9640 1 -- 172.21.15.88:0/358802720 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f35b00b43f0 con 0x7f35c00d3010 2023-11-20T07:01:40.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.785+0000 7f35bcff9640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f35a00664a0 0x7f35a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.785+0000 7f35bcff9640 1 -- 172.21.15.88:0/358802720 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f35b011ef00 con 0x7f35c00d3010 2023-11-20T07:01:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.785+0000 7f35beffd640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f35a00664a0 0x7f35a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.789+0000 7f35beffd640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f35a00664a0 0x7f35a0068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f35a8006fd0 tx=0x7f35a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:40.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.789+0000 7f35bcff9640 1 -- 172.21.15.88:0/358802720 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f35b00ebfd0 con 0x7f35c00d3010 2023-11-20T07:01:40.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.941+0000 7f35c5a32640 1 -- 172.21.15.88:0/358802720 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35c0156110 con 0x7f35c00d3010 2023-11-20T07:01:40.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.941+0000 7f35bcff9640 1 -- 172.21.15.88:0/358802720 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f35b00c4090 con 0x7f35c00d3010 2023-11-20T07:01:40.943 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:40.943 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:40.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.941+0000 7f35c5a32640 1 -- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f35a00664a0 msgr2=0x7f35a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.941+0000 7f35c5a32640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f35a00664a0 0x7f35a0068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f35a8006fd0 tx=0x7f35a8008040 comp rx=0 tx=0).stop 2023-11-20T07:01:40.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.941+0000 7f35c5a32640 1 -- 172.21.15.88:0/358802720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c00d3010 msgr2=0x7f35c014b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:40.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.941+0000 7f35c5a32640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c00d3010 0x7f35c014b660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f35b00ad040 tx=0x7f35b001ac80 comp rx=0 tx=0).stop 2023-11-20T07:01:40.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.941+0000 7f35c5a32640 1 -- 172.21.15.88:0/358802720 shutdown_connections 2023-11-20T07:01:40.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.941+0000 7f35c5a32640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f35a00664a0 0x7f35a0068960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.941+0000 7f35c5a32640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35c015cb90 0x7f35c0149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.941+0000 7f35c5a32640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35c00d3010 0x7f35c014b660 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.941+0000 7f35c5a32640 1 --2- 172.21.15.88:0/358802720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c00d1400 0x7f35c015bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:40.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.941+0000 7f35c5a32640 1 -- 172.21.15.88:0/358802720 >> 172.21.15.88:0/358802720 conn(0x7f35c009bc50 msgr2=0x7f35c00b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:40.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.945+0000 7f35c5a32640 1 -- 172.21.15.88:0/358802720 shutdown_connections 2023-11-20T07:01:40.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:40.945+0000 7f35c5a32640 1 -- 172.21.15.88:0/358802720 wait complete. 2023-11-20T07:01:40.964 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:40.964 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:41.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.101+0000 7f39b5fb8640 1 Processor -- start 2023-11-20T07:01:41.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.101+0000 7f39b5fb8640 1 -- start start 2023-11-20T07:01:41.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39b5fb8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39b0161390 0x7f39b00ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39b5fb8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f39b006e2f0 0x7f39b006e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39b5fb8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b00cdc30 con 0x7f39b015ce10 2023-11-20T07:01:41.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39b5fb8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b01617f0 con 0x7f39b0161390 2023-11-20T07:01:41.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39b5fb8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b006ec60 con 0x7f39b006e2f0 2023-11-20T07:01:41.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39aeffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39b0161390 0x7f39b00ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39aeffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39b0161390 0x7f39b00ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38624/0 (socket says 172.21.15.88:38624) 2023-11-20T07:01:41.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39aeffd640 1 -- 172.21.15.88:0/3185401358 learned_addr learned my addr 172.21.15.88:0/3185401358 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:41.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39af7fe640 1 --1- 172.21.15.88:0/3185401358 >> v1:172.21.15.88:6789/0 conn(0x7f39b015ce10 0x7f39b00cd3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34654/0 (socket says 172.21.15.88:34654) 2023-11-20T07:01:41.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39affff640 1 --2- 172.21.15.88:0/3185401358 >> v2:172.21.15.175:3300/0 conn(0x7f39b006e2f0 0x7f39b006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39aeffd640 1 -- 172.21.15.88:0/3185401358 >> v2:172.21.15.175:3300/0 conn(0x7f39b006e2f0 msgr2=0x7f39b006e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:41.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39aeffd640 1 --2- 172.21.15.88:0/3185401358 >> v2:172.21.15.175:3300/0 conn(0x7f39b006e2f0 0x7f39b006e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39aeffd640 1 -- 172.21.15.88:0/3185401358 >> v1:172.21.15.88:6789/0 conn(0x7f39b015ce10 legacy=0x7f39b00cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39aeffd640 1 -- 172.21.15.88:0/3185401358 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b00c9750 con 0x7f39b0161390 2023-11-20T07:01:41.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.105+0000 7f39ae7fc640 1 -- 172.21.15.88:0/3185401358 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427846579 0 0) 0x7f39b00cdc30 con 0x7f39b015ce10 2023-11-20T07:01:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39aeffd640 1 --2- 172.21.15.88:0/3185401358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b0161390 0x7f39b00ca7b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f39b00ccbf0 tx=0x7f39a401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd670cecfb8e7ec server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39ae7fc640 1 -- 172.21.15.88:0/3185401358 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a40aa660 con 0x7f39b0161390 2023-11-20T07:01:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39ae7fc640 1 -- 172.21.15.88:0/3185401358 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a40aa7c0 con 0x7f39b0161390 2023-11-20T07:01:41.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39ae7fc640 1 -- 172.21.15.88:0/3185401358 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a40aab50 con 0x7f39b0161390 2023-11-20T07:01:41.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39b5fb8640 1 -- 172.21.15.88:0/3185401358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b0161390 msgr2=0x7f39b00ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39b5fb8640 1 --2- 172.21.15.88:0/3185401358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b0161390 0x7f39b00ca7b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f39b00ccbf0 tx=0x7f39a401c500 comp rx=0 tx=0).stop 2023-11-20T07:01:41.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39b5fb8640 1 -- 172.21.15.88:0/3185401358 shutdown_connections 2023-11-20T07:01:41.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39b5fb8640 1 --2- 172.21.15.88:0/3185401358 >> v2:172.21.15.175:3300/0 conn(0x7f39b006e2f0 0x7f39b006e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39b5fb8640 1 --2- 172.21.15.88:0/3185401358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b0161390 0x7f39b00ca7b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39b5fb8640 1 -- 172.21.15.88:0/3185401358 >> 172.21.15.88:0/3185401358 conn(0x7f39b00cef20 msgr2=0x7f39b00cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:41.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39b5fb8640 1 -- 172.21.15.88:0/3185401358 shutdown_connections 2023-11-20T07:01:41.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39b5fb8640 1 -- 172.21.15.88:0/3185401358 wait complete. 2023-11-20T07:01:41.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39b5fb8640 1 Processor -- start 2023-11-20T07:01:41.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.109+0000 7f39b5fb8640 1 -- start start 2023-11-20T07:01:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39b5fb8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39b006e2f0 0x7f39b0156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39b5fb8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b0161390 0x7f39b0154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39b5fb8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39b01552a0 0x7f39b00c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39b5fb8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b00c5a30 con 0x7f39b0161390 2023-11-20T07:01:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39b5fb8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b0155730 con 0x7f39b006e2f0 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39b5fb8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b00c5750 con 0x7f39b01552a0 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39aeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b0161390 0x7f39b0154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39aeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b0161390 0x7f39b0154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38634/0 (socket says 172.21.15.88:38634) 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39aeffd640 1 -- 172.21.15.88:0/1929416240 learned_addr learned my addr 172.21.15.88:0/1929416240 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39af7fe640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39b006e2f0 0x7f39b0156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39affff640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39b01552a0 0x7f39b00c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39aeffd640 1 -- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39b01552a0 msgr2=0x7f39b00c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39aeffd640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39b01552a0 0x7f39b00c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39aeffd640 1 -- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39b006e2f0 msgr2=0x7f39b0156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39aeffd640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39b006e2f0 0x7f39b0156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39aeffd640 1 -- 172.21.15.88:0/1929416240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a40094d0 con 0x7f39b0161390 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39aeffd640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b0161390 0x7f39b0154d60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f39a4019110 tx=0x7f39a401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f3997fff640 1 -- 172.21.15.88:0/1929416240 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a40b3800 con 0x7f39b0161390 2023-11-20T07:01:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f3997fff640 1 -- 172.21.15.88:0/1929416240 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a40b3980 con 0x7f39b0161390 2023-11-20T07:01:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39b5fb8640 1 -- 172.21.15.88:0/1929416240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b00c34e0 con 0x7f39b0161390 2023-11-20T07:01:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f3997fff640 1 -- 172.21.15.88:0/1929416240 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a40b3d30 con 0x7f39b0161390 2023-11-20T07:01:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39b5fb8640 1 -- 172.21.15.88:0/1929416240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b00c3aa0 con 0x7f39b0161390 2023-11-20T07:01:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f39b5fb8640 1 -- 172.21.15.88:0/1929416240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b00c3340 con 0x7f39b0161390 2023-11-20T07:01:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.113+0000 7f3997fff640 1 -- 172.21.15.88:0/1929416240 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f39a40b2380 con 0x7f39b0161390 2023-11-20T07:01:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.117+0000 7f3997fff640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f399c0664d0 0x7f399c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.117+0000 7f3997fff640 1 -- 172.21.15.88:0/1929416240 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f39a40a6040 con 0x7f39b0161390 2023-11-20T07:01:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.117+0000 7f39af7fe640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f399c0664d0 0x7f399c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.117+0000 7f39af7fe640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f399c0664d0 0x7f399c068990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f39a0007fd0 tx=0x7f39a0007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.117+0000 7f3997fff640 1 -- 172.21.15.88:0/1929416240 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f39b00c3340 con 0x7f39b0161390 2023-11-20T07:01:41.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.269+0000 7f39b5fb8640 1 -- 172.21.15.88:0/1929416240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39b00c3340 con 0x7f39b0161390 2023-11-20T07:01:41.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.269+0000 7f3997fff640 1 -- 172.21.15.88:0/1929416240 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39b00c3340 con 0x7f39b0161390 2023-11-20T07:01:41.272 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:41.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.273+0000 7f39b5fb8640 1 -- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f399c0664d0 msgr2=0x7f399c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.273+0000 7f39b5fb8640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f399c0664d0 0x7f399c068990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f39a0007fd0 tx=0x7f39a0007d60 comp rx=0 tx=0).stop 2023-11-20T07:01:41.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.273+0000 7f39b5fb8640 1 -- 172.21.15.88:0/1929416240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b0161390 msgr2=0x7f39b0154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.273+0000 7f39b5fb8640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b0161390 0x7f39b0154d60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f39a4019110 tx=0x7f39a401ad40 comp rx=0 tx=0).stop 2023-11-20T07:01:41.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.273+0000 7f39b5fb8640 1 -- 172.21.15.88:0/1929416240 shutdown_connections 2023-11-20T07:01:41.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.273+0000 7f39b5fb8640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f399c0664d0 0x7f399c068990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.273+0000 7f39b5fb8640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39b01552a0 0x7f39b00c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.273+0000 7f39b5fb8640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39b0161390 0x7f39b0154d60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.273+0000 7f39b5fb8640 1 --2- 172.21.15.88:0/1929416240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39b006e2f0 0x7f39b0156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.273+0000 7f39b5fb8640 1 -- 172.21.15.88:0/1929416240 >> 172.21.15.88:0/1929416240 conn(0x7f39b00cef20 msgr2=0x7f39b00c8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:41.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.273+0000 7f39b5fb8640 1 -- 172.21.15.88:0/1929416240 shutdown_connections 2023-11-20T07:01:41.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.273+0000 7f39b5fb8640 1 -- 172.21.15.88:0/1929416240 wait complete. 2023-11-20T07:01:41.293 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:41.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadde31d640 1 Processor -- start 2023-11-20T07:01:41.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadde31d640 1 -- start start 2023-11-20T07:01:41.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadde31d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadd806f560 0x7fadd80c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadde31d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd806ac10 con 0x7fadd815cf40 2023-11-20T07:01:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadde31d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd8072110 con 0x7fadd815cb60 2023-11-20T07:01:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadde31d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80723f0 con 0x7fadd806f560 2023-11-20T07:01:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7faddc8ba640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fadd815cf40 0x7fadd8071400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34660/0 (socket says 172.21.15.88:34660) 2023-11-20T07:01:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7faddc8ba640 1 -- 172.21.15.88:0/4244119246 learned_addr learned my addr 172.21.15.88:0/4244119246 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadd77fe640 1 --2- 172.21.15.88:0/4244119246 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadd806f560 0x7fadd80c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadd6ffd640 1 -- 172.21.15.88:0/4244119246 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205504909 0 0) 0x7fadd806ac10 con 0x7fadd815cf40 2023-11-20T07:01:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadd6ffd640 1 -- 172.21.15.88:0/4244119246 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc0003530 con 0x7fadd815cf40 2023-11-20T07:01:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadd6ffd640 1 -- 172.21.15.88:0/4244119246 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825215235 0 0) 0x7fadd8072110 con 0x7fadd815cb60 2023-11-20T07:01:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadd6ffd640 1 -- 172.21.15.88:0/4244119246 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd806ac10 con 0x7fadd815cb60 2023-11-20T07:01:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadd77fe640 1 -- 172.21.15.88:0/4244119246 >> v1:172.21.15.175:6789/0 conn(0x7fadd815cb60 legacy=0x7fadd806ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadd77fe640 1 -- 172.21.15.88:0/4244119246 >> v1:172.21.15.88:6789/0 conn(0x7fadd815cf40 legacy=0x7fadd8071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.433+0000 7fadd77fe640 1 -- 172.21.15.88:0/4244119246 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd806a5c0 con 0x7fadd806f560 2023-11-20T07:01:41.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.437+0000 7fadd77fe640 1 --2- 172.21.15.88:0/4244119246 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadd806f560 0x7fadd80c9fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0097f0 tx=0x7fadcc01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5280eca7525f7a25 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.437+0000 7fadd6ffd640 1 -- 172.21.15.88:0/4244119246 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc0ac600 con 0x7fadd806f560 2023-11-20T07:01:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.437+0000 7fadd6ffd640 1 -- 172.21.15.88:0/4244119246 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc0a8050 con 0x7fadd806f560 2023-11-20T07:01:41.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.437+0000 7fadd6ffd640 1 -- 172.21.15.88:0/4244119246 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc0ac980 con 0x7fadd806f560 2023-11-20T07:01:41.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.437+0000 7fadde31d640 1 -- 172.21.15.88:0/4244119246 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadd806f560 msgr2=0x7fadd80c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.437+0000 7fadde31d640 1 --2- 172.21.15.88:0/4244119246 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadd806f560 0x7fadd80c9fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0097f0 tx=0x7fadcc01c490 comp rx=0 tx=0).stop 2023-11-20T07:01:41.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.437+0000 7fadde31d640 1 -- 172.21.15.88:0/4244119246 shutdown_connections 2023-11-20T07:01:41.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.437+0000 7fadde31d640 1 --2- 172.21.15.88:0/4244119246 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadd806f560 0x7fadd80c9fd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.437+0000 7fadde31d640 1 -- 172.21.15.88:0/4244119246 >> 172.21.15.88:0/4244119246 conn(0x7fadd80cf7a0 msgr2=0x7fadd80cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:41.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.437+0000 7fadde31d640 1 -- 172.21.15.88:0/4244119246 shutdown_connections 2023-11-20T07:01:41.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.437+0000 7fadde31d640 1 -- 172.21.15.88:0/4244119246 wait complete. 2023-11-20T07:01:41.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadde31d640 1 Processor -- start 2023-11-20T07:01:41.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadde31d640 1 -- start start 2023-11-20T07:01:41.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadde31d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd806f560 0x7fadd80c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadde31d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadd815cb60 0x7fadd8156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadde31d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd815cf40 0x7fadd80c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadde31d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd815bba0 con 0x7fadd815cf40 2023-11-20T07:01:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadde31d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80c4f30 con 0x7fadd806f560 2023-11-20T07:01:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadde31d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd815b8c0 con 0x7fadd815cb60 2023-11-20T07:01:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7faddc8ba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd815cf40 0x7fadd80c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7faddc8ba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd815cf40 0x7fadd80c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38638/0 (socket says 172.21.15.88:38638) 2023-11-20T07:01:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7faddc8ba640 1 -- 172.21.15.88:0/2664399336 learned_addr learned my addr 172.21.15.88:0/2664399336 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadd7fff640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd806f560 0x7fadd80c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadd77fe640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadd815cb60 0x7fadd8156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7faddc8ba640 1 -- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadd815cb60 msgr2=0x7fadd8156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7faddc8ba640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadd815cb60 0x7fadd8156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7faddc8ba640 1 -- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd806f560 msgr2=0x7fadd80c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7faddc8ba640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd806f560 0x7fadd80c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7faddc8ba640 1 -- 172.21.15.88:0/2664399336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc009420 con 0x7fadd815cf40 2023-11-20T07:01:41.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7faddc8ba640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd815cf40 0x7fadd80c8f00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fadd000cb70 tx=0x7fadd000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:41.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadd4ff9640 1 -- 172.21.15.88:0/2664399336 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000ace0 con 0x7fadd815cf40 2023-11-20T07:01:41.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadd4ff9640 1 -- 172.21.15.88:0/2664399336 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd000ae40 con 0x7fadd815cf40 2023-11-20T07:01:41.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadd4ff9640 1 -- 172.21.15.88:0/2664399336 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0012620 con 0x7fadd815cf40 2023-11-20T07:01:41.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadde31d640 1 -- 172.21.15.88:0/2664399336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd80c51d0 con 0x7fadd815cf40 2023-11-20T07:01:41.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadde31d640 1 -- 172.21.15.88:0/2664399336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd81570c0 con 0x7fadd815cf40 2023-11-20T07:01:41.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.441+0000 7fadde31d640 1 -- 172.21.15.88:0/2664399336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd80c9960 con 0x7fadd815cf40 2023-11-20T07:01:41.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.445+0000 7fadd4ff9640 1 -- 172.21.15.88:0/2664399336 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fadd0007070 con 0x7fadd815cf40 2023-11-20T07:01:41.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.445+0000 7fadd4ff9640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fadc40664a0 0x7fadc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.445+0000 7fadd4ff9640 1 -- 172.21.15.88:0/2664399336 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fadd00840f0 con 0x7fadd815cf40 2023-11-20T07:01:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.445+0000 7fadd7fff640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fadc40664a0 0x7fadc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.445+0000 7fadd7fff640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fadc40664a0 0x7fadc4068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fadc80011f0 tx=0x7fadc8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:41.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.449+0000 7fadd4ff9640 1 -- 172.21.15.88:0/2664399336 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fadd0054d80 con 0x7fadd815cf40 2023-11-20T07:01:41.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.597+0000 7fadde31d640 1 -- 172.21.15.88:0/2664399336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fadd804e170 con 0x7fadd815cf40 2023-11-20T07:01:41.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.597+0000 7fadd4ff9640 1 -- 172.21.15.88:0/2664399336 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fadd0054910 con 0x7fadd815cf40 2023-11-20T07:01:41.601 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:41.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.601+0000 7fadde31d640 1 -- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fadc40664a0 msgr2=0x7fadc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.601+0000 7fadde31d640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fadc40664a0 0x7fadc4068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fadc80011f0 tx=0x7fadc8009040 comp rx=0 tx=0).stop 2023-11-20T07:01:41.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.601+0000 7fadde31d640 1 -- 172.21.15.88:0/2664399336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd815cf40 msgr2=0x7fadd80c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.601+0000 7fadde31d640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd815cf40 0x7fadd80c8f00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fadd000cb70 tx=0x7fadd000a430 comp rx=0 tx=0).stop 2023-11-20T07:01:41.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.601+0000 7fadde31d640 1 -- 172.21.15.88:0/2664399336 shutdown_connections 2023-11-20T07:01:41.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.601+0000 7fadde31d640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fadc40664a0 0x7fadc4068960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.601+0000 7fadde31d640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadd815cb60 0x7fadd8156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.601+0000 7fadde31d640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadd815cf40 0x7fadd80c8f00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.601+0000 7fadde31d640 1 --2- 172.21.15.88:0/2664399336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd806f560 0x7fadd80c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.601+0000 7fadde31d640 1 -- 172.21.15.88:0/2664399336 >> 172.21.15.88:0/2664399336 conn(0x7fadd80cf7a0 msgr2=0x7fadd815d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:41.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.601+0000 7fadde31d640 1 -- 172.21.15.88:0/2664399336 shutdown_connections 2023-11-20T07:01:41.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.601+0000 7fadde31d640 1 -- 172.21.15.88:0/2664399336 wait complete. 2023-11-20T07:01:41.621 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:41.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.765+0000 7f621ff0f640 1 Processor -- start 2023-11-20T07:01:41.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621ff0f640 1 -- start start 2023-11-20T07:01:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621ff0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621815cba0 0x7f62180d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621ff0f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f62180d0210 0x7f62180b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621ff0f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62180d1670 con 0x7f62180b84e0 2023-11-20T07:01:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621ff0f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62180d1460 con 0x7f62180d0210 2023-11-20T07:01:41.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621ff0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62180d1950 con 0x7f621815cba0 2023-11-20T07:01:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621e4ac640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f62180d0210 0x7f62180b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621e4ac640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f62180d0210 0x7f62180b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:37330/0 (socket says 172.21.15.88:37330) 2023-11-20T07:01:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621dcab640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621815cba0 0x7f62180d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621e4ac640 1 -- 172.21.15.88:0/1343051910 learned_addr learned my addr 172.21.15.88:0/1343051910 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:41.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621e4ac640 1 -- 172.21.15.88:0/1343051910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621815cba0 msgr2=0x7f62180d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:41.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621e4ac640 1 --2- 172.21.15.88:0/1343051910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621815cba0 0x7f62180d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621e4ac640 1 -- 172.21.15.88:0/1343051910 >> v1:172.21.15.175:6789/0 conn(0x7f62180b84e0 legacy=0x7f62180cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621e4ac640 1 -- 172.21.15.88:0/1343051910 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62180d1c30 con 0x7f62180d0210 2023-11-20T07:01:41.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621dcab640 1 --2- 172.21.15.88:0/1343051910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621815cba0 0x7f62180d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:41.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.769+0000 7f621cca9640 1 -- 172.21.15.88:0/1343051910 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192503017 0 0) 0x7f62180d1670 con 0x7f62180b84e0 2023-11-20T07:01:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.773+0000 7f621e4ac640 1 --2- 172.21.15.88:0/1343051910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62180d0210 0x7f62180b5cf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6210009e50 tx=0x7f621001ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ff627e213928c8a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.773+0000 7f621cca9640 1 -- 172.21.15.88:0/1343051910 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62100a58e0 con 0x7f62180d0210 2023-11-20T07:01:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.773+0000 7f621cca9640 1 -- 172.21.15.88:0/1343051910 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62100a5a40 con 0x7f62180d0210 2023-11-20T07:01:41.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.773+0000 7f621cca9640 1 -- 172.21.15.88:0/1343051910 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62100a5dd0 con 0x7f62180d0210 2023-11-20T07:01:41.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.773+0000 7f621ff0f640 1 -- 172.21.15.88:0/1343051910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62180d0210 msgr2=0x7f62180b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.773+0000 7f621ff0f640 1 --2- 172.21.15.88:0/1343051910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62180d0210 0x7f62180b5cf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6210009e50 tx=0x7f621001ca10 comp rx=0 tx=0).stop 2023-11-20T07:01:41.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.773+0000 7f621ff0f640 1 -- 172.21.15.88:0/1343051910 shutdown_connections 2023-11-20T07:01:41.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.773+0000 7f621ff0f640 1 --2- 172.21.15.88:0/1343051910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62180d0210 0x7f62180b5cf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.773+0000 7f621ff0f640 1 --2- 172.21.15.88:0/1343051910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f621815cba0 0x7f62180d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.773+0000 7f621ff0f640 1 -- 172.21.15.88:0/1343051910 >> 172.21.15.88:0/1343051910 conn(0x7f62180719c0 msgr2=0x7f6218071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:41.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.773+0000 7f621ff0f640 1 -- 172.21.15.88:0/1343051910 shutdown_connections 2023-11-20T07:01:41.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.773+0000 7f621ff0f640 1 -- 172.21.15.88:0/1343051910 wait complete. 2023-11-20T07:01:41.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621ff0f640 1 Processor -- start 2023-11-20T07:01:41.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621ff0f640 1 -- start start 2023-11-20T07:01:41.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621ff0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62180b84e0 0x7f62180c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621ff0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62180d0210 0x7f62180c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621ff0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f621815cba0 0x7f6218150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621ff0f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621815e260 con 0x7f62180b84e0 2023-11-20T07:01:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621ff0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6218151260 con 0x7f621815cba0 2023-11-20T07:01:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621ff0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62180c8690 con 0x7f62180d0210 2023-11-20T07:01:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621dcab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62180b84e0 0x7f62180c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621dcab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62180b84e0 0x7f62180c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38640/0 (socket says 172.21.15.88:38640) 2023-11-20T07:01:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621dcab640 1 -- 172.21.15.88:0/4147645018 learned_addr learned my addr 172.21.15.88:0/4147645018 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621d4aa640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62180d0210 0x7f62180c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621e4ac640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f621815cba0 0x7f6218150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621dcab640 1 -- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62180d0210 msgr2=0x7f62180c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621dcab640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62180d0210 0x7f62180c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621dcab640 1 -- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f621815cba0 msgr2=0x7f6218150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621dcab640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f621815cba0 0x7f6218150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621dcab640 1 -- 172.21.15.88:0/4147645018 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214009420 con 0x7f62180b84e0 2023-11-20T07:01:41.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621e4ac640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f621815cba0 0x7f6218150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621dcab640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62180b84e0 0x7f62180c80b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f621400ec10 tx=0x7f621400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f620e7fc640 1 -- 172.21.15.88:0/4147645018 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621400cc30 con 0x7f62180b84e0 2023-11-20T07:01:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f620e7fc640 1 -- 172.21.15.88:0/4147645018 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621400cd90 con 0x7f62180b84e0 2023-11-20T07:01:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f620e7fc640 1 -- 172.21.15.88:0/4147645018 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214013690 con 0x7f62180b84e0 2023-11-20T07:01:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621ff0f640 1 -- 172.21.15.88:0/4147645018 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6210009b30 con 0x7f62180b84e0 2023-11-20T07:01:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621ff0f640 1 -- 172.21.15.88:0/4147645018 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62180c8c50 con 0x7f62180b84e0 2023-11-20T07:01:41.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.777+0000 7f621ff0f640 1 -- 172.21.15.88:0/4147645018 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621815e030 con 0x7f62180b84e0 2023-11-20T07:01:41.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.781+0000 7f620e7fc640 1 -- 172.21.15.88:0/4147645018 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f62140137f0 con 0x7f62180b84e0 2023-11-20T07:01:41.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.781+0000 7f620e7fc640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f61fc0664a0 0x7f61fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:41.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.781+0000 7f620e7fc640 1 -- 172.21.15.88:0/4147645018 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f62140844a0 con 0x7f62180b84e0 2023-11-20T07:01:41.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.781+0000 7f621d4aa640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f61fc0664a0 0x7f61fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:41.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.781+0000 7f621d4aa640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f61fc0664a0 0x7f61fc068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f621815c4f0 tx=0x7f6208009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:41.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.785+0000 7f620e7fc640 1 -- 172.21.15.88:0/4147645018 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6214051600 con 0x7f62180b84e0 2023-11-20T07:01:41.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 -- 172.21.15.88:0/4147645018 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f621804e170 con 0x7f62180b84e0 2023-11-20T07:01:41.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f620e7fc640 1 -- 172.21.15.88:0/4147645018 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6214054c20 con 0x7f62180b84e0 2023-11-20T07:01:41.935 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:41.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 -- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f61fc0664a0 msgr2=0x7f61fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f61fc0664a0 0x7f61fc068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f621815c4f0 tx=0x7f6208009040 comp rx=0 tx=0).stop 2023-11-20T07:01:41.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 -- 172.21.15.88:0/4147645018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62180b84e0 msgr2=0x7f62180c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:41.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62180b84e0 0x7f62180c80b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f621400ec10 tx=0x7f621400c520 comp rx=0 tx=0).stop 2023-11-20T07:01:41.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 -- 172.21.15.88:0/4147645018 shutdown_connections 2023-11-20T07:01:41.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f61fc0664a0 0x7f61fc068960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62180d0210 0x7f62180c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f621815cba0 0x7f6218150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 --2- 172.21.15.88:0/4147645018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62180b84e0 0x7f62180c80b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:41.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 -- 172.21.15.88:0/4147645018 >> 172.21.15.88:0/4147645018 conn(0x7f62180719c0 msgr2=0x7f62180b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:41.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 -- 172.21.15.88:0/4147645018 shutdown_connections 2023-11-20T07:01:41.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:41.933+0000 7f621ff0f640 1 -- 172.21.15.88:0/4147645018 wait complete. 2023-11-20T07:01:41.955 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd839fab640 1 Processor -- start 2023-11-20T07:01:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd839fab640 1 -- start start 2023-11-20T07:01:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd839fab640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd83415cba0 0x7fd8340d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd839fab640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340d1670 con 0x7fd8340d0210 2023-11-20T07:01:42.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd839fab640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340d1950 con 0x7fd8340b84e0 2023-11-20T07:01:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd839fab640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340d1460 con 0x7fd83415cba0 2023-11-20T07:01:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd833fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd8340d0210 0x7fd8340b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34672/0 (socket says 172.21.15.88:34672) 2023-11-20T07:01:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd833fff640 1 -- 172.21.15.88:0/1100871239 learned_addr learned my addr 172.21.15.88:0/1100871239 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd8337fe640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd83415cba0 0x7fd8340d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034553472 0 0) 0x7fd8340d1670 con 0x7fd8340d0210 2023-11-20T07:01:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd820003530 con 0x7fd8340d0210 2023-11-20T07:01:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144112674 0 0) 0x7fd8340d1950 con 0x7fd8340b84e0 2023-11-20T07:01:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8340d1670 con 0x7fd8340b84e0 2023-11-20T07:01:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.097+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4135941824 0 0) 0x7fd820003530 con 0x7fd8340d0210 2023-11-20T07:01:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd83415cba0 msgr2=0x7fd8340d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd83415cba0 0x7fd8340d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 >> v1:172.21.15.175:6789/0 conn(0x7fd8340b84e0 legacy=0x7fd8340cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340d1c30 con 0x7fd8340d0210 2023-11-20T07:01:42.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fd82c001980 con 0x7fd8340d0210 2023-11-20T07:01:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd8337fe640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd83415cba0 0x7fd8340d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 >> v1:172.21.15.88:6789/0 conn(0x7fd8340d0210 legacy=0x7fd8340b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd820003b40 0x7fd820003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8200047d0 0x7fd820004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd83415cba0 0x7fd820005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340d1460 con 0x7fd8200047d0 2023-11-20T07:01:42.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82000ba40 con 0x7fd820003b40 2023-11-20T07:01:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82000bbd0 con 0x7fd83415cba0 2023-11-20T07:01:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd82bfff640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8200047d0 0x7fd820004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd8337fe640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd820003b40 0x7fd820003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd833fff640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd83415cba0 0x7fd820005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd82bfff640 1 -- 172.21.15.88:0/1100871239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd83415cba0 msgr2=0x7fd820005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd82bfff640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd83415cba0 0x7fd820005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd82bfff640 1 -- 172.21.15.88:0/1100871239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd820003b40 msgr2=0x7fd820003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd82bfff640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd820003b40 0x7fd820003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd82bfff640 1 -- 172.21.15.88:0/1100871239 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd824009420 con 0x7fd8200047d0 2023-11-20T07:01:42.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd82bfff640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8200047d0 0x7fd820004c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd81c007fd0 tx=0x7fd81c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b2c4cdca651624 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:42.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c0052d0 con 0x7fd8200047d0 2023-11-20T07:01:42.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.101+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81c005450 con 0x7fd8200047d0 2023-11-20T07:01:42.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd832ffd640 1 -- 172.21.15.88:0/1100871239 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c0a88f0 con 0x7fd8200047d0 2023-11-20T07:01:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 -- 172.21.15.88:0/1100871239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8200047d0 msgr2=0x7fd820004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 --2- 172.21.15.88:0/1100871239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8200047d0 0x7fd820004c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd81c007fd0 tx=0x7fd81c01ec90 comp rx=0 tx=0).stop 2023-11-20T07:01:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd833fff640 1 -- 172.21.15.88:0/1100871239 reap_dead start 2023-11-20T07:01:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 -- 172.21.15.88:0/1100871239 shutdown_connections 2023-11-20T07:01:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 -- 172.21.15.88:0/1100871239 >> 172.21.15.88:0/1100871239 conn(0x7fd8340719c0 msgr2=0x7fd834071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 -- 172.21.15.88:0/1100871239 shutdown_connections 2023-11-20T07:01:42.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 -- 172.21.15.88:0/1100871239 wait complete. 2023-11-20T07:01:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 Processor -- start 2023-11-20T07:01:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 -- start start 2023-11-20T07:01:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8200047d0 0x7fd834158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd83415ea80 0x7fd83415ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8340cae60 0x7fd8340cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83415f440 con 0x7fd8200047d0 2023-11-20T07:01:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340aa470 con 0x7fd83415ea80 2023-11-20T07:01:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd839fab640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340cbbf0 con 0x7fd8340cae60 2023-11-20T07:01:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd8337fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8200047d0 0x7fd834158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd8337fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8200047d0 0x7fd834158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38658/0 (socket says 172.21.15.88:38658) 2023-11-20T07:01:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd8337fe640 1 -- 172.21.15.88:0/895438925 learned_addr learned my addr 172.21.15.88:0/895438925 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd82bfff640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd83415ea80 0x7fd83415ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.105+0000 7fd833fff640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8340cae60 0x7fd8340cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd8337fe640 1 -- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8340cae60 msgr2=0x7fd8340cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd8337fe640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8340cae60 0x7fd8340cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd8337fe640 1 -- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd83415ea80 msgr2=0x7fd83415ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd8337fe640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd83415ea80 0x7fd83415ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd8337fe640 1 -- 172.21.15.88:0/895438925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340cbed0 con 0x7fd8200047d0 2023-11-20T07:01:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd833fff640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8340cae60 0x7fd8340cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd8337fe640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8200047d0 0x7fd834158910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd824011d00 tx=0x7fd82400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:42.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd830ff9640 1 -- 172.21.15.88:0/895438925 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82400fd20 con 0x7fd8200047d0 2023-11-20T07:01:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd830ff9640 1 -- 172.21.15.88:0/895438925 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82400fe80 con 0x7fd8200047d0 2023-11-20T07:01:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd830ff9640 1 -- 172.21.15.88:0/895438925 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824004240 con 0x7fd8200047d0 2023-11-20T07:01:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd839fab640 1 -- 172.21.15.88:0/895438925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8340cc1b0 con 0x7fd8200047d0 2023-11-20T07:01:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd839fab640 1 -- 172.21.15.88:0/895438925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8340cb820 con 0x7fd8200047d0 2023-11-20T07:01:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd839fab640 1 -- 172.21.15.88:0/895438925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8340cc3a0 con 0x7fd8200047d0 2023-11-20T07:01:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd830ff9640 1 -- 172.21.15.88:0/895438925 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd8240043a0 con 0x7fd8200047d0 2023-11-20T07:01:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.109+0000 7fd830ff9640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd8140664a0 0x7fd814068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.113+0000 7fd830ff9640 1 -- 172.21.15.88:0/895438925 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd8240847c0 con 0x7fd8200047d0 2023-11-20T07:01:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.113+0000 7fd82bfff640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd8140664a0 0x7fd814068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.113+0000 7fd82bfff640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd8140664a0 0x7fd814068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0b0000 tx=0x7fd81c0aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.117+0000 7fd830ff9640 1 -- 172.21.15.88:0/895438925 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd8240519c0 con 0x7fd8200047d0 2023-11-20T07:01:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 -- 172.21.15.88:0/895438925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd83404e170 con 0x7fd8200047d0 2023-11-20T07:01:42.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd830ff9640 1 -- 172.21.15.88:0/895438925 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd8240220a0 con 0x7fd8200047d0 2023-11-20T07:01:42.266 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 -- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd8140664a0 msgr2=0x7fd814068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd8140664a0 0x7fd814068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0b0000 tx=0x7fd81c0aa070 comp rx=0 tx=0).stop 2023-11-20T07:01:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 -- 172.21.15.88:0/895438925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8200047d0 msgr2=0x7fd834158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8200047d0 0x7fd834158910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd824011d00 tx=0x7fd82400f610 comp rx=0 tx=0).stop 2023-11-20T07:01:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 -- 172.21.15.88:0/895438925 shutdown_connections 2023-11-20T07:01:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd8140664a0 0x7fd814068960 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8340cae60 0x7fd8340cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd83415ea80 0x7fd83415ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 --2- 172.21.15.88:0/895438925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8200047d0 0x7fd834158910 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 -- 172.21.15.88:0/895438925 >> 172.21.15.88:0/895438925 conn(0x7fd8340719c0 msgr2=0x7fd8340d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 -- 172.21.15.88:0/895438925 shutdown_connections 2023-11-20T07:01:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.265+0000 7fd839fab640 1 -- 172.21.15.88:0/895438925 wait complete. 2023-11-20T07:01:42.286 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:42.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.425+0000 7f391ecea640 1 Processor -- start 2023-11-20T07:01:42.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.425+0000 7f391ecea640 1 -- start start 2023-11-20T07:01:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.425+0000 7f391ecea640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3918070c90 0x7f39180b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.425+0000 7f391ecea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3918145f50 0x7f39180b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.425+0000 7f391ecea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391806e0f0 con 0x7f3918145950 2023-11-20T07:01:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.425+0000 7f391ecea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3918145d30 con 0x7f3918145f50 2023-11-20T07:01:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.425+0000 7f391ecea640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39180b1860 con 0x7f3918070c90 2023-11-20T07:01:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.425+0000 7f391ca86640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3918145950 0x7f3918070580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34682/0 (socket says 172.21.15.88:34682) 2023-11-20T07:01:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.425+0000 7f391ca86640 1 -- 172.21.15.88:0/2878027055 learned_addr learned my addr 172.21.15.88:0/2878027055 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.425+0000 7f391d287640 1 --2- 172.21.15.88:0/2878027055 >> v2:172.21.15.88:3300/0 conn(0x7f3918145f50 0x7f39180b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.425+0000 7f3917fff640 1 --2- 172.21.15.88:0/2878027055 >> v2:172.21.15.175:3300/0 conn(0x7f3918070c90 0x7f39180b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391d287640 1 -- 172.21.15.88:0/2878027055 >> v2:172.21.15.175:3300/0 conn(0x7f3918070c90 msgr2=0x7f39180b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:42.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391d287640 1 --2- 172.21.15.88:0/2878027055 >> v2:172.21.15.175:3300/0 conn(0x7f3918070c90 0x7f39180b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391d287640 1 -- 172.21.15.88:0/2878027055 >> v1:172.21.15.88:6789/0 conn(0x7f3918145950 legacy=0x7f3918070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391d287640 1 -- 172.21.15.88:0/2878027055 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39180b1b20 con 0x7f3918145f50 2023-11-20T07:01:42.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f39177fe640 1 -- 172.21.15.88:0/2878027055 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940902791 0 0) 0x7f390c001120 con 0x7f3918145950 2023-11-20T07:01:42.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391d287640 1 --2- 172.21.15.88:0/2878027055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3918145f50 0x7f39180b3100 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f39180cf9f0 tx=0x7f391001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ed50367ea65d7a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f39177fe640 1 -- 172.21.15.88:0/2878027055 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39100a58b0 con 0x7f3918145f50 2023-11-20T07:01:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f39177fe640 1 -- 172.21.15.88:0/2878027055 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39100a5a10 con 0x7f3918145f50 2023-11-20T07:01:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f39177fe640 1 -- 172.21.15.88:0/2878027055 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39100a5da0 con 0x7f3918145f50 2023-11-20T07:01:42.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391ecea640 1 -- 172.21.15.88:0/2878027055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3918145f50 msgr2=0x7f39180b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391ecea640 1 --2- 172.21.15.88:0/2878027055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3918145f50 0x7f39180b3100 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f39180cf9f0 tx=0x7f391001c8e0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391ecea640 1 -- 172.21.15.88:0/2878027055 shutdown_connections 2023-11-20T07:01:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391ecea640 1 --2- 172.21.15.88:0/2878027055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3918145f50 0x7f39180b3100 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391ecea640 1 --2- 172.21.15.88:0/2878027055 >> v2:172.21.15.175:3300/0 conn(0x7f3918070c90 0x7f39180b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391ecea640 1 -- 172.21.15.88:0/2878027055 >> 172.21.15.88:0/2878027055 conn(0x7f391806a540 msgr2=0x7f39180b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391ecea640 1 -- 172.21.15.88:0/2878027055 shutdown_connections 2023-11-20T07:01:42.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.429+0000 7f391ecea640 1 -- 172.21.15.88:0/2878027055 wait complete. 2023-11-20T07:01:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391ecea640 1 Processor -- start 2023-11-20T07:01:42.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391ecea640 1 -- start start 2023-11-20T07:01:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391ecea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918070c90 0x7f39180acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391ecea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3918145950 0x7f39181416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391ecea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3918145f50 0x7f391815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391ecea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391813e3c0 con 0x7f3918145f50 2023-11-20T07:01:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391ecea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39180aca90 con 0x7f3918070c90 2023-11-20T07:01:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391ecea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3918141be0 con 0x7f3918145950 2023-11-20T07:01:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391d287640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3918145f50 0x7f391815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391d287640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3918145f50 0x7f391815a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38670/0 (socket says 172.21.15.88:38670) 2023-11-20T07:01:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391d287640 1 -- 172.21.15.88:0/288739994 learned_addr learned my addr 172.21.15.88:0/288739994 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391ca86640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918070c90 0x7f39180acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f3917fff640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3918145950 0x7f39181416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391d287640 1 -- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3918145950 msgr2=0x7f39181416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391d287640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3918145950 0x7f39181416a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391d287640 1 -- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918070c90 msgr2=0x7f39180acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391d287640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918070c90 0x7f39180acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391d287640 1 -- 172.21.15.88:0/288739994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3910009a70 con 0x7f3918145f50 2023-11-20T07:01:42.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f3917fff640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3918145950 0x7f39181416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.433+0000 7f391d287640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3918145f50 0x7f391815a8a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f39100b0040 tx=0x7f3910019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.437+0000 7f39157fa640 1 -- 172.21.15.88:0/288739994 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39100b9860 con 0x7f3918145f50 2023-11-20T07:01:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.437+0000 7f39157fa640 1 -- 172.21.15.88:0/288739994 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39100b99c0 con 0x7f3918145f50 2023-11-20T07:01:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.437+0000 7f39157fa640 1 -- 172.21.15.88:0/288739994 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39100b9d70 con 0x7f3918145f50 2023-11-20T07:01:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.437+0000 7f391ecea640 1 -- 172.21.15.88:0/288739994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391815ade0 con 0x7f3918145f50 2023-11-20T07:01:42.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.437+0000 7f391ecea640 1 -- 172.21.15.88:0/288739994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39180ac440 con 0x7f3918145f50 2023-11-20T07:01:42.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.437+0000 7f391ecea640 1 -- 172.21.15.88:0/288739994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39180ac2a0 con 0x7f3918145f50 2023-11-20T07:01:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.437+0000 7f39157fa640 1 -- 172.21.15.88:0/288739994 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f39100ad440 con 0x7f3918145f50 2023-11-20T07:01:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.437+0000 7f39157fa640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f38fc0664a0 0x7f38fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.437+0000 7f39157fa640 1 -- 172.21.15.88:0/288739994 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f391011f5b0 con 0x7f3918145f50 2023-11-20T07:01:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.437+0000 7f391ca86640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f38fc0664a0 0x7f38fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.437+0000 7f391ca86640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f38fc0664a0 0x7f38fc068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f390c007fd0 tx=0x7f390c0079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.441+0000 7f39157fa640 1 -- 172.21.15.88:0/288739994 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f39180ac2a0 con 0x7f3918145f50 2023-11-20T07:01:42.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.593+0000 7f391ecea640 1 -- 172.21.15.88:0/288739994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39180ac2a0 con 0x7f3918145f50 2023-11-20T07:01:42.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.593+0000 7f39157fa640 1 -- 172.21.15.88:0/288739994 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f39180ac2a0 con 0x7f3918145f50 2023-11-20T07:01:42.596 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:42.597 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.597+0000 7f391ecea640 1 -- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f38fc0664a0 msgr2=0x7f38fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.597+0000 7f391ecea640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f38fc0664a0 0x7f38fc068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f390c007fd0 tx=0x7f390c0079c0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.597+0000 7f391ecea640 1 -- 172.21.15.88:0/288739994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3918145f50 msgr2=0x7f391815a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.597+0000 7f391ecea640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3918145f50 0x7f391815a8a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f39100b0040 tx=0x7f3910019680 comp rx=0 tx=0).stop 2023-11-20T07:01:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.597+0000 7f391ecea640 1 -- 172.21.15.88:0/288739994 shutdown_connections 2023-11-20T07:01:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.597+0000 7f391ecea640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f38fc0664a0 0x7f38fc068960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.597+0000 7f391ecea640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3918145950 0x7f39181416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.597+0000 7f391ecea640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3918145f50 0x7f391815a8a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.597+0000 7f391ecea640 1 --2- 172.21.15.88:0/288739994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918070c90 0x7f39180acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.597+0000 7f391ecea640 1 -- 172.21.15.88:0/288739994 >> 172.21.15.88:0/288739994 conn(0x7f391806a540 msgr2=0x7f39180cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.597+0000 7f391ecea640 1 -- 172.21.15.88:0/288739994 shutdown_connections 2023-11-20T07:01:42.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.597+0000 7f391ecea640 1 -- 172.21.15.88:0/288739994 wait complete. 2023-11-20T07:01:42.618 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:42.618 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:42.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.757+0000 7f98d0aea640 1 Processor -- start 2023-11-20T07:01:42.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.757+0000 7f98d0aea640 1 -- start start 2023-11-20T07:01:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98d0aea640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f98cc15ce10 0x7f98cc161390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98d0aea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98cc0cd3e0 0x7f98cc0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98d0aea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98cc06e2f0 0x7f98cc06e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98d0aea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc06eca0 con 0x7f98cc0cd3e0 2023-11-20T07:01:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98d0aea640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc0cdc30 con 0x7f98cc15ce10 2023-11-20T07:01:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98d0aea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc0c9750 con 0x7f98cc06e2f0 2023-11-20T07:01:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98c3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98cc0cd3e0 0x7f98cc0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98c3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98cc0cd3e0 0x7f98cc0ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38686/0 (socket says 172.21.15.88:38686) 2023-11-20T07:01:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98c3fff640 1 -- 172.21.15.88:0/2967913408 learned_addr learned my addr 172.21.15.88:0/2967913408 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98ca59c640 1 --2- 172.21.15.88:0/2967913408 >> v2:172.21.15.175:3300/0 conn(0x7f98cc15ce10 0x7f98cc161390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98c3fff640 1 -- 172.21.15.88:0/2967913408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98cc06e2f0 msgr2=0x7f98cc06e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98c3fff640 1 --2- 172.21.15.88:0/2967913408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98cc06e2f0 0x7f98cc06e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98c3fff640 1 -- 172.21.15.88:0/2967913408 >> v2:172.21.15.175:3300/0 conn(0x7f98cc15ce10 msgr2=0x7f98cc161390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98c3fff640 1 --2- 172.21.15.88:0/2967913408 >> v2:172.21.15.175:3300/0 conn(0x7f98cc15ce10 0x7f98cc161390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98c3fff640 1 -- 172.21.15.88:0/2967913408 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc0c99f0 con 0x7f98cc0cd3e0 2023-11-20T07:01:42.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98c3fff640 1 --2- 172.21.15.88:0/2967913408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98cc0cd3e0 0x7f98cc0ca7b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f98cc072050 tx=0x7f98b401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcac18aeda64226e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:42.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98c9d9b640 1 -- 172.21.15.88:0/2967913408 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40aa620 con 0x7f98cc0cd3e0 2023-11-20T07:01:42.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98c9d9b640 1 -- 172.21.15.88:0/2967913408 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b40aa780 con 0x7f98cc0cd3e0 2023-11-20T07:01:42.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.761+0000 7f98c9d9b640 1 -- 172.21.15.88:0/2967913408 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40aab10 con 0x7f98cc0cd3e0 2023-11-20T07:01:42.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 -- 172.21.15.88:0/2967913408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98cc0cd3e0 msgr2=0x7f98cc0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 --2- 172.21.15.88:0/2967913408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98cc0cd3e0 0x7f98cc0ca7b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f98cc072050 tx=0x7f98b401c500 comp rx=0 tx=0).stop 2023-11-20T07:01:42.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 -- 172.21.15.88:0/2967913408 shutdown_connections 2023-11-20T07:01:42.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 --2- 172.21.15.88:0/2967913408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98cc06e2f0 0x7f98cc06e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 --2- 172.21.15.88:0/2967913408 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98cc0cd3e0 0x7f98cc0ca7b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 --2- 172.21.15.88:0/2967913408 >> v2:172.21.15.175:3300/0 conn(0x7f98cc15ce10 0x7f98cc161390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 -- 172.21.15.88:0/2967913408 >> 172.21.15.88:0/2967913408 conn(0x7f98cc0cef20 msgr2=0x7f98cc0cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:42.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 -- 172.21.15.88:0/2967913408 shutdown_connections 2023-11-20T07:01:42.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 -- 172.21.15.88:0/2967913408 wait complete. 2023-11-20T07:01:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 Processor -- start 2023-11-20T07:01:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 -- start start 2023-11-20T07:01:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98cc06e2f0 0x7f98cc0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98cc0cd3e0 0x7f98cc0c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98cc15b640 0x7f98cc0c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc1555a0 con 0x7f98cc15b640 2023-11-20T07:01:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc0c5320 con 0x7f98cc06e2f0 2023-11-20T07:01:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98d0aea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc0c5600 con 0x7f98cc0cd3e0 2023-11-20T07:01:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98cad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98cc15b640 0x7f98cc0c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98cad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98cc15b640 0x7f98cc0c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38698/0 (socket says 172.21.15.88:38698) 2023-11-20T07:01:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98cad9d640 1 -- 172.21.15.88:0/3565670136 learned_addr learned my addr 172.21.15.88:0/3565670136 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.765+0000 7f98ca59c640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98cc06e2f0 0x7f98cc0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98cad9d640 1 -- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98cc0cd3e0 msgr2=0x7f98cc0c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98cad9d640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98cc0cd3e0 0x7f98cc0c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98cad9d640 1 -- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98cc06e2f0 msgr2=0x7f98cc0b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98cad9d640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98cc06e2f0 0x7f98cc0b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98cad9d640 1 -- 172.21.15.88:0/3565670136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b40094d0 con 0x7f98cc15b640 2023-11-20T07:01:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98cad9d640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98cc15b640 0x7f98cc0c65b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f98c400b970 tx=0x7f98c400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98c2ffd640 1 -- 172.21.15.88:0/3565670136 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c400cb40 con 0x7f98cc15b640 2023-11-20T07:01:42.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98c2ffd640 1 -- 172.21.15.88:0/3565670136 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c400ccc0 con 0x7f98cc15b640 2023-11-20T07:01:42.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98c2ffd640 1 -- 172.21.15.88:0/3565670136 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4014680 con 0x7f98cc15b640 2023-11-20T07:01:42.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98d0aea640 1 -- 172.21.15.88:0/3565670136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc0c58e0 con 0x7f98cc15b640 2023-11-20T07:01:42.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98d0aea640 1 -- 172.21.15.88:0/3565670136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc0c4fd0 con 0x7f98cc15b640 2023-11-20T07:01:42.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98d0aea640 1 -- 172.21.15.88:0/3565670136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98cc04e170 con 0x7f98cc15b640 2023-11-20T07:01:42.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98c2ffd640 1 -- 172.21.15.88:0/3565670136 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f98c401d3b0 con 0x7f98cc15b640 2023-11-20T07:01:42.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98c2ffd640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98ac0664d0 0x7f98ac068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:42.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98c2ffd640 1 -- 172.21.15.88:0/3565670136 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f98c4084010 con 0x7f98cc15b640 2023-11-20T07:01:42.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.769+0000 7f98ca59c640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98ac0664d0 0x7f98ac068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.773+0000 7f98ca59c640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98ac0664d0 0x7f98ac068990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009ac0 tx=0x7f98bc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:42.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.773+0000 7f98c2ffd640 1 -- 172.21.15.88:0/3565670136 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f98c4051210 con 0x7f98cc15b640 2023-11-20T07:01:42.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.921+0000 7f98d0aea640 1 -- 172.21.15.88:0/3565670136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98cc0c5d90 con 0x7f98cc15b640 2023-11-20T07:01:42.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.921+0000 7f98c2ffd640 1 -- 172.21.15.88:0/3565670136 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f98c4019020 con 0x7f98cc15b640 2023-11-20T07:01:42.924 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:42.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.925+0000 7f98d0aea640 1 -- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98ac0664d0 msgr2=0x7f98ac068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.925+0000 7f98d0aea640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98ac0664d0 0x7f98ac068990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009ac0 tx=0x7f98bc009190 comp rx=0 tx=0).stop 2023-11-20T07:01:42.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.925+0000 7f98d0aea640 1 -- 172.21.15.88:0/3565670136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98cc15b640 msgr2=0x7f98cc0c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:42.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.925+0000 7f98d0aea640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98cc15b640 0x7f98cc0c65b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f98c400b970 tx=0x7f98c400be30 comp rx=0 tx=0).stop 2023-11-20T07:01:42.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.925+0000 7f98d0aea640 1 -- 172.21.15.88:0/3565670136 shutdown_connections 2023-11-20T07:01:42.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.925+0000 7f98d0aea640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98ac0664d0 0x7f98ac068990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.925+0000 7f98d0aea640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98cc0cd3e0 0x7f98cc0c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.925+0000 7f98d0aea640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98cc15b640 0x7f98cc0c65b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.925+0000 7f98d0aea640 1 --2- 172.21.15.88:0/3565670136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98cc06e2f0 0x7f98cc0b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:42.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.925+0000 7f98d0aea640 1 -- 172.21.15.88:0/3565670136 >> 172.21.15.88:0/3565670136 conn(0x7f98cc0cef20 msgr2=0x7f98cc0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:42.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.925+0000 7f98d0aea640 1 -- 172.21.15.88:0/3565670136 shutdown_connections 2023-11-20T07:01:42.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:42.925+0000 7f98d0aea640 1 -- 172.21.15.88:0/3565670136 wait complete. 2023-11-20T07:01:42.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f37969f8640 1 Processor -- start 2023-11-20T07:01:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f37969f8640 1 -- start start 2023-11-20T07:01:43.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f37969f8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f379015cc30 0x7f37900b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f37969f8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37900d1fa0 0x7f37900b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f37969f8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379015d010 con 0x7f37900cd840 2023-11-20T07:01:43.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f37969f8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37900b74d0 con 0x7f37900d1fa0 2023-11-20T07:01:43.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f37969f8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37900b77b0 con 0x7f379015cc30 2023-11-20T07:01:43.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f3794f95640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37900d1fa0 0x7f37900b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f378f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f37900cd840 0x7f37900cdc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34698/0 (socket says 172.21.15.88:34698) 2023-11-20T07:01:43.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f378f7fe640 1 -- 172.21.15.88:0/1279384544 learned_addr learned my addr 172.21.15.88:0/1279384544 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:43.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f378ffff640 1 --2- 172.21.15.88:0/1279384544 >> v2:172.21.15.175:3300/0 conn(0x7f379015cc30 0x7f37900b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f3794f95640 1 -- 172.21.15.88:0/1279384544 >> v2:172.21.15.175:3300/0 conn(0x7f379015cc30 msgr2=0x7f37900b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:43.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f3794f95640 1 --2- 172.21.15.88:0/1279384544 >> v2:172.21.15.175:3300/0 conn(0x7f379015cc30 0x7f37900b8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f3794f95640 1 -- 172.21.15.88:0/1279384544 >> v1:172.21.15.88:6789/0 conn(0x7f37900cd840 legacy=0x7f37900cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f378effd640 1 -- 172.21.15.88:0/1279384544 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796426194 0 0) 0x7f379015d010 con 0x7f37900cd840 2023-11-20T07:01:43.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.085+0000 7f3794f95640 1 -- 172.21.15.88:0/1279384544 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37900b7a90 con 0x7f37900d1fa0 2023-11-20T07:01:43.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.089+0000 7f3794f95640 1 --2- 172.21.15.88:0/1279384544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37900d1fa0 0x7f37900b5be0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f37900b4720 tx=0x7f378801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958b1ffa6b96d2d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:43.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.089+0000 7f378effd640 1 -- 172.21.15.88:0/1279384544 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880a59c0 con 0x7f37900d1fa0 2023-11-20T07:01:43.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.089+0000 7f378effd640 1 -- 172.21.15.88:0/1279384544 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37880a5b20 con 0x7f37900d1fa0 2023-11-20T07:01:43.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.089+0000 7f378effd640 1 -- 172.21.15.88:0/1279384544 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880ad440 con 0x7f37900d1fa0 2023-11-20T07:01:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.089+0000 7f37969f8640 1 -- 172.21.15.88:0/1279384544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37900d1fa0 msgr2=0x7f37900b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.089+0000 7f37969f8640 1 --2- 172.21.15.88:0/1279384544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37900d1fa0 0x7f37900b5be0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f37900b4720 tx=0x7f378801c8e0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.089+0000 7f37969f8640 1 -- 172.21.15.88:0/1279384544 shutdown_connections 2023-11-20T07:01:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.089+0000 7f37969f8640 1 --2- 172.21.15.88:0/1279384544 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37900d1fa0 0x7f37900b5be0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.089+0000 7f37969f8640 1 --2- 172.21.15.88:0/1279384544 >> v2:172.21.15.175:3300/0 conn(0x7f379015cc30 0x7f37900b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.089+0000 7f37969f8640 1 -- 172.21.15.88:0/1279384544 >> 172.21.15.88:0/1279384544 conn(0x7f379006b750 msgr2=0x7f379006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:43.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.089+0000 7f37969f8640 1 -- 172.21.15.88:0/1279384544 shutdown_connections 2023-11-20T07:01:43.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.089+0000 7f37969f8640 1 -- 172.21.15.88:0/1279384544 wait complete. 2023-11-20T07:01:43.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f37969f8640 1 Processor -- start 2023-11-20T07:01:43.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f37969f8640 1 -- start start 2023-11-20T07:01:43.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f37969f8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37900cd840 0x7f3790149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f37969f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37900d1fa0 0x7f379015d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f37969f8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f379015cc30 0x7f379015ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f37969f8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790149850 con 0x7f37900d1fa0 2023-11-20T07:01:43.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f37969f8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37900b8300 con 0x7f379015cc30 2023-11-20T07:01:43.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f37969f8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379015d780 con 0x7f37900cd840 2023-11-20T07:01:43.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37900d1fa0 0x7f379015d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37900d1fa0 0x7f379015d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38716/0 (socket says 172.21.15.88:38716) 2023-11-20T07:01:43.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378f7fe640 1 -- 172.21.15.88:0/625408260 learned_addr learned my addr 172.21.15.88:0/625408260 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:43.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378ffff640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37900cd840 0x7f3790149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f3794f95640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f379015cc30 0x7f379015ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378f7fe640 1 -- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37900cd840 msgr2=0x7f3790149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378f7fe640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37900cd840 0x7f3790149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378f7fe640 1 -- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f379015cc30 msgr2=0x7f379015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378f7fe640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f379015cc30 0x7f379015ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378f7fe640 1 -- 172.21.15.88:0/625408260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788009a70 con 0x7f37900d1fa0 2023-11-20T07:01:43.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378f7fe640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37900d1fa0 0x7f379015d240 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f378400c520 tx=0x7f378400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:43.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378cff9640 1 -- 172.21.15.88:0/625408260 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37840074e0 con 0x7f37900d1fa0 2023-11-20T07:01:43.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378cff9640 1 -- 172.21.15.88:0/625408260 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3784007640 con 0x7f37900d1fa0 2023-11-20T07:01:43.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f378cff9640 1 -- 172.21.15.88:0/625408260 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37840049f0 con 0x7f37900d1fa0 2023-11-20T07:01:43.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f37969f8640 1 -- 172.21.15.88:0/625408260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379015d9b0 con 0x7f37900d1fa0 2023-11-20T07:01:43.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.093+0000 7f37969f8640 1 -- 172.21.15.88:0/625408260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379015df70 con 0x7f37900d1fa0 2023-11-20T07:01:43.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.097+0000 7f37969f8640 1 -- 172.21.15.88:0/625408260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3790067230 con 0x7f37900d1fa0 2023-11-20T07:01:43.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.097+0000 7f378cff9640 1 -- 172.21.15.88:0/625408260 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3784004b50 con 0x7f37900d1fa0 2023-11-20T07:01:43.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.097+0000 7f378cff9640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f377c0664a0 0x7f377c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.097+0000 7f378cff9640 1 -- 172.21.15.88:0/625408260 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3784083340 con 0x7f37900d1fa0 2023-11-20T07:01:43.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.097+0000 7f378ffff640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f377c0664a0 0x7f377c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.097+0000 7f378ffff640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f377c0664a0 0x7f377c068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3790153610 tx=0x7f3780009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:43.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.101+0000 7f378cff9640 1 -- 172.21.15.88:0/625408260 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3784050540 con 0x7f37900d1fa0 2023-11-20T07:01:43.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.249+0000 7f37969f8640 1 -- 172.21.15.88:0/625408260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37901536e0 con 0x7f37900d1fa0 2023-11-20T07:01:43.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.249+0000 7f378cff9640 1 -- 172.21.15.88:0/625408260 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3784053b60 con 0x7f37900d1fa0 2023-11-20T07:01:43.252 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:43.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.253+0000 7f37969f8640 1 -- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f377c0664a0 msgr2=0x7f377c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.253+0000 7f37969f8640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f377c0664a0 0x7f377c068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3790153610 tx=0x7f3780009190 comp rx=0 tx=0).stop 2023-11-20T07:01:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.253+0000 7f37969f8640 1 -- 172.21.15.88:0/625408260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37900d1fa0 msgr2=0x7f379015d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.253+0000 7f37969f8640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37900d1fa0 0x7f379015d240 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f378400c520 tx=0x7f378400c9e0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.253+0000 7f37969f8640 1 -- 172.21.15.88:0/625408260 shutdown_connections 2023-11-20T07:01:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.253+0000 7f37969f8640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f377c0664a0 0x7f377c068960 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.253+0000 7f37969f8640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f379015cc30 0x7f379015ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.253+0000 7f37969f8640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37900d1fa0 0x7f379015d240 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.253+0000 7f37969f8640 1 --2- 172.21.15.88:0/625408260 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37900cd840 0x7f3790149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.253+0000 7f37969f8640 1 -- 172.21.15.88:0/625408260 >> 172.21.15.88:0/625408260 conn(0x7f379006b750 msgr2=0x7f379015b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.253+0000 7f37969f8640 1 -- 172.21.15.88:0/625408260 shutdown_connections 2023-11-20T07:01:43.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.253+0000 7f37969f8640 1 -- 172.21.15.88:0/625408260 wait complete. 2023-11-20T07:01:43.272 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:43.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.413+0000 7f6a1f73e640 1 Processor -- start 2023-11-20T07:01:43.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.413+0000 7f6a1f73e640 1 -- start start 2023-11-20T07:01:43.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.413+0000 7f6a1f73e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a1806a5a0 0x7f6a1806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.413+0000 7f6a1f73e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6a180b3f00 0x7f6a180c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.413+0000 7f6a1f73e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a180b4370 con 0x7f6a18159900 2023-11-20T07:01:43.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.413+0000 7f6a1f73e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a180cd740 con 0x7f6a1806a5a0 2023-11-20T07:01:43.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.413+0000 7f6a1f73e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a180b4600 con 0x7f6a180b3f00 2023-11-20T07:01:43.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.413+0000 7f6a1ccd9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a1806a5a0 0x7f6a1806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.413+0000 7f6a1ccd9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a1806a5a0 0x7f6a1806e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38718/0 (socket says 172.21.15.88:38718) 2023-11-20T07:01:43.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.413+0000 7f6a1ccd9640 1 -- 172.21.15.88:0/1707394028 learned_addr learned my addr 172.21.15.88:0/1707394028 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:43.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.413+0000 7f6a1dcdb640 1 --2- 172.21.15.88:0/1707394028 >> v2:172.21.15.175:3300/0 conn(0x7f6a180b3f00 0x7f6a180c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.417+0000 7f6a1ccd9640 1 -- 172.21.15.88:0/1707394028 >> v2:172.21.15.175:3300/0 conn(0x7f6a180b3f00 msgr2=0x7f6a180c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:43.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.417+0000 7f6a1ccd9640 1 --2- 172.21.15.88:0/1707394028 >> v2:172.21.15.175:3300/0 conn(0x7f6a180b3f00 0x7f6a180c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.417+0000 7f6a1ccd9640 1 -- 172.21.15.88:0/1707394028 >> v1:172.21.15.175:6789/0 conn(0x7f6a18159900 legacy=0x7f6a18069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.417+0000 7f6a1ccd9640 1 -- 172.21.15.88:0/1707394028 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a180c8dd0 con 0x7f6a1806a5a0 2023-11-20T07:01:43.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.417+0000 7f6a1ccd9640 1 --2- 172.21.15.88:0/1707394028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a1806a5a0 0x7f6a1806e260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6a1806afc0 tx=0x7f6a0801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c0025520b378b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:43.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.417+0000 7f6a0ffff640 1 -- 172.21.15.88:0/1707394028 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080aa430 con 0x7f6a1806a5a0 2023-11-20T07:01:43.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.417+0000 7f6a0ffff640 1 -- 172.21.15.88:0/1707394028 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a080aa590 con 0x7f6a1806a5a0 2023-11-20T07:01:43.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.417+0000 7f6a0ffff640 1 -- 172.21.15.88:0/1707394028 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080aa920 con 0x7f6a1806a5a0 2023-11-20T07:01:43.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.417+0000 7f6a1f73e640 1 -- 172.21.15.88:0/1707394028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a1806a5a0 msgr2=0x7f6a1806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.417+0000 7f6a1f73e640 1 --2- 172.21.15.88:0/1707394028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a1806a5a0 0x7f6a1806e260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6a1806afc0 tx=0x7f6a0801c4d0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 -- 172.21.15.88:0/1707394028 shutdown_connections 2023-11-20T07:01:43.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 --2- 172.21.15.88:0/1707394028 >> v2:172.21.15.175:3300/0 conn(0x7f6a180b3f00 0x7f6a180c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 --2- 172.21.15.88:0/1707394028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a1806a5a0 0x7f6a1806e260 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 -- 172.21.15.88:0/1707394028 >> 172.21.15.88:0/1707394028 conn(0x7f6a180b0da0 msgr2=0x7f6a180ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:43.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 -- 172.21.15.88:0/1707394028 shutdown_connections 2023-11-20T07:01:43.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 -- 172.21.15.88:0/1707394028 wait complete. 2023-11-20T07:01:43.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 Processor -- start 2023-11-20T07:01:43.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 -- start start 2023-11-20T07:01:43.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a1806a5a0 0x7f6a18152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a180b3f00 0x7f6a18155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18159900 0x7f6a181576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18152b70 con 0x7f6a18159900 2023-11-20T07:01:43.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18155c20 con 0x7f6a180b3f00 2023-11-20T07:01:43.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1f73e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18155f00 con 0x7f6a1806a5a0 2023-11-20T07:01:43.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1dcdb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18159900 0x7f6a181576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1dcdb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18159900 0x7f6a181576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38720/0 (socket says 172.21.15.88:38720) 2023-11-20T07:01:43.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1dcdb640 1 -- 172.21.15.88:0/2950641719 learned_addr learned my addr 172.21.15.88:0/2950641719 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:43.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1ccd9640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a180b3f00 0x7f6a18155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1d4da640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a1806a5a0 0x7f6a18152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1dcdb640 1 -- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a1806a5a0 msgr2=0x7f6a18152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1dcdb640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a1806a5a0 0x7f6a18152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1dcdb640 1 -- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a180b3f00 msgr2=0x7f6a18155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1dcdb640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a180b3f00 0x7f6a18155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1dcdb640 1 -- 172.21.15.88:0/2950641719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080094d0 con 0x7f6a18159900 2023-11-20T07:01:43.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1d4da640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a1806a5a0 0x7f6a18152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:43.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a1dcdb640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18159900 0x7f6a181576a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000efc0 tx=0x7f6a1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:43.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.421+0000 7f6a0dffb640 1 -- 172.21.15.88:0/2950641719 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10014480 con 0x7f6a18159900 2023-11-20T07:01:43.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.425+0000 7f6a0dffb640 1 -- 172.21.15.88:0/2950641719 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1000f040 con 0x7f6a18159900 2023-11-20T07:01:43.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.425+0000 7f6a0dffb640 1 -- 172.21.15.88:0/2950641719 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10014820 con 0x7f6a18159900 2023-11-20T07:01:43.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.425+0000 7f6a1f73e640 1 -- 172.21.15.88:0/2950641719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a181561e0 con 0x7f6a18159900 2023-11-20T07:01:43.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.425+0000 7f6a1f73e640 1 -- 172.21.15.88:0/2950641719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a180c7740 con 0x7f6a18159900 2023-11-20T07:01:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.425+0000 7f6a1f73e640 1 -- 172.21.15.88:0/2950641719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a180c72c0 con 0x7f6a18159900 2023-11-20T07:01:43.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.425+0000 7f6a0dffb640 1 -- 172.21.15.88:0/2950641719 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6a10014980 con 0x7f6a18159900 2023-11-20T07:01:43.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.425+0000 7f6a0dffb640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f69fc0664a0 0x7f69fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.425+0000 7f6a0dffb640 1 -- 172.21.15.88:0/2950641719 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6a10084d30 con 0x7f6a18159900 2023-11-20T07:01:43.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.425+0000 7f6a1d4da640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f69fc0664a0 0x7f69fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.429+0000 7f6a1d4da640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f69fc0664a0 0x7f69fc068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a14000f70 tx=0x7f6a14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:43.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.429+0000 7f6a0dffb640 1 -- 172.21.15.88:0/2950641719 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6a180c72c0 con 0x7f6a18159900 2023-11-20T07:01:43.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 -- 172.21.15.88:0/2950641719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a180c72c0 con 0x7f6a18159900 2023-11-20T07:01:43.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a0dffb640 1 -- 172.21.15.88:0/2950641719 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a180c72c0 con 0x7f6a18159900 2023-11-20T07:01:43.582 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:43.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 -- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f69fc0664a0 msgr2=0x7f69fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f69fc0664a0 0x7f69fc068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a14000f70 tx=0x7f6a14009040 comp rx=0 tx=0).stop 2023-11-20T07:01:43.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 -- 172.21.15.88:0/2950641719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18159900 msgr2=0x7f6a181576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18159900 0x7f6a181576a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000efc0 tx=0x7f6a1000c490 comp rx=0 tx=0).stop 2023-11-20T07:01:43.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 -- 172.21.15.88:0/2950641719 shutdown_connections 2023-11-20T07:01:43.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f69fc0664a0 0x7f69fc068960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a18159900 0x7f6a181576a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a180b3f00 0x7f6a18155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 --2- 172.21.15.88:0/2950641719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a1806a5a0 0x7f6a18152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 -- 172.21.15.88:0/2950641719 >> 172.21.15.88:0/2950641719 conn(0x7f6a180b0da0 msgr2=0x7f6a180ca8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:43.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 -- 172.21.15.88:0/2950641719 shutdown_connections 2023-11-20T07:01:43.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.581+0000 7f6a1f73e640 1 -- 172.21.15.88:0/2950641719 wait complete. 2023-11-20T07:01:43.602 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:43.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.741+0000 7fc0ce9c5640 1 Processor -- start 2023-11-20T07:01:43.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.741+0000 7fc0ce9c5640 1 -- start start 2023-11-20T07:01:43.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0ce9c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c80c36c0 0x7fc0c8165570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0ce9c5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c815ae30 con 0x7fc0c8069e90 2023-11-20T07:01:43.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0ce9c5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c80ca510 con 0x7fc0c806d010 2023-11-20T07:01:43.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0ce9c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c80cb090 con 0x7fc0c80c36c0 2023-11-20T07:01:43.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc0c8069e90 0x7fc0c806a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34710/0 (socket says 172.21.15.88:34710) 2023-11-20T07:01:43.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c7fff640 1 -- 172.21.15.88:0/4241486089 learned_addr learned my addr 172.21.15.88:0/4241486089 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:43.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0ccf62640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c80c36c0 0x7fc0c8165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466638340 0 0) 0x7fc0c815ae30 con 0x7fc0c8069e90 2023-11-20T07:01:43.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0b0003530 con 0x7fc0c8069e90 2023-11-20T07:01:43.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 513206107 0 0) 0x7fc0b0003530 con 0x7fc0c8069e90 2023-11-20T07:01:43.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c80c36c0 msgr2=0x7fc0c8165570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:43.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c80c36c0 0x7fc0c8165570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 >> v1:172.21.15.175:6789/0 conn(0x7fc0c806d010 legacy=0x7fc0c80c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c80ca7f0 con 0x7fc0c8069e90 2023-11-20T07:01:43.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fc0b8001680 con 0x7fc0c8069e90 2023-11-20T07:01:43.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 >> v1:172.21.15.88:6789/0 conn(0x7fc0c8069e90 legacy=0x7fc0c806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c80c36c0 0x7fc0b00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b0003f30 0x7fc0b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b0004d10 0x7fc0b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c80cb090 con 0x7fc0b0004d10 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b000bb00 con 0x7fc0b0003f30 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b000bcc0 con 0x7fc0c80c36c0 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c7fff640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c80c36c0 0x7fc0b00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c77fe640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b0003f30 0x7fc0b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0ccf62640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b0004d10 0x7fc0b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c77fe640 1 -- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c80c36c0 msgr2=0x7fc0b00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c77fe640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c80c36c0 0x7fc0b00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c77fe640 1 -- 172.21.15.88:0/4241486089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b0004d10 msgr2=0x7fc0b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:43.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c77fe640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b0004d10 0x7fc0b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c77fe640 1 -- 172.21.15.88:0/4241486089 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b0003530 con 0x7fc0b0003f30 2023-11-20T07:01:43.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0c7fff640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c80c36c0 0x7fc0b00039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:43.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.745+0000 7fc0ccf62640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b0004d10 0x7fc0b0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:43.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.749+0000 7fc0c77fe640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b0003f30 0x7fc0b00047d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc001780 tx=0x7fc0bc01c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfbb02b6de75e3e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:43.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.749+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0052d0 con 0x7fc0b0003f30 2023-11-20T07:01:43.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.749+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0bc0a7050 con 0x7fc0b0003f30 2023-11-20T07:01:43.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.749+0000 7fc0c6ffd640 1 -- 172.21.15.88:0/4241486089 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc003600 con 0x7fc0b0003f30 2023-11-20T07:01:43.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.749+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b0003f30 msgr2=0x7fc0b00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.749+0000 7fc0ce9c5640 1 --2- 172.21.15.88:0/4241486089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b0003f30 0x7fc0b00047d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc001780 tx=0x7fc0bc01c400 comp rx=0 tx=0).stop 2023-11-20T07:01:43.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.749+0000 7fc0ccf62640 1 -- 172.21.15.88:0/4241486089 reap_dead start 2023-11-20T07:01:43.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.749+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/4241486089 shutdown_connections 2023-11-20T07:01:43.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.749+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/4241486089 >> 172.21.15.88:0/4241486089 conn(0x7fc0c80b0da0 msgr2=0x7fc0c80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:43.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.749+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/4241486089 shutdown_connections 2023-11-20T07:01:43.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.749+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/4241486089 wait complete. 2023-11-20T07:01:43.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.749+0000 7fc0ce9c5640 1 Processor -- start 2023-11-20T07:01:43.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0ce9c5640 1 -- start start 2023-11-20T07:01:43.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0ce9c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b0003f30 0x7fc0c814ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0ce9c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c814c980 0x7fc0c815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0ce9c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0c814c130 0x7fc0c8162660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0ce9c5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c815b380 con 0x7fc0b0003f30 2023-11-20T07:01:43.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0ce9c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c815cdb0 con 0x7fc0c814c130 2023-11-20T07:01:43.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0ce9c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c815d090 con 0x7fc0c814c980 2023-11-20T07:01:43.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b0003f30 0x7fc0c814ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b0003f30 0x7fc0c814ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38748/0 (socket says 172.21.15.88:38748) 2023-11-20T07:01:43.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c7fff640 1 -- 172.21.15.88:0/1925301157 learned_addr learned my addr 172.21.15.88:0/1925301157 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:43.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c77fe640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c814c980 0x7fc0c815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c7fff640 1 -- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c814c980 msgr2=0x7fc0c815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c7fff640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c814c980 0x7fc0c815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c7fff640 1 -- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0c814c130 msgr2=0x7fc0c8162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c7fff640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0c814c130 0x7fc0c8162660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c7fff640 1 -- 172.21.15.88:0/1925301157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c815d370 con 0x7fc0b0003f30 2023-11-20T07:01:43.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c77fe640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c814c980 0x7fc0c815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:43.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c7fff640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b0003f30 0x7fc0c814ceb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80017b0 tx=0x7fc0b8007790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:43.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c4ff9640 1 -- 172.21.15.88:0/1925301157 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b800fa60 con 0x7fc0b0003f30 2023-11-20T07:01:43.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c4ff9640 1 -- 172.21.15.88:0/1925301157 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b800fbe0 con 0x7fc0b0003f30 2023-11-20T07:01:43.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/1925301157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c815ddd0 con 0x7fc0b0003f30 2023-11-20T07:01:43.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0c4ff9640 1 -- 172.21.15.88:0/1925301157 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80133f0 con 0x7fc0b0003f30 2023-11-20T07:01:43.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/1925301157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c815b660 con 0x7fc0b0003f30 2023-11-20T07:01:43.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.753+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/1925301157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c815cc10 con 0x7fc0b0003f30 2023-11-20T07:01:43.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.757+0000 7fc0c4ff9640 1 -- 172.21.15.88:0/1925301157 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc0b8013550 con 0x7fc0b0003f30 2023-11-20T07:01:43.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.757+0000 7fc0c4ff9640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0b40664a0 0x7fc0b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:43.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.757+0000 7fc0c4ff9640 1 -- 172.21.15.88:0/1925301157 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc0b8084610 con 0x7fc0b0003f30 2023-11-20T07:01:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.757+0000 7fc0c77fe640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0b40664a0 0x7fc0b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.757+0000 7fc0c77fe640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0b40664a0 0x7fc0b4068960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc004000 tx=0x7fc0bc0011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:43.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.761+0000 7fc0c4ff9640 1 -- 172.21.15.88:0/1925301157 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc0c815cc10 con 0x7fc0b0003f30 2023-11-20T07:01:43.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/1925301157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc0c815cc10 con 0x7fc0b0003f30 2023-11-20T07:01:43.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0c4ff9640 1 -- 172.21.15.88:0/1925301157 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc0c815cc10 con 0x7fc0b0003f30 2023-11-20T07:01:43.910 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:43.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0b40664a0 msgr2=0x7fc0b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0b40664a0 0x7fc0b4068960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc004000 tx=0x7fc0bc0011a0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/1925301157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b0003f30 msgr2=0x7fc0c814ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:43.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b0003f30 0x7fc0c814ceb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80017b0 tx=0x7fc0b8007790 comp rx=0 tx=0).stop 2023-11-20T07:01:43.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/1925301157 shutdown_connections 2023-11-20T07:01:43.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc0b40664a0 0x7fc0b4068960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0c814c980 0x7fc0c815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0c814c130 0x7fc0c8162660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 --2- 172.21.15.88:0/1925301157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b0003f30 0x7fc0c814ceb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:43.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/1925301157 >> 172.21.15.88:0/1925301157 conn(0x7fc0c80b0da0 msgr2=0x7fc0c80c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:43.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/1925301157 shutdown_connections 2023-11-20T07:01:43.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:43.909+0000 7fc0ce9c5640 1 -- 172.21.15.88:0/1925301157 wait complete. 2023-11-20T07:01:43.943 INFO:tasks.cephfs_test_runner:Starting test: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-11-20T07:01:43.943 INFO:tasks.cephfs_test_runner:test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-20T07:01:43.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:44.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f498759e640 1 Processor -- start 2023-11-20T07:01:44.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f498759e640 1 -- start start 2023-11-20T07:01:44.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f498759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49880d1490 0x7f498806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f498759e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49880d3510 con 0x7f498815cd60 2023-11-20T07:01:44.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f498759e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49880d2f50 con 0x7f498815c980 2023-11-20T07:01:44.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f498759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49880cd2b0 con 0x7f49880d1490 2023-11-20T07:01:44.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f4986d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f498815cd60 0x7f49880cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34726/0 (socket says 172.21.15.88:34726) 2023-11-20T07:01:44.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f4986d9d640 1 -- 172.21.15.88:0/3304232071 learned_addr learned my addr 172.21.15.88:0/3304232071 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:44.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f4985d9b640 1 --2- 172.21.15.88:0/3304232071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49880d1490 0x7f498806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f498559a640 1 -- 172.21.15.88:0/3304232071 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614501767 0 0) 0x7f49800014a0 con 0x7f498815cd60 2023-11-20T07:01:44.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f498559a640 1 -- 172.21.15.88:0/3304232071 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4970003530 con 0x7f498815cd60 2023-11-20T07:01:44.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f498559a640 1 -- 172.21.15.88:0/3304232071 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866598472 0 0) 0x7f49880d2f50 con 0x7f498815c980 2023-11-20T07:01:44.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f498559a640 1 -- 172.21.15.88:0/3304232071 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49800014a0 con 0x7f498815c980 2023-11-20T07:01:44.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f498559a640 1 -- 172.21.15.88:0/3304232071 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3784282025 0 0) 0x7f4970003530 con 0x7f498815cd60 2023-11-20T07:01:44.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f4985d9b640 1 -- 172.21.15.88:0/3304232071 >> v1:172.21.15.175:6789/0 conn(0x7f498815c980 legacy=0x7f49880d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f4985d9b640 1 -- 172.21.15.88:0/3304232071 >> v1:172.21.15.88:6789/0 conn(0x7f498815cd60 legacy=0x7f49880cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.081+0000 7f4985d9b640 1 -- 172.21.15.88:0/3304232071 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49880d3230 con 0x7f49880d1490 2023-11-20T07:01:44.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.085+0000 7f4985d9b640 1 --2- 172.21.15.88:0/3304232071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49880d1490 0x7f498806af90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f497c0097f0 tx=0x7f497c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=493a2df8f05906b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:44.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.085+0000 7f498559a640 1 -- 172.21.15.88:0/3304232071 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980001b90 con 0x7f49880d1490 2023-11-20T07:01:44.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.085+0000 7f498559a640 1 -- 172.21.15.88:0/3304232071 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c0ad480 con 0x7f49880d1490 2023-11-20T07:01:44.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.085+0000 7f498559a640 1 -- 172.21.15.88:0/3304232071 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c0ad810 con 0x7f49880d1490 2023-11-20T07:01:44.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.085+0000 7f498759e640 1 -- 172.21.15.88:0/3304232071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49880d1490 msgr2=0x7f498806af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.085+0000 7f498759e640 1 --2- 172.21.15.88:0/3304232071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49880d1490 0x7f498806af90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f497c0097f0 tx=0x7f497c01c3e0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.085+0000 7f498759e640 1 -- 172.21.15.88:0/3304232071 shutdown_connections 2023-11-20T07:01:44.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.085+0000 7f498759e640 1 --2- 172.21.15.88:0/3304232071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49880d1490 0x7f498806af90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.085+0000 7f498759e640 1 -- 172.21.15.88:0/3304232071 >> 172.21.15.88:0/3304232071 conn(0x7f498809ba80 msgr2=0x7f49880d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:44.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.085+0000 7f498759e640 1 -- 172.21.15.88:0/3304232071 shutdown_connections 2023-11-20T07:01:44.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.085+0000 7f498759e640 1 -- 172.21.15.88:0/3304232071 wait complete. 2023-11-20T07:01:44.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498759e640 1 Processor -- start 2023-11-20T07:01:44.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498759e640 1 -- start start 2023-11-20T07:01:44.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49880d1490 0x7f4988157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f498815c980 0x7f49880c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f498815cd60 0x7f49880c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498759e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49880c86b0 con 0x7f49880d1490 2023-11-20T07:01:44.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4988158ff0 con 0x7f498815c980 2023-11-20T07:01:44.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49880c7340 con 0x7f498815cd60 2023-11-20T07:01:44.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49880d1490 0x7f4988157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49880d1490 0x7f4988157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38764/0 (socket says 172.21.15.88:38764) 2023-11-20T07:01:44.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498659c640 1 -- 172.21.15.88:0/2799155531 learned_addr learned my addr 172.21.15.88:0/2799155531 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:44.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f4986d9d640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f498815cd60 0x7f49880c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f4985d9b640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f498815c980 0x7f49880c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498659c640 1 -- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f498815cd60 msgr2=0x7f49880c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498659c640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f498815cd60 0x7f49880c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498659c640 1 -- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f498815c980 msgr2=0x7f49880c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498659c640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f498815c980 0x7f49880c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498659c640 1 -- 172.21.15.88:0/2799155531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c009420 con 0x7f49880d1490 2023-11-20T07:01:44.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498659c640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49880d1490 0x7f4988157090 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f497800c4d0 tx=0x7f497800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:44.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f4976ffd640 1 -- 172.21.15.88:0/2799155531 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49780052d0 con 0x7f49880d1490 2023-11-20T07:01:44.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f4976ffd640 1 -- 172.21.15.88:0/2799155531 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4978005430 con 0x7f49880d1490 2023-11-20T07:01:44.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f4976ffd640 1 -- 172.21.15.88:0/2799155531 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978003850 con 0x7f49880d1490 2023-11-20T07:01:44.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498759e640 1 -- 172.21.15.88:0/2799155531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49881589a0 con 0x7f49880d1490 2023-11-20T07:01:44.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498759e640 1 -- 172.21.15.88:0/2799155531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49880b57e0 con 0x7f49880d1490 2023-11-20T07:01:44.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.089+0000 7f498759e640 1 -- 172.21.15.88:0/2799155531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4988158800 con 0x7f49880d1490 2023-11-20T07:01:44.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.093+0000 7f4976ffd640 1 -- 172.21.15.88:0/2799155531 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f49780039b0 con 0x7f49880d1490 2023-11-20T07:01:44.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.093+0000 7f4976ffd640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f49680664a0 0x7f4968068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.093+0000 7f4976ffd640 1 -- 172.21.15.88:0/2799155531 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4978083e10 con 0x7f49880d1490 2023-11-20T07:01:44.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.093+0000 7f4985d9b640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f49680664a0 0x7f4968068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.093+0000 7f4985d9b640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f49680664a0 0x7f4968068960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f497c0af000 tx=0x7f497c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:44.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.097+0000 7f4976ffd640 1 -- 172.21.15.88:0/2799155531 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4988158800 con 0x7f49880d1490 2023-11-20T07:01:44.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.249+0000 7f498759e640 1 -- 172.21.15.88:0/2799155531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4988158800 con 0x7f49880d1490 2023-11-20T07:01:44.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.249+0000 7f4976ffd640 1 -- 172.21.15.88:0/2799155531 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f4988158800 con 0x7f49880d1490 2023-11-20T07:01:44.252 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:44.252 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:44.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.253+0000 7f498759e640 1 -- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f49680664a0 msgr2=0x7f4968068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.253+0000 7f498759e640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f49680664a0 0x7f4968068960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f497c0af000 tx=0x7f497c0a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:44.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.253+0000 7f498759e640 1 -- 172.21.15.88:0/2799155531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49880d1490 msgr2=0x7f4988157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.253+0000 7f498759e640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49880d1490 0x7f4988157090 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f497800c4d0 tx=0x7f497800c990 comp rx=0 tx=0).stop 2023-11-20T07:01:44.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.253+0000 7f498759e640 1 -- 172.21.15.88:0/2799155531 shutdown_connections 2023-11-20T07:01:44.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.253+0000 7f498759e640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f49680664a0 0x7f4968068960 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.253+0000 7f498759e640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f498815cd60 0x7f49880c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.253+0000 7f498759e640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f498815c980 0x7f49880c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.253+0000 7f498759e640 1 --2- 172.21.15.88:0/2799155531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49880d1490 0x7f4988157090 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.253+0000 7f498759e640 1 -- 172.21.15.88:0/2799155531 >> 172.21.15.88:0/2799155531 conn(0x7f498809ba80 msgr2=0x7f49880d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:44.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.253+0000 7f498759e640 1 -- 172.21.15.88:0/2799155531 shutdown_connections 2023-11-20T07:01:44.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.253+0000 7f498759e640 1 -- 172.21.15.88:0/2799155531 wait complete. 2023-11-20T07:01:44.273 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:44.273 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.413+0000 7f2369f94640 1 Processor -- start 2023-11-20T07:01:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.413+0000 7f2369f94640 1 -- start start 2023-11-20T07:01:44.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.413+0000 7f2369f94640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2364159900 0x7f236406e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.413+0000 7f2369f94640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f236406a5a0 0x7f23640c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.413+0000 7f2369f94640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23640b4390 con 0x7f23640b3f00 2023-11-20T07:01:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.413+0000 7f2369f94640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23640cd740 con 0x7f2364159900 2023-11-20T07:01:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.413+0000 7f2369f94640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23640b4600 con 0x7f236406a5a0 2023-11-20T07:01:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f23637fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2364159900 0x7f236406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f23637fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2364159900 0x7f236406e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38772/0 (socket says 172.21.15.88:38772) 2023-11-20T07:01:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f23637fe640 1 -- 172.21.15.88:0/669051955 learned_addr learned my addr 172.21.15.88:0/669051955 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f2362ffd640 1 --1- 172.21.15.88:0/669051955 >> v1:172.21.15.88:6789/0 conn(0x7f23640b3f00 0x7f2364069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34734/0 (socket says 172.21.15.88:34734) 2023-11-20T07:01:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f2363fff640 1 --2- 172.21.15.88:0/669051955 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f236406a5a0 0x7f23640c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f23637fe640 1 -- 172.21.15.88:0/669051955 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f236406a5a0 msgr2=0x7f23640c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:44.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f23637fe640 1 --2- 172.21.15.88:0/669051955 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f236406a5a0 0x7f23640c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f23637fe640 1 -- 172.21.15.88:0/669051955 >> v1:172.21.15.88:6789/0 conn(0x7f23640b3f00 legacy=0x7f2364069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f23637fe640 1 -- 172.21.15.88:0/669051955 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640c8dd0 con 0x7f2364159900 2023-11-20T07:01:44.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f23627fc640 1 -- 172.21.15.88:0/669051955 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146885301 0 0) 0x7f23640b4390 con 0x7f23640b3f00 2023-11-20T07:01:44.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f2363fff640 1 --2- 172.21.15.88:0/669051955 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f236406a5a0 0x7f23640c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:44.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f23637fe640 1 --2- 172.21.15.88:0/669051955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2364159900 0x7f236406e260 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2354009870 tx=0x7f235401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347c350bbb0d329b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f23627fc640 1 -- 172.21.15.88:0/669051955 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540aa670 con 0x7f2364159900 2023-11-20T07:01:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f23627fc640 1 -- 172.21.15.88:0/669051955 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23540aa7d0 con 0x7f2364159900 2023-11-20T07:01:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.417+0000 7f23627fc640 1 -- 172.21.15.88:0/669051955 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540aab60 con 0x7f2364159900 2023-11-20T07:01:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 -- 172.21.15.88:0/669051955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2364159900 msgr2=0x7f236406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 --2- 172.21.15.88:0/669051955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2364159900 0x7f236406e260 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2354009870 tx=0x7f235401c510 comp rx=0 tx=0).stop 2023-11-20T07:01:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 -- 172.21.15.88:0/669051955 shutdown_connections 2023-11-20T07:01:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 --2- 172.21.15.88:0/669051955 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f236406a5a0 0x7f23640c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 --2- 172.21.15.88:0/669051955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2364159900 0x7f236406e260 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 -- 172.21.15.88:0/669051955 >> 172.21.15.88:0/669051955 conn(0x7f23640b0da0 msgr2=0x7f23640ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 -- 172.21.15.88:0/669051955 shutdown_connections 2023-11-20T07:01:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 -- 172.21.15.88:0/669051955 wait complete. 2023-11-20T07:01:44.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 Processor -- start 2023-11-20T07:01:44.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 -- start start 2023-11-20T07:01:44.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f236406a5a0 0x7f2364155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23640b3f00 0x7f23640ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2364159900 0x7f2364156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2364155cc0 con 0x7f236406a5a0 2023-11-20T07:01:44.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23640ad360 con 0x7f2364159900 2023-11-20T07:01:44.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2369f94640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236415c5c0 con 0x7f23640b3f00 2023-11-20T07:01:44.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f23637fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f236406a5a0 0x7f2364155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f23637fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f236406a5a0 0x7f2364155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38778/0 (socket says 172.21.15.88:38778) 2023-11-20T07:01:44.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f23637fe640 1 -- 172.21.15.88:0/1527576700 learned_addr learned my addr 172.21.15.88:0/1527576700 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:44.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2362ffd640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23640b3f00 0x7f23640ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2363fff640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2364159900 0x7f2364156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f23637fe640 1 -- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23640b3f00 msgr2=0x7f23640ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f23637fe640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23640b3f00 0x7f23640ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f23637fe640 1 -- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2364159900 msgr2=0x7f2364156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f23637fe640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2364159900 0x7f2364156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f23637fe640 1 -- 172.21.15.88:0/1527576700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23540094d0 con 0x7f236406a5a0 2023-11-20T07:01:44.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2363fff640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2364159900 0x7f2364156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:44.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.421+0000 7f2362ffd640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23640b3f00 0x7f23640ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:44.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.425+0000 7f23637fe640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f236406a5a0 0x7f2364155780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f23540ac040 tx=0x7f235401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:44.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.425+0000 7f234bfff640 1 -- 172.21.15.88:0/1527576700 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540b3800 con 0x7f236406a5a0 2023-11-20T07:01:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.425+0000 7f234bfff640 1 -- 172.21.15.88:0/1527576700 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23540b3980 con 0x7f236406a5a0 2023-11-20T07:01:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.425+0000 7f234bfff640 1 -- 172.21.15.88:0/1527576700 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23540b3d30 con 0x7f236406a5a0 2023-11-20T07:01:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.425+0000 7f2369f94640 1 -- 172.21.15.88:0/1527576700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236415c8a0 con 0x7f236406a5a0 2023-11-20T07:01:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.425+0000 7f2369f94640 1 -- 172.21.15.88:0/1527576700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236415c2c0 con 0x7f236406a5a0 2023-11-20T07:01:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.425+0000 7f2369f94640 1 -- 172.21.15.88:0/1527576700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23640ad4a0 con 0x7f236406a5a0 2023-11-20T07:01:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.425+0000 7f234bfff640 1 -- 172.21.15.88:0/1527576700 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f23540b2380 con 0x7f236406a5a0 2023-11-20T07:01:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.425+0000 7f234bfff640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f23500664a0 0x7f2350068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.425+0000 7f234bfff640 1 -- 172.21.15.88:0/1527576700 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f235411eaa0 con 0x7f236406a5a0 2023-11-20T07:01:44.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.425+0000 7f2362ffd640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f23500664a0 0x7f2350068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.429+0000 7f2362ffd640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f23500664a0 0x7f2350068960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2358007fd0 tx=0x7f2358007c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:44.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.429+0000 7f234bfff640 1 -- 172.21.15.88:0/1527576700 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f23540ebc10 con 0x7f236406a5a0 2023-11-20T07:01:44.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.581+0000 7f2369f94640 1 -- 172.21.15.88:0/1527576700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f236404e170 con 0x7f236406a5a0 2023-11-20T07:01:44.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.581+0000 7f234bfff640 1 -- 172.21.15.88:0/1527576700 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23540c3020 con 0x7f236406a5a0 2023-11-20T07:01:44.584 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:44.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.585+0000 7f2369f94640 1 -- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f23500664a0 msgr2=0x7f2350068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.585+0000 7f2369f94640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f23500664a0 0x7f2350068960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2358007fd0 tx=0x7f2358007c20 comp rx=0 tx=0).stop 2023-11-20T07:01:44.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.585+0000 7f2369f94640 1 -- 172.21.15.88:0/1527576700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f236406a5a0 msgr2=0x7f2364155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.585+0000 7f2369f94640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f236406a5a0 0x7f2364155780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f23540ac040 tx=0x7f235401ad50 comp rx=0 tx=0).stop 2023-11-20T07:01:44.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.585+0000 7f2369f94640 1 -- 172.21.15.88:0/1527576700 shutdown_connections 2023-11-20T07:01:44.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.585+0000 7f2369f94640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f23500664a0 0x7f2350068960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.585+0000 7f2369f94640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23640b3f00 0x7f23640ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.585+0000 7f2369f94640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2364159900 0x7f2364156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.585+0000 7f2369f94640 1 --2- 172.21.15.88:0/1527576700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f236406a5a0 0x7f2364155780 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.585+0000 7f2369f94640 1 -- 172.21.15.88:0/1527576700 >> 172.21.15.88:0/1527576700 conn(0x7f23640b0da0 msgr2=0x7f2364158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:44.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.585+0000 7f2369f94640 1 -- 172.21.15.88:0/1527576700 shutdown_connections 2023-11-20T07:01:44.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.585+0000 7f2369f94640 1 -- 172.21.15.88:0/1527576700 wait complete. 2023-11-20T07:01:44.605 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:44.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6fe59d640 1 Processor -- start 2023-11-20T07:01:44.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6fe59d640 1 -- start start 2023-11-20T07:01:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6fe59d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6f806a5a0 0x7fc6f806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6fe59d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6f80b3f00 0x7fc6f80c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6fe59d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f80b4340 con 0x7fc6f8159900 2023-11-20T07:01:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6fe59d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f80cd740 con 0x7fc6f80b3f00 2023-11-20T07:01:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6fe59d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80b4600 con 0x7fc6f806a5a0 2023-11-20T07:01:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6f7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc6f8159900 0x7fc6f8069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34746/0 (socket says 172.21.15.88:34746) 2023-11-20T07:01:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6fcb3a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc6f80b3f00 0x7fc6f80c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6f7fff640 1 -- 172.21.15.88:0/2174265757 learned_addr learned my addr 172.21.15.88:0/2174265757 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6f77fe640 1 --2- 172.21.15.88:0/2174265757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6f806a5a0 0x7fc6f806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6fcb3a640 1 -- 172.21.15.88:0/2174265757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6f806a5a0 msgr2=0x7fc6f806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6fcb3a640 1 --2- 172.21.15.88:0/2174265757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6f806a5a0 0x7fc6f806e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6fcb3a640 1 -- 172.21.15.88:0/2174265757 >> v1:172.21.15.88:6789/0 conn(0x7fc6f8159900 legacy=0x7fc6f8069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6fcb3a640 1 -- 172.21.15.88:0/2174265757 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80c8dd0 con 0x7fc6f80b3f00 2023-11-20T07:01:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.745+0000 7fc6f6ffd640 1 -- 172.21.15.88:0/2174265757 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783035349 0 0) 0x7fc6f80b4340 con 0x7fc6f8159900 2023-11-20T07:01:44.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.749+0000 7fc6fcb3a640 1 --2- 172.21.15.88:0/2174265757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6f80b3f00 0x7fc6f80c9b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009d90 tx=0x7fc6f001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff289adf89013c9e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:44.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.749+0000 7fc6f6ffd640 1 -- 172.21.15.88:0/2174265757 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f00a59e0 con 0x7fc6f80b3f00 2023-11-20T07:01:44.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.749+0000 7fc6f6ffd640 1 -- 172.21.15.88:0/2174265757 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f00a5b40 con 0x7fc6f80b3f00 2023-11-20T07:01:44.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.749+0000 7fc6f6ffd640 1 -- 172.21.15.88:0/2174265757 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f00ad440 con 0x7fc6f80b3f00 2023-11-20T07:01:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.749+0000 7fc6fe59d640 1 -- 172.21.15.88:0/2174265757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6f80b3f00 msgr2=0x7fc6f80c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.749+0000 7fc6fe59d640 1 --2- 172.21.15.88:0/2174265757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6f80b3f00 0x7fc6f80c9b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009d90 tx=0x7fc6f001c920 comp rx=0 tx=0).stop 2023-11-20T07:01:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.749+0000 7fc6fe59d640 1 -- 172.21.15.88:0/2174265757 shutdown_connections 2023-11-20T07:01:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.749+0000 7fc6fe59d640 1 --2- 172.21.15.88:0/2174265757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6f80b3f00 0x7fc6f80c9b90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.749+0000 7fc6fe59d640 1 --2- 172.21.15.88:0/2174265757 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6f806a5a0 0x7fc6f806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.749+0000 7fc6fe59d640 1 -- 172.21.15.88:0/2174265757 >> 172.21.15.88:0/2174265757 conn(0x7fc6f80b0da0 msgr2=0x7fc6f80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.749+0000 7fc6fe59d640 1 -- 172.21.15.88:0/2174265757 shutdown_connections 2023-11-20T07:01:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.749+0000 7fc6fe59d640 1 -- 172.21.15.88:0/2174265757 wait complete. 2023-11-20T07:01:44.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6fe59d640 1 Processor -- start 2023-11-20T07:01:44.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6fe59d640 1 -- start start 2023-11-20T07:01:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6fe59d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6f806a5a0 0x7fc6f80b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6fe59d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6f80b3f00 0x7fc6f80c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6fe59d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6f8159900 0x7fc6f815c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6fe59d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80ac2d0 con 0x7fc6f806a5a0 2023-11-20T07:01:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6fe59d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f815ae10 con 0x7fc6f80b3f00 2023-11-20T07:01:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6fe59d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80b31b0 con 0x7fc6f8159900 2023-11-20T07:01:44.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6f806a5a0 0x7fc6f80b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6f806a5a0 0x7fc6f80b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38802/0 (socket says 172.21.15.88:38802) 2023-11-20T07:01:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f7fff640 1 -- 172.21.15.88:0/340305561 learned_addr learned my addr 172.21.15.88:0/340305561 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6fcb3a640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6f8159900 0x7fc6f815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f77fe640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6f80b3f00 0x7fc6f80c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f7fff640 1 -- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6f8159900 msgr2=0x7fc6f815c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f7fff640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6f8159900 0x7fc6f815c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f7fff640 1 -- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6f80b3f00 msgr2=0x7fc6f80c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f7fff640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6f80b3f00 0x7fc6f80c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f7fff640 1 -- 172.21.15.88:0/340305561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f0009a70 con 0x7fc6f806a5a0 2023-11-20T07:01:44.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6fcb3a640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6f8159900 0x7fc6f815c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f7fff640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6f806a5a0 0x7fc6f80b2c70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c4b0 tx=0x7fc6e800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f4ff9640 1 -- 172.21.15.88:0/340305561 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80074e0 con 0x7fc6f806a5a0 2023-11-20T07:01:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f4ff9640 1 -- 172.21.15.88:0/340305561 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e8007660 con 0x7fc6f806a5a0 2023-11-20T07:01:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6fe59d640 1 -- 172.21.15.88:0/340305561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f80b3430 con 0x7fc6f806a5a0 2023-11-20T07:01:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6f4ff9640 1 -- 172.21.15.88:0/340305561 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8004a30 con 0x7fc6f806a5a0 2023-11-20T07:01:44.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.753+0000 7fc6fe59d640 1 -- 172.21.15.88:0/340305561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f80abc80 con 0x7fc6f806a5a0 2023-11-20T07:01:44.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.757+0000 7fc6fe59d640 1 -- 172.21.15.88:0/340305561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f804e170 con 0x7fc6f806a5a0 2023-11-20T07:01:44.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.757+0000 7fc6f4ff9640 1 -- 172.21.15.88:0/340305561 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc6e8004b90 con 0x7fc6f806a5a0 2023-11-20T07:01:44.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.757+0000 7fc6f4ff9640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc6e40664a0 0x7fc6e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:44.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.757+0000 7fc6f4ff9640 1 -- 172.21.15.88:0/340305561 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc6e80833d0 con 0x7fc6f806a5a0 2023-11-20T07:01:44.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.757+0000 7fc6f77fe640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc6e40664a0 0x7fc6e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:44.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.757+0000 7fc6f77fe640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc6e40664a0 0x7fc6e4068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80c8cb0 tx=0x7fc6ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:44.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.761+0000 7fc6f4ff9640 1 -- 172.21.15.88:0/340305561 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc6e8053f10 con 0x7fc6f806a5a0 2023-11-20T07:01:44.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.909+0000 7fc6fe59d640 1 -- 172.21.15.88:0/340305561 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6f80afe90 con 0x7fc6f806a5a0 2023-11-20T07:01:44.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.909+0000 7fc6f4ff9640 1 -- 172.21.15.88:0/340305561 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6e8053aa0 con 0x7fc6f806a5a0 2023-11-20T07:01:44.912 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:44.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.913+0000 7fc6fe59d640 1 -- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc6e40664a0 msgr2=0x7fc6e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.913+0000 7fc6fe59d640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc6e40664a0 0x7fc6e4068960 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80c8cb0 tx=0x7fc6ec008040 comp rx=0 tx=0).stop 2023-11-20T07:01:44.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.913+0000 7fc6fe59d640 1 -- 172.21.15.88:0/340305561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6f806a5a0 msgr2=0x7fc6f80b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:44.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.913+0000 7fc6fe59d640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6f806a5a0 0x7fc6f80b2c70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c4b0 tx=0x7fc6e800c970 comp rx=0 tx=0).stop 2023-11-20T07:01:44.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.913+0000 7fc6fe59d640 1 -- 172.21.15.88:0/340305561 shutdown_connections 2023-11-20T07:01:44.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.913+0000 7fc6fe59d640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc6e40664a0 0x7fc6e4068960 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.913+0000 7fc6fe59d640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6f8159900 0x7fc6f815c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.913+0000 7fc6fe59d640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6f80b3f00 0x7fc6f80c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.913+0000 7fc6fe59d640 1 --2- 172.21.15.88:0/340305561 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6f806a5a0 0x7fc6f80b2c70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:44.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.913+0000 7fc6fe59d640 1 -- 172.21.15.88:0/340305561 >> 172.21.15.88:0/340305561 conn(0x7fc6f80b0da0 msgr2=0x7fc6f8072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:44.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.913+0000 7fc6fe59d640 1 -- 172.21.15.88:0/340305561 shutdown_connections 2023-11-20T07:01:44.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:44.913+0000 7fc6fe59d640 1 -- 172.21.15.88:0/340305561 wait complete. 2023-11-20T07:01:44.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f661373e640 1 Processor -- start 2023-11-20T07:01:45.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f661373e640 1 -- start start 2023-11-20T07:01:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f661373e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f660c15cba0 0x7f660c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f661373e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f660c0d0210 0x7f660c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f661373e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660c0d1670 con 0x7f660c0b84e0 2023-11-20T07:01:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f661373e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c0d1460 con 0x7f660c15cba0 2023-11-20T07:01:45.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f661373e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0d1950 con 0x7f660c0d0210 2023-11-20T07:01:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f66114da640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f660c15cba0 0x7f660c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f6611cdb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f660c0d0210 0x7f660c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f6611cdb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f660c0d0210 0x7f660c0b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:52632/0 (socket says 172.21.15.88:52632) 2023-11-20T07:01:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f6611cdb640 1 -- 172.21.15.88:0/3304651168 learned_addr learned my addr 172.21.15.88:0/3304651168 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f6611cdb640 1 -- 172.21.15.88:0/3304651168 >> v2:172.21.15.175:3300/0 conn(0x7f660c15cba0 msgr2=0x7f660c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f6611cdb640 1 --2- 172.21.15.88:0/3304651168 >> v2:172.21.15.175:3300/0 conn(0x7f660c15cba0 0x7f660c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f6611cdb640 1 -- 172.21.15.88:0/3304651168 >> v1:172.21.15.175:6789/0 conn(0x7f660c0b84e0 legacy=0x7f660c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.073+0000 7f6611cdb640 1 -- 172.21.15.88:0/3304651168 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c0d1c30 con 0x7f660c0d0210 2023-11-20T07:01:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.077+0000 7f6611cdb640 1 --2- 172.21.15.88:0/3304651168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f660c0d0210 0x7f660c0b5cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6604009e50 tx=0x7f660401ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=144c8d528a7267d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.077+0000 7f6603fff640 1 -- 172.21.15.88:0/3304651168 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66040a58e0 con 0x7f660c0d0210 2023-11-20T07:01:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.077+0000 7f6603fff640 1 -- 172.21.15.88:0/3304651168 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66040a5a40 con 0x7f660c0d0210 2023-11-20T07:01:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.077+0000 7f6603fff640 1 -- 172.21.15.88:0/3304651168 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66040a5dd0 con 0x7f660c0d0210 2023-11-20T07:01:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.077+0000 7f661373e640 1 -- 172.21.15.88:0/3304651168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f660c0d0210 msgr2=0x7f660c0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.077+0000 7f661373e640 1 --2- 172.21.15.88:0/3304651168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f660c0d0210 0x7f660c0b5cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6604009e50 tx=0x7f660401ca10 comp rx=0 tx=0).stop 2023-11-20T07:01:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.077+0000 7f661373e640 1 -- 172.21.15.88:0/3304651168 shutdown_connections 2023-11-20T07:01:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.077+0000 7f661373e640 1 --2- 172.21.15.88:0/3304651168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f660c0d0210 0x7f660c0b5cf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.077+0000 7f661373e640 1 --2- 172.21.15.88:0/3304651168 >> v2:172.21.15.175:3300/0 conn(0x7f660c15cba0 0x7f660c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.077+0000 7f661373e640 1 -- 172.21.15.88:0/3304651168 >> 172.21.15.88:0/3304651168 conn(0x7f660c0719c0 msgr2=0x7f660c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.077+0000 7f661373e640 1 -- 172.21.15.88:0/3304651168 shutdown_connections 2023-11-20T07:01:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.077+0000 7f661373e640 1 -- 172.21.15.88:0/3304651168 wait complete. 2023-11-20T07:01:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f661373e640 1 Processor -- start 2023-11-20T07:01:45.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f661373e640 1 -- start start 2023-11-20T07:01:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f661373e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f660c0b84e0 0x7f660c14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f661373e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f660c0d0210 0x7f660c156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f661373e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f660c15cba0 0x7f660c1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f661373e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c14e080 con 0x7f660c0d0210 2023-11-20T07:01:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f661373e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0c8c10 con 0x7f660c0b84e0 2023-11-20T07:01:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f661373e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c156a50 con 0x7f660c15cba0 2023-11-20T07:01:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6610cd9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f660c0d0210 0x7f660c156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6610cd9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f660c0d0210 0x7f660c156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38810/0 (socket says 172.21.15.88:38810) 2023-11-20T07:01:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6610cd9640 1 -- 172.21.15.88:0/3112021040 learned_addr learned my addr 172.21.15.88:0/3112021040 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f66114da640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f660c0b84e0 0x7f660c14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6611cdb640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f660c15cba0 0x7f660c1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6610cd9640 1 -- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f660c15cba0 msgr2=0x7f660c1545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6610cd9640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f660c15cba0 0x7f660c1545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6610cd9640 1 -- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f660c0b84e0 msgr2=0x7f660c14db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6610cd9640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f660c0b84e0 0x7f660c14db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6610cd9640 1 -- 172.21.15.88:0/3112021040 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6604009b30 con 0x7f660c0d0210 2023-11-20T07:01:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6610cd9640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f660c0d0210 0x7f660c156090 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00c370 tx=0x7f65fc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:45.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6601ffb640 1 -- 172.21.15.88:0/3112021040 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0052d0 con 0x7f660c0d0210 2023-11-20T07:01:45.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6601ffb640 1 -- 172.21.15.88:0/3112021040 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc005430 con 0x7f660c0d0210 2023-11-20T07:01:45.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f661373e640 1 -- 172.21.15.88:0/3112021040 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c156d30 con 0x7f660c0d0210 2023-11-20T07:01:45.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f6601ffb640 1 -- 172.21.15.88:0/3112021040 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc007260 con 0x7f660c0d0210 2023-11-20T07:01:45.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.081+0000 7f661373e640 1 -- 172.21.15.88:0/3112021040 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c1572f0 con 0x7f660c0d0210 2023-11-20T07:01:45.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.085+0000 7f661373e640 1 -- 172.21.15.88:0/3112021040 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c04e170 con 0x7f660c0d0210 2023-11-20T07:01:45.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.085+0000 7f6601ffb640 1 -- 172.21.15.88:0/3112021040 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f65fc0073c0 con 0x7f660c0d0210 2023-11-20T07:01:45.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.085+0000 7f6601ffb640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f65f00664a0 0x7f65f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.085+0000 7f6601ffb640 1 -- 172.21.15.88:0/3112021040 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f65fc083570 con 0x7f660c0d0210 2023-11-20T07:01:45.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.085+0000 7f66114da640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f65f00664a0 0x7f65f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.085+0000 7f66114da640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f65f00664a0 0x7f65f0068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6608009b60 tx=0x7f6608009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:45.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.089+0000 7f6601ffb640 1 -- 172.21.15.88:0/3112021040 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f65fc050640 con 0x7f660c0d0210 2023-11-20T07:01:45.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.237+0000 7f661373e640 1 -- 172.21.15.88:0/3112021040 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f660c0cfdc0 con 0x7f660c0d0210 2023-11-20T07:01:45.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f6601ffb640 1 -- 172.21.15.88:0/3112021040 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65fc053c60 con 0x7f660c0d0210 2023-11-20T07:01:45.241 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:45.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f661373e640 1 -- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f65f00664a0 msgr2=0x7f65f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f661373e640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f65f00664a0 0x7f65f0068960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6608009b60 tx=0x7f6608009190 comp rx=0 tx=0).stop 2023-11-20T07:01:45.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f661373e640 1 -- 172.21.15.88:0/3112021040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f660c0d0210 msgr2=0x7f660c156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f661373e640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f660c0d0210 0x7f660c156090 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00c370 tx=0x7f65fc00c830 comp rx=0 tx=0).stop 2023-11-20T07:01:45.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f661373e640 1 -- 172.21.15.88:0/3112021040 shutdown_connections 2023-11-20T07:01:45.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f661373e640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f65f00664a0 0x7f65f0068960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f661373e640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f660c15cba0 0x7f660c1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f661373e640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f660c0d0210 0x7f660c156090 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f661373e640 1 --2- 172.21.15.88:0/3112021040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f660c0b84e0 0x7f660c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f661373e640 1 -- 172.21.15.88:0/3112021040 >> 172.21.15.88:0/3112021040 conn(0x7f660c0719c0 msgr2=0x7f660c15b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:45.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f661373e640 1 -- 172.21.15.88:0/3112021040 shutdown_connections 2023-11-20T07:01:45.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.241+0000 7f661373e640 1 -- 172.21.15.88:0/3112021040 wait complete. 2023-11-20T07:01:45.261 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:45.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b4f66b640 1 Processor -- start 2023-11-20T07:01:45.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b4f66b640 1 -- start start 2023-11-20T07:01:45.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b4f66b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0b48069e90 0x7f0b4806d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b4f66b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4815ae30 con 0x7f0b4806a270 2023-11-20T07:01:45.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b4f66b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b480ca510 con 0x7f0b480c26b0 2023-11-20T07:01:45.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b4f66b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b480cb090 con 0x7f0b48069e90 2023-11-20T07:01:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b4cc06640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0b4806a270 0x7f0b480c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34762/0 (socket says 172.21.15.88:34762) 2023-11-20T07:01:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b4cc06640 1 -- 172.21.15.88:0/2121833983 learned_addr learned my addr 172.21.15.88:0/2121833983 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b4d407640 1 --2- 172.21.15.88:0/2121833983 >> v2:172.21.15.175:3300/0 conn(0x7f0b48069e90 0x7f0b4806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b3ffff640 1 -- 172.21.15.88:0/2121833983 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239309539 0 0) 0x7f0b4815ae30 con 0x7f0b4806a270 2023-11-20T07:01:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b3ffff640 1 -- 172.21.15.88:0/2121833983 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b34003530 con 0x7f0b4806a270 2023-11-20T07:01:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b3ffff640 1 -- 172.21.15.88:0/2121833983 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778217349 0 0) 0x7f0b480ca510 con 0x7f0b480c26b0 2023-11-20T07:01:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b4d407640 1 -- 172.21.15.88:0/2121833983 >> v1:172.21.15.175:6789/0 conn(0x7f0b480c26b0 legacy=0x7f0b480c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b4d407640 1 -- 172.21.15.88:0/2121833983 >> v1:172.21.15.88:6789/0 conn(0x7f0b4806a270 legacy=0x7f0b480c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.401+0000 7f0b4d407640 1 -- 172.21.15.88:0/2121833983 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b480ca7f0 con 0x7f0b48069e90 2023-11-20T07:01:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.405+0000 7f0b4d407640 1 --2- 172.21.15.88:0/2121833983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b48069e90 0x7f0b4806d010 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0b440097c0 tx=0x7f0b4401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19d4f2e1efd8377a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.405+0000 7f0b3ffff640 1 -- 172.21.15.88:0/2121833983 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b480c3a20 con 0x7f0b48069e90 2023-11-20T07:01:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.405+0000 7f0b3ffff640 1 -- 172.21.15.88:0/2121833983 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b440ab650 con 0x7f0b48069e90 2023-11-20T07:01:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.405+0000 7f0b3ffff640 1 -- 172.21.15.88:0/2121833983 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b440ab9e0 con 0x7f0b48069e90 2023-11-20T07:01:45.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.405+0000 7f0b4f66b640 1 -- 172.21.15.88:0/2121833983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b48069e90 msgr2=0x7f0b4806d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.405+0000 7f0b4f66b640 1 --2- 172.21.15.88:0/2121833983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b48069e90 0x7f0b4806d010 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0b440097c0 tx=0x7f0b4401c450 comp rx=0 tx=0).stop 2023-11-20T07:01:45.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.405+0000 7f0b4f66b640 1 -- 172.21.15.88:0/2121833983 shutdown_connections 2023-11-20T07:01:45.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.405+0000 7f0b4f66b640 1 --2- 172.21.15.88:0/2121833983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b48069e90 0x7f0b4806d010 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.405+0000 7f0b4f66b640 1 -- 172.21.15.88:0/2121833983 >> 172.21.15.88:0/2121833983 conn(0x7f0b480b0da0 msgr2=0x7f0b480ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:45.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.405+0000 7f0b4f66b640 1 -- 172.21.15.88:0/2121833983 shutdown_connections 2023-11-20T07:01:45.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.405+0000 7f0b4f66b640 1 -- 172.21.15.88:0/2121833983 wait complete. 2023-11-20T07:01:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4f66b640 1 Processor -- start 2023-11-20T07:01:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4f66b640 1 -- start start 2023-11-20T07:01:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4f66b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b48069e90 0x7f0b48153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4f66b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4806a270 0x7f0b480ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4f66b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480c26b0 0x7f0b480c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4f66b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b481f5760 con 0x7f0b48069e90 2023-11-20T07:01:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4f66b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b48154300 con 0x7f0b4806a270 2023-11-20T07:01:45.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4f66b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b481f59b0 con 0x7f0b480c26b0 2023-11-20T07:01:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4d407640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b48069e90 0x7f0b48153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4d407640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b48069e90 0x7f0b48153cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38820/0 (socket says 172.21.15.88:38820) 2023-11-20T07:01:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4d407640 1 -- 172.21.15.88:0/3893457513 learned_addr learned my addr 172.21.15.88:0/3893457513 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4cc06640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4806a270 0x7f0b480ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4dc08640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480c26b0 0x7f0b480c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4d407640 1 -- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480c26b0 msgr2=0x7f0b480c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4d407640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480c26b0 0x7f0b480c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4d407640 1 -- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4806a270 msgr2=0x7f0b480ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4d407640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4806a270 0x7f0b480ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4d407640 1 -- 172.21.15.88:0/3893457513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b44009420 con 0x7f0b48069e90 2023-11-20T07:01:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4d407640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b48069e90 0x7f0b48153cf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0b440ad040 tx=0x7f0b4401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b3dffb640 1 -- 172.21.15.88:0/3893457513 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44004020 con 0x7f0b48069e90 2023-11-20T07:01:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b3dffb640 1 -- 172.21.15.88:0/3893457513 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b44004180 con 0x7f0b48069e90 2023-11-20T07:01:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4f66b640 1 -- 172.21.15.88:0/3893457513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b481f5c90 con 0x7f0b48069e90 2023-11-20T07:01:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b3dffb640 1 -- 172.21.15.88:0/3893457513 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44004510 con 0x7f0b48069e90 2023-11-20T07:01:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.409+0000 7f0b4f66b640 1 -- 172.21.15.88:0/3893457513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b48154830 con 0x7f0b48069e90 2023-11-20T07:01:45.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.413+0000 7f0b4f66b640 1 -- 172.21.15.88:0/3893457513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b481f5e50 con 0x7f0b48069e90 2023-11-20T07:01:45.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.413+0000 7f0b3dffb640 1 -- 172.21.15.88:0/3893457513 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0b440b5610 con 0x7f0b48069e90 2023-11-20T07:01:45.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.413+0000 7f0b3dffb640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0b2c0664a0 0x7f0b2c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.413+0000 7f0b3dffb640 1 -- 172.21.15.88:0/3893457513 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0b4411ee10 con 0x7f0b48069e90 2023-11-20T07:01:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.413+0000 7f0b4cc06640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0b2c0664a0 0x7f0b2c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.413+0000 7f0b4cc06640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0b2c0664a0 0x7f0b2c068960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b4815d1e0 tx=0x7f0b38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:45.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.417+0000 7f0b3dffb640 1 -- 172.21.15.88:0/3893457513 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0b440ebf80 con 0x7f0b48069e90 2023-11-20T07:01:45.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.565+0000 7f0b4f66b640 1 -- 172.21.15.88:0/3893457513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0b4804e170 con 0x7f0b48069e90 2023-11-20T07:01:45.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.565+0000 7f0b3dffb640 1 -- 172.21.15.88:0/3893457513 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0b440c4020 con 0x7f0b48069e90 2023-11-20T07:01:45.568 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.569+0000 7f0b4f66b640 1 -- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0b2c0664a0 msgr2=0x7f0b2c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.569+0000 7f0b4f66b640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0b2c0664a0 0x7f0b2c068960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b4815d1e0 tx=0x7f0b38009040 comp rx=0 tx=0).stop 2023-11-20T07:01:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.569+0000 7f0b4f66b640 1 -- 172.21.15.88:0/3893457513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b48069e90 msgr2=0x7f0b48153cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.569+0000 7f0b4f66b640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b48069e90 0x7f0b48153cf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0b440ad040 tx=0x7f0b4401ac90 comp rx=0 tx=0).stop 2023-11-20T07:01:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.569+0000 7f0b4f66b640 1 -- 172.21.15.88:0/3893457513 shutdown_connections 2023-11-20T07:01:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.569+0000 7f0b4f66b640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0b2c0664a0 0x7f0b2c068960 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.569+0000 7f0b4f66b640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b480c26b0 0x7f0b480c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.569+0000 7f0b4f66b640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4806a270 0x7f0b480ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.569+0000 7f0b4f66b640 1 --2- 172.21.15.88:0/3893457513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b48069e90 0x7f0b48153cf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.569+0000 7f0b4f66b640 1 -- 172.21.15.88:0/3893457513 >> 172.21.15.88:0/3893457513 conn(0x7f0b480b0da0 msgr2=0x7f0b480c4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.569+0000 7f0b4f66b640 1 -- 172.21.15.88:0/3893457513 shutdown_connections 2023-11-20T07:01:45.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.569+0000 7f0b4f66b640 1 -- 172.21.15.88:0/3893457513 wait complete. 2023-11-20T07:01:45.588 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection' 2023-11-20T07:01:45.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.725+0000 7fef2df1d640 1 Processor -- start 2023-11-20T07:01:45.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.725+0000 7fef2df1d640 1 -- start start 2023-11-20T07:01:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef2df1d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fef2815cf90 0x7fef2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef2df1d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef280ce310 0x7fef280ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef2df1d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef2815d4e0 con 0x7fef280b2ad0 2023-11-20T07:01:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef2df1d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef280ced00 con 0x7fef2815cf90 2023-11-20T07:01:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef2df1d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef28160580 con 0x7fef280ce310 2023-11-20T07:01:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef277fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fef280b2ad0 0x7fef2806b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34774/0 (socket says 172.21.15.88:34774) 2023-11-20T07:01:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef277fe640 1 -- 172.21.15.88:0/3365700462 learned_addr learned my addr 172.21.15.88:0/3365700462 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef26ffd640 1 --2- 172.21.15.88:0/3365700462 >> v2:172.21.15.175:3300/0 conn(0x7fef2815cf90 0x7fef2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef27fff640 1 --2- 172.21.15.88:0/3365700462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef280ce310 0x7fef280ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef267fc640 1 -- 172.21.15.88:0/3365700462 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097979373 0 0) 0x7fef2815d4e0 con 0x7fef280b2ad0 2023-11-20T07:01:45.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef267fc640 1 -- 172.21.15.88:0/3365700462 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef10003530 con 0x7fef280b2ad0 2023-11-20T07:01:45.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef26ffd640 1 -- 172.21.15.88:0/3365700462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef280ce310 msgr2=0x7fef280ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:45.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef26ffd640 1 --2- 172.21.15.88:0/3365700462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef280ce310 0x7fef280ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef26ffd640 1 -- 172.21.15.88:0/3365700462 >> v1:172.21.15.88:6789/0 conn(0x7fef280b2ad0 legacy=0x7fef2806b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.729+0000 7fef26ffd640 1 -- 172.21.15.88:0/3365700462 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2815d7c0 con 0x7fef2815cf90 2023-11-20T07:01:45.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef26ffd640 1 --2- 172.21.15.88:0/3365700462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef2815cf90 0x7fef2806c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0097f0 tx=0x7fef1c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf09b1c7aec98cf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef267fc640 1 -- 172.21.15.88:0/3365700462 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0ab650 con 0x7fef2815cf90 2023-11-20T07:01:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef267fc640 1 -- 172.21.15.88:0/3365700462 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c0ab7b0 con 0x7fef2815cf90 2023-11-20T07:01:45.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef267fc640 1 -- 172.21.15.88:0/3365700462 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0abb40 con 0x7fef2815cf90 2023-11-20T07:01:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef2df1d640 1 -- 172.21.15.88:0/3365700462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef2815cf90 msgr2=0x7fef2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef2df1d640 1 --2- 172.21.15.88:0/3365700462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef2815cf90 0x7fef2806c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0097f0 tx=0x7fef1c01c450 comp rx=0 tx=0).stop 2023-11-20T07:01:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef2df1d640 1 -- 172.21.15.88:0/3365700462 shutdown_connections 2023-11-20T07:01:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef2df1d640 1 --2- 172.21.15.88:0/3365700462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef280ce310 0x7fef280ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef2df1d640 1 --2- 172.21.15.88:0/3365700462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef2815cf90 0x7fef2806c8f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef2df1d640 1 -- 172.21.15.88:0/3365700462 >> 172.21.15.88:0/3365700462 conn(0x7fef280cd1c0 msgr2=0x7fef280cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef2df1d640 1 -- 172.21.15.88:0/3365700462 shutdown_connections 2023-11-20T07:01:45.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef2df1d640 1 -- 172.21.15.88:0/3365700462 wait complete. 2023-11-20T07:01:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef2df1d640 1 Processor -- start 2023-11-20T07:01:45.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.733+0000 7fef2df1d640 1 -- start start 2023-11-20T07:01:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef2df1d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef280b2ad0 0x7fef281522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef2df1d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef280ce310 0x7fef280b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef2df1d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef2815cf90 0x7fef280b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef2df1d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef28151860 con 0x7fef280b2ad0 2023-11-20T07:01:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef2df1d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef280b02e0 con 0x7fef2815cf90 2023-11-20T07:01:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef2df1d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef280b05c0 con 0x7fef280ce310 2023-11-20T07:01:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef277fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef280b2ad0 0x7fef281522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef277fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef280b2ad0 0x7fef281522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38824/0 (socket says 172.21.15.88:38824) 2023-11-20T07:01:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef277fe640 1 -- 172.21.15.88:0/3055885728 learned_addr learned my addr 172.21.15.88:0/3055885728 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:45.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef27fff640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef2815cf90 0x7fef280b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef26ffd640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef280ce310 0x7fef280b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef277fe640 1 -- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef280ce310 msgr2=0x7fef280b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef277fe640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef280ce310 0x7fef280b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef277fe640 1 -- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef2815cf90 msgr2=0x7fef280b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef277fe640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef2815cf90 0x7fef280b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef277fe640 1 -- 172.21.15.88:0/3055885728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009420 con 0x7fef280b2ad0 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef27fff640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef2815cf90 0x7fef280b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef277fe640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef280b2ad0 0x7fef281522c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fef1800c420 tx=0x7fef1800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef0ffff640 1 -- 172.21.15.88:0/3055885728 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18005cf0 con 0x7fef280b2ad0 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef0ffff640 1 -- 172.21.15.88:0/3055885728 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef18005e50 con 0x7fef280b2ad0 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef0ffff640 1 -- 172.21.15.88:0/3055885728 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef180072d0 con 0x7fef280b2ad0 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef2df1d640 1 -- 172.21.15.88:0/3055885728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef280b08a0 con 0x7fef280b2ad0 2023-11-20T07:01:45.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef2df1d640 1 -- 172.21.15.88:0/3055885728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef28151da0 con 0x7fef280b2ad0 2023-11-20T07:01:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef2df1d640 1 -- 172.21.15.88:0/3055885728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef280b0a90 con 0x7fef280b2ad0 2023-11-20T07:01:45.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.737+0000 7fef0ffff640 1 -- 172.21.15.88:0/3055885728 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fef18007430 con 0x7fef280b2ad0 2023-11-20T07:01:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.741+0000 7fef0ffff640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fef140664a0 0x7fef14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.741+0000 7fef0ffff640 1 -- 172.21.15.88:0/3055885728 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fef180837f0 con 0x7fef280b2ad0 2023-11-20T07:01:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.741+0000 7fef26ffd640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fef140664a0 0x7fef14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:45.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.741+0000 7fef26ffd640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fef140664a0 0x7fef14068960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0af000 tx=0x7fef1c0b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:45.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.741+0000 7fef0ffff640 1 -- 172.21.15.88:0/3055885728 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fef180508c0 con 0x7fef280b2ad0 2023-11-20T07:01:45.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:45.949+0000 7fef2df1d640 1 -- 172.21.15.88:0/3055885728 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]} v 0) v1 -- 0x7fef28151f90 con 0x7fef280b2ad0 2023-11-20T07:01:46.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef0ffff640 1 -- 172.21.15.88:0/3055885728 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]}]=0 v72) v1 ==== 148+0+0 (secure 0 0 0) 0x7fef18053ee0 con 0x7fef280b2ad0 2023-11-20T07:01:46.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef2df1d640 1 -- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fef140664a0 msgr2=0x7fef14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:46.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef2df1d640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fef140664a0 0x7fef14068960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fef1c0af000 tx=0x7fef1c0b6040 comp rx=0 tx=0).stop 2023-11-20T07:01:46.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef2df1d640 1 -- 172.21.15.88:0/3055885728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef280b2ad0 msgr2=0x7fef281522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:46.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef2df1d640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef280b2ad0 0x7fef281522c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fef1800c420 tx=0x7fef1800c8e0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef2df1d640 1 -- 172.21.15.88:0/3055885728 shutdown_connections 2023-11-20T07:01:46.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef2df1d640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fef140664a0 0x7fef14068960 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef2df1d640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef280ce310 0x7fef280b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef2df1d640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef2815cf90 0x7fef280b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef2df1d640 1 --2- 172.21.15.88:0/3055885728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef280b2ad0 0x7fef281522c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef2df1d640 1 -- 172.21.15.88:0/3055885728 >> 172.21.15.88:0/3055885728 conn(0x7fef280cd1c0 msgr2=0x7fef2806bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:46.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef2df1d640 1 -- 172.21.15.88:0/3055885728 shutdown_connections 2023-11-20T07:01:46.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.645+0000 7fef2df1d640 1 -- 172.21.15.88:0/3055885728 wait complete. 2023-11-20T07:01:46.669 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-20T07:01:46.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe71993e640 1 Processor -- start 2023-11-20T07:01:46.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe71993e640 1 -- start start 2023-11-20T07:01:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe71993e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe71415cba0 0x7fe7140d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe71993e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7140d1670 con 0x7fe7140b84e0 2023-11-20T07:01:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe71993e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7140d1950 con 0x7fe7140d0210 2023-11-20T07:01:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe71993e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140d1460 con 0x7fe71415cba0 2023-11-20T07:01:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe70a7fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe7140b84e0 0x7fe7140cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36360/0 (socket says 172.21.15.88:36360) 2023-11-20T07:01:46.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe70a7fc640 1 -- 172.21.15.88:0/2015001170 learned_addr learned my addr 172.21.15.88:0/2015001170 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe712ffd640 1 --2- 172.21.15.88:0/2015001170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe71415cba0 0x7fe7140d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697162837 0 0) 0x7fe7140d1670 con 0x7fe7140b84e0 2023-11-20T07:01:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe700003530 con 0x7fe7140b84e0 2023-11-20T07:01:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2006849996 0 0) 0x7fe700003530 con 0x7fe7140b84e0 2023-11-20T07:01:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe71415cba0 msgr2=0x7fe7140d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:46.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 --2- 172.21.15.88:0/2015001170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe71415cba0 0x7fe7140d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 >> v1:172.21.15.175:6789/0 conn(0x7fe7140d0210 legacy=0x7fe7140b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7140d1c30 con 0x7fe7140b84e0 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fe704001680 con 0x7fe7140b84e0 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 >> v1:172.21.15.88:6789/0 conn(0x7fe7140b84e0 legacy=0x7fe7140cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 --2- 172.21.15.88:0/2015001170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7000039b0 0x7fe700003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 --2- 172.21.15.88:0/2015001170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe700004360 0x7fe700004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 --2- 172.21.15.88:0/2015001170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe71415cba0 0x7fe700005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140d1460 con 0x7fe700004360 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70000b990 con 0x7fe7000039b0 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70000bb50 con 0x7fe71415cba0 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.809+0000 7fe70a7fc640 1 --2- 172.21.15.88:0/2015001170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe700004360 0x7fe700004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe712ffd640 1 --2- 172.21.15.88:0/2015001170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7000039b0 0x7fe700003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:46.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe7137fe640 1 --2- 172.21.15.88:0/2015001170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe71415cba0 0x7fe700005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe70a7fc640 1 -- 172.21.15.88:0/2015001170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe71415cba0 msgr2=0x7fe700005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe70a7fc640 1 --2- 172.21.15.88:0/2015001170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe71415cba0 0x7fe700005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe70a7fc640 1 -- 172.21.15.88:0/2015001170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7000039b0 msgr2=0x7fe700003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe70a7fc640 1 --2- 172.21.15.88:0/2015001170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7000039b0 0x7fe700003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe70a7fc640 1 -- 172.21.15.88:0/2015001170 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe700003530 con 0x7fe700004360 2023-11-20T07:01:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe70a7fc640 1 --2- 172.21.15.88:0/2015001170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe700004360 0x7fe700004830 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c190 tx=0x7fe70401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7377d933b4cc23b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:46.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704005ae0 con 0x7fe700004360 2023-11-20T07:01:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe704005c60 con 0x7fe700004360 2023-11-20T07:01:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe7127fc640 1 -- 172.21.15.88:0/2015001170 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7040a57b0 con 0x7fe700004360 2023-11-20T07:01:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe71993e640 1 -- 172.21.15.88:0/2015001170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe700004360 msgr2=0x7fe700004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe71993e640 1 --2- 172.21.15.88:0/2015001170 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe700004360 0x7fe700004830 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c190 tx=0x7fe70401cbc0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe7137fe640 1 -- 172.21.15.88:0/2015001170 reap_dead start 2023-11-20T07:01:46.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe71993e640 1 -- 172.21.15.88:0/2015001170 shutdown_connections 2023-11-20T07:01:46.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.813+0000 7fe71993e640 1 -- 172.21.15.88:0/2015001170 >> 172.21.15.88:0/2015001170 conn(0x7fe7140719c0 msgr2=0x7fe714071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:46.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe71993e640 1 -- 172.21.15.88:0/2015001170 shutdown_connections 2023-11-20T07:01:46.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe71993e640 1 -- 172.21.15.88:0/2015001170 wait complete. 2023-11-20T07:01:46.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe71993e640 1 Processor -- start 2023-11-20T07:01:46.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe71993e640 1 -- start start 2023-11-20T07:01:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe71993e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe700004360 0x7fe7140c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe71993e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe71415e530 0x7fe7141f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe71993e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71415e990 0x7fe7141f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe71993e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140cadb0 con 0x7fe71415e530 2023-11-20T07:01:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe71993e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7141f5330 con 0x7fe71415e990 2023-11-20T07:01:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe71993e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7140ca7f0 con 0x7fe700004360 2023-11-20T07:01:46.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe70a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe71415e530 0x7fe7141f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe70a7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe71415e530 0x7fe7141f48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38018/0 (socket says 172.21.15.88:38018) 2023-11-20T07:01:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe70a7fc640 1 -- 172.21.15.88:0/1509132136 learned_addr learned my addr 172.21.15.88:0/1509132136 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe712ffd640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe700004360 0x7fe7140c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe7137fe640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71415e990 0x7fe7141f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe70a7fc640 1 -- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe700004360 msgr2=0x7fe7140c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe70a7fc640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe700004360 0x7fe7140c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe70a7fc640 1 -- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71415e990 msgr2=0x7fe7141f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe70a7fc640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71415e990 0x7fe7141f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe70a7fc640 1 -- 172.21.15.88:0/1509132136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7140caad0 con 0x7fe71415e530 2023-11-20T07:01:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe7137fe640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71415e990 0x7fe7141f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:46.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe70a7fc640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe71415e530 0x7fe7141f48b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c190 tx=0x7fe700005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.817+0000 7fe710ff9640 1 -- 172.21.15.88:0/1509132136 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7040b4070 con 0x7fe71415e530 2023-11-20T07:01:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.821+0000 7fe710ff9640 1 -- 172.21.15.88:0/1509132136 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe704005dd0 con 0x7fe71415e530 2023-11-20T07:01:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.821+0000 7fe710ff9640 1 -- 172.21.15.88:0/1509132136 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704001660 con 0x7fe71415e530 2023-11-20T07:01:46.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.821+0000 7fe71993e640 1 -- 172.21.15.88:0/1509132136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe714150f10 con 0x7fe71415e530 2023-11-20T07:01:46.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.821+0000 7fe71993e640 1 -- 172.21.15.88:0/1509132136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe714156be0 con 0x7fe71415e530 2023-11-20T07:01:46.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.821+0000 7fe71993e640 1 -- 172.21.15.88:0/1509132136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71404e170 con 0x7fe71415e530 2023-11-20T07:01:46.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.821+0000 7fe710ff9640 1 -- 172.21.15.88:0/1509132136 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe7040a57b0 con 0x7fe71415e530 2023-11-20T07:01:46.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.821+0000 7fe710ff9640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6f40664a0 0x7fe6f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:46.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.821+0000 7fe710ff9640 1 -- 172.21.15.88:0/1509132136 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe70411dbc0 con 0x7fe71415e530 2023-11-20T07:01:46.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.821+0000 7fe712ffd640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6f40664a0 0x7fe6f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:46.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.825+0000 7fe712ffd640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6f40664a0 0x7fe6f4068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009be0 tx=0x7fe6fc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:46.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.825+0000 7fe710ff9640 1 -- 172.21.15.88:0/1509132136 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe7040eac70 con 0x7fe71415e530 2023-11-20T07:01:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.977+0000 7fe71993e640 1 -- 172.21.15.88:0/1509132136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe7140cdd80 con 0x7fe71415e530 2023-11-20T07:01:46.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.981+0000 7fe710ff9640 1 -- 172.21.15.88:0/1509132136 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe7040ee290 con 0x7fe71415e530 2023-11-20T07:01:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.985+0000 7fe71993e640 1 -- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6f40664a0 msgr2=0x7fe6f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.985+0000 7fe71993e640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6f40664a0 0x7fe6f4068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc009be0 tx=0x7fe6fc009190 comp rx=0 tx=0).stop 2023-11-20T07:01:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.985+0000 7fe71993e640 1 -- 172.21.15.88:0/1509132136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe71415e530 msgr2=0x7fe7141f48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.985+0000 7fe71993e640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe71415e530 0x7fe7141f48b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c190 tx=0x7fe700005800 comp rx=0 tx=0).stop 2023-11-20T07:01:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.985+0000 7fe71993e640 1 -- 172.21.15.88:0/1509132136 shutdown_connections 2023-11-20T07:01:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.985+0000 7fe71993e640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6f40664a0 0x7fe6f4068960 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.985+0000 7fe71993e640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe71415e990 0x7fe7141f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.985+0000 7fe71993e640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe71415e530 0x7fe7141f48b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.985+0000 7fe71993e640 1 --2- 172.21.15.88:0/1509132136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe700004360 0x7fe7140c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:46.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.985+0000 7fe71993e640 1 -- 172.21.15.88:0/1509132136 >> 172.21.15.88:0/1509132136 conn(0x7fe7140719c0 msgr2=0x7fe7140b6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:46.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.985+0000 7fe71993e640 1 -- 172.21.15.88:0/1509132136 shutdown_connections 2023-11-20T07:01:46.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:46.985+0000 7fe71993e640 1 -- 172.21.15.88:0/1509132136 wait complete. 2023-11-20T07:01:47.004 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-20T07:01:47.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-20T07:01:47.115 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-20T07:01:47.164 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:01:47.167 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:01:47.209 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-20T07:01:47.210 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:01:47.210 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:47.219 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:01:47.219 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:47.272 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:47.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.457+0000 7f9393e17640 1 Processor -- start 2023-11-20T07:01:47.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.457+0000 7f9393e17640 1 -- start start 2023-11-20T07:01:47.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9393e17640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f938c0d15d0 0x7f938c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9393e17640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c0ce770 con 0x7f938c15cb90 2023-11-20T07:01:47.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9393e17640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c0d0600 con 0x7f938c0d3010 2023-11-20T07:01:47.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9393e17640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938c0c6450 con 0x7f938c0d15d0 2023-11-20T07:01:47.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9391bb3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f938c15cb90 0x7f938c0d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36370/0 (socket says 172.21.15.88:36370) 2023-11-20T07:01:47.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9391bb3640 1 -- 172.21.15.88:0/3077563768 learned_addr learned my addr 172.21.15.88:0/3077563768 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:47.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991846549 0 0) 0x7f938c0ce770 con 0x7f938c15cb90 2023-11-20T07:01:47.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f93913b2640 1 --2- 172.21.15.88:0/3077563768 >> v2:172.21.15.175:3300/0 conn(0x7f938c0d15d0 0x7f938c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9378003530 con 0x7f938c15cb90 2023-11-20T07:01:47.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1029383071 0 0) 0x7f9378003530 con 0x7f938c15cb90 2023-11-20T07:01:47.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 >> v2:172.21.15.175:3300/0 conn(0x7f938c0d15d0 msgr2=0x7f938c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:47.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 --2- 172.21.15.88:0/3077563768 >> v2:172.21.15.175:3300/0 conn(0x7f938c0d15d0 0x7f938c0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 >> v1:172.21.15.175:6789/0 conn(0x7f938c0d3010 legacy=0x7f938c0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0d08a0 con 0x7f938c15cb90 2023-11-20T07:01:47.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f9388001800 con 0x7f938c15cb90 2023-11-20T07:01:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 >> v1:172.21.15.88:6789/0 conn(0x7f938c15cb90 legacy=0x7f938c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 --2- 172.21.15.88:0/3077563768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9378003980 0x7f9378003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 --2- 172.21.15.88:0/3077563768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93780047d0 0x7f9378004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 --2- 172.21.15.88:0/3077563768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9378005190 0x7f937800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0c6450 con 0x7f93780047d0 2023-11-20T07:01:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937800c130 con 0x7f9378005190 2023-11-20T07:01:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937800c2f0 con 0x7f9378003980 2023-11-20T07:01:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f93913b2640 1 --2- 172.21.15.88:0/3077563768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93780047d0 0x7f9378004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f9391bb3640 1 --2- 172.21.15.88:0/3077563768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9378003980 0x7f9378003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f93923b4640 1 --2- 172.21.15.88:0/3077563768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9378005190 0x7f937800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f93913b2640 1 -- 172.21.15.88:0/3077563768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9378003980 msgr2=0x7f9378003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:47.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f93913b2640 1 --2- 172.21.15.88:0/3077563768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9378003980 0x7f9378003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f93913b2640 1 -- 172.21.15.88:0/3077563768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9378005190 msgr2=0x7f937800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:47.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f93913b2640 1 --2- 172.21.15.88:0/3077563768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9378005190 0x7f937800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f93913b2640 1 -- 172.21.15.88:0/3077563768 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9378003530 con 0x7f93780047d0 2023-11-20T07:01:47.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.461+0000 7f93923b4640 1 -- 172.21.15.88:0/3077563768 reap_dead start 2023-11-20T07:01:47.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f93913b2640 1 --2- 172.21.15.88:0/3077563768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93780047d0 0x7f9378004c50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f937c009ae0 tx=0x7f937c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a20a480a1d3f83 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:47.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c0a6410 con 0x7f93780047d0 2023-11-20T07:01:47.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c0a6570 con 0x7f93780047d0 2023-11-20T07:01:47.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f9390bb1640 1 -- 172.21.15.88:0/3077563768 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c0a6920 con 0x7f93780047d0 2023-11-20T07:01:47.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f9393e17640 1 -- 172.21.15.88:0/3077563768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93780047d0 msgr2=0x7f9378004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f9393e17640 1 --2- 172.21.15.88:0/3077563768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93780047d0 0x7f9378004c50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f937c009ae0 tx=0x7f937c01ca20 comp rx=0 tx=0).stop 2023-11-20T07:01:47.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f9393e17640 1 -- 172.21.15.88:0/3077563768 shutdown_connections 2023-11-20T07:01:47.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f9393e17640 1 --2- 172.21.15.88:0/3077563768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93780047d0 0x7f9378004c50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f9393e17640 1 -- 172.21.15.88:0/3077563768 >> 172.21.15.88:0/3077563768 conn(0x7f938c09bc50 msgr2=0x7f938c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:47.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f9393e17640 1 -- 172.21.15.88:0/3077563768 shutdown_connections 2023-11-20T07:01:47.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f9393e17640 1 -- 172.21.15.88:0/3077563768 wait complete. 2023-11-20T07:01:47.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f9393e17640 1 Processor -- start 2023-11-20T07:01:47.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.465+0000 7f9393e17640 1 -- start start 2023-11-20T07:01:47.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f9393e17640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93780047d0 0x7f938c14ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f9393e17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f938c1597b0 0x7f938c157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f9393e17640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f938c156df0 0x7f938c15e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f9393e17640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c15d5f0 con 0x7f938c1597b0 2023-11-20T07:01:47.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f9393e17640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c14e2f0 con 0x7f938c156df0 2023-11-20T07:01:47.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f9393e17640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c158440 con 0x7f93780047d0 2023-11-20T07:01:47.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93913b2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f938c1597b0 0x7f938c157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93913b2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f938c1597b0 0x7f938c157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38042/0 (socket says 172.21.15.88:38042) 2023-11-20T07:01:47.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93913b2640 1 -- 172.21.15.88:0/2017232899 learned_addr learned my addr 172.21.15.88:0/2017232899 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:47.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f9391bb3640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93780047d0 0x7f938c14ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93923b4640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f938c156df0 0x7f938c15e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93913b2640 1 -- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93780047d0 msgr2=0x7f938c14ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93913b2640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93780047d0 0x7f938c14ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93913b2640 1 -- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f938c156df0 msgr2=0x7f938c15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93913b2640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f938c156df0 0x7f938c15e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93913b2640 1 -- 172.21.15.88:0/2017232899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c158710 con 0x7f938c1597b0 2023-11-20T07:01:47.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f9391bb3640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93780047d0 0x7f938c14ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:47.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93913b2640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f938c1597b0 0x7f938c157f00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f937c01c850 tx=0x7f937c0197c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:47.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93827fc640 1 -- 172.21.15.88:0/2017232899 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c0a6de0 con 0x7f938c1597b0 2023-11-20T07:01:47.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93827fc640 1 -- 172.21.15.88:0/2017232899 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c00f000 con 0x7f938c1597b0 2023-11-20T07:01:47.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f9393e17640 1 -- 172.21.15.88:0/2017232899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c1589f0 con 0x7f938c1597b0 2023-11-20T07:01:47.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93827fc640 1 -- 172.21.15.88:0/2017232899 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c0b9630 con 0x7f938c1597b0 2023-11-20T07:01:47.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f9393e17640 1 -- 172.21.15.88:0/2017232899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c158fb0 con 0x7f938c1597b0 2023-11-20T07:01:47.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f9393e17640 1 -- 172.21.15.88:0/2017232899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c074010 con 0x7f938c1597b0 2023-11-20T07:01:47.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.469+0000 7f93827fc640 1 -- 172.21.15.88:0/2017232899 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f937c0b03f0 con 0x7f938c1597b0 2023-11-20T07:01:47.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.473+0000 7f93827fc640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f93700664d0 0x7f9370068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.473+0000 7f93827fc640 1 -- 172.21.15.88:0/2017232899 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f937c11ded0 con 0x7f938c1597b0 2023-11-20T07:01:47.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.473+0000 7f9391bb3640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f93700664d0 0x7f9370068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.473+0000 7f9391bb3640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f93700664d0 0x7f9370068990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9388001e20 tx=0x7f9388009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:47.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.477+0000 7f93827fc640 1 -- 172.21.15.88:0/2017232899 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f937c0eaf90 con 0x7f938c1597b0 2023-11-20T07:01:47.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 -- 172.21.15.88:0/2017232899 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f938c0cf070 con 0x7f938c1597b0 2023-11-20T07:01:47.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f93827fc640 1 -- 172.21.15.88:0/2017232899 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f937c0be070 con 0x7f938c1597b0 2023-11-20T07:01:47.630 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:47.630 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:47.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 -- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f93700664d0 msgr2=0x7f9370068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f93700664d0 0x7f9370068990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9388001e20 tx=0x7f9388009040 comp rx=0 tx=0).stop 2023-11-20T07:01:47.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 -- 172.21.15.88:0/2017232899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f938c1597b0 msgr2=0x7f938c157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f938c1597b0 0x7f938c157f00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f937c01c850 tx=0x7f937c0197c0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 -- 172.21.15.88:0/2017232899 shutdown_connections 2023-11-20T07:01:47.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f93700664d0 0x7f9370068990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f938c156df0 0x7f938c15e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f938c1597b0 0x7f938c157f00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 --2- 172.21.15.88:0/2017232899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93780047d0 0x7f938c14ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 -- 172.21.15.88:0/2017232899 >> 172.21.15.88:0/2017232899 conn(0x7f938c09bc50 msgr2=0x7f938c0cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:47.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 -- 172.21.15.88:0/2017232899 shutdown_connections 2023-11-20T07:01:47.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.629+0000 7f9393e17640 1 -- 172.21.15.88:0/2017232899 wait complete. 2023-11-20T07:01:47.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:47.652 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:47.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.789+0000 7f22e91ab640 1 Processor -- start 2023-11-20T07:01:47.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.789+0000 7f22e91ab640 1 -- start start 2023-11-20T07:01:47.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.793+0000 7f22e91ab640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22e415cc60 0x7f22e40cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.793+0000 7f22e91ab640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e40cc330 con 0x7f22e40ceda0 2023-11-20T07:01:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.793+0000 7f22e91ab640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e40cb720 con 0x7f22e4161260 2023-11-20T07:01:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.793+0000 7f22e91ab640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e40cba00 con 0x7f22e415cc60 2023-11-20T07:01:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.793+0000 7f22e2d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22e415cc60 0x7f22e40cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.793+0000 7f22e2d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22e415cc60 0x7f22e40cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38056/0 (socket says 172.21.15.88:38056) 2023-11-20T07:01:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.793+0000 7f22e2d9d640 1 -- 172.21.15.88:0/2700197443 learned_addr learned my addr 172.21.15.88:0/2700197443 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:47.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.793+0000 7f22e2d9d640 1 -- 172.21.15.88:0/2700197443 >> v1:172.21.15.175:6789/0 conn(0x7f22e4161260 legacy=0x7f22e40ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.793+0000 7f22e2d9d640 1 -- 172.21.15.88:0/2700197443 >> v1:172.21.15.88:6789/0 conn(0x7f22e40ceda0 legacy=0x7f22e40cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.793+0000 7f22e2d9d640 1 -- 172.21.15.88:0/2700197443 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e40cbce0 con 0x7f22e415cc60 2023-11-20T07:01:47.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e2d9d640 1 --2- 172.21.15.88:0/2700197443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e415cc60 0x7f22e40cb040 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009870 tx=0x7f22d401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbee5881ea337d40 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:47.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e259c640 1 -- 172.21.15.88:0/2700197443 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a95f0 con 0x7f22e415cc60 2023-11-20T07:01:47.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e259c640 1 -- 172.21.15.88:0/2700197443 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40a9750 con 0x7f22e415cc60 2023-11-20T07:01:47.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e259c640 1 -- 172.21.15.88:0/2700197443 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a9ae0 con 0x7f22e415cc60 2023-11-20T07:01:47.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e91ab640 1 -- 172.21.15.88:0/2700197443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e415cc60 msgr2=0x7f22e40cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e91ab640 1 --2- 172.21.15.88:0/2700197443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e415cc60 0x7f22e40cb040 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009870 tx=0x7f22d401c510 comp rx=0 tx=0).stop 2023-11-20T07:01:47.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e91ab640 1 -- 172.21.15.88:0/2700197443 shutdown_connections 2023-11-20T07:01:47.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e91ab640 1 --2- 172.21.15.88:0/2700197443 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e415cc60 0x7f22e40cb040 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e91ab640 1 -- 172.21.15.88:0/2700197443 >> 172.21.15.88:0/2700197443 conn(0x7f22e406e570 msgr2=0x7f22e406e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:47.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e91ab640 1 -- 172.21.15.88:0/2700197443 shutdown_connections 2023-11-20T07:01:47.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e91ab640 1 -- 172.21.15.88:0/2700197443 wait complete. 2023-11-20T07:01:47.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e91ab640 1 Processor -- start 2023-11-20T07:01:47.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.797+0000 7f22e91ab640 1 -- start start 2023-11-20T07:01:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22e91ab640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22e40ceda0 0x7f22e40b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22e91ab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e415cc60 0x7f22e414b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22e91ab640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22e4161260 0x7f22e415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22e91ab640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40b3bd0 con 0x7f22e415cc60 2023-11-20T07:01:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22e91ab640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40b5120 con 0x7f22e4161260 2023-11-20T07:01:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22e91ab640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40b3e20 con 0x7f22e40ceda0 2023-11-20T07:01:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22da59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e415cc60 0x7f22e414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22da59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e415cc60 0x7f22e414b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38070/0 (socket says 172.21.15.88:38070) 2023-11-20T07:01:47.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22da59c640 1 -- 172.21.15.88:0/1902237965 learned_addr learned my addr 172.21.15.88:0/1902237965 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:47.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22e2d9d640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22e40ceda0 0x7f22e40b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22e359e640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22e4161260 0x7f22e415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22da59c640 1 -- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22e40ceda0 msgr2=0x7f22e40b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22da59c640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22e40ceda0 0x7f22e40b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22da59c640 1 -- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22e4161260 msgr2=0x7f22e415aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22da59c640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22e4161260 0x7f22e415aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22da59c640 1 -- 172.21.15.88:0/1902237965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d40094d0 con 0x7f22e415cc60 2023-11-20T07:01:47.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22e359e640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22e4161260 0x7f22e415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:47.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22da59c640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e415cc60 0x7f22e414b330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00c3c0 tx=0x7f22cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22dbfff640 1 -- 172.21.15.88:0/1902237965 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0052d0 con 0x7f22e415cc60 2023-11-20T07:01:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22dbfff640 1 -- 172.21.15.88:0/1902237965 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc005430 con 0x7f22e415cc60 2023-11-20T07:01:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22e91ab640 1 -- 172.21.15.88:0/1902237965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e40b4100 con 0x7f22e415cc60 2023-11-20T07:01:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22dbfff640 1 -- 172.21.15.88:0/1902237965 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc003840 con 0x7f22e415cc60 2023-11-20T07:01:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22e91ab640 1 -- 172.21.15.88:0/1902237965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e40b46c0 con 0x7f22e415cc60 2023-11-20T07:01:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22e91ab640 1 -- 172.21.15.88:0/1902237965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e40b3f60 con 0x7f22e415cc60 2023-11-20T07:01:47.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.801+0000 7f22dbfff640 1 -- 172.21.15.88:0/1902237965 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f22cc0039a0 con 0x7f22e415cc60 2023-11-20T07:01:47.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.805+0000 7f22dbfff640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f22c40664a0 0x7f22c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:47.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.805+0000 7f22dbfff640 1 -- 172.21.15.88:0/1902237965 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f22cc0838e0 con 0x7f22e415cc60 2023-11-20T07:01:47.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.805+0000 7f22e2d9d640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f22c40664a0 0x7f22c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:47.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.805+0000 7f22e2d9d640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f22c40664a0 0x7f22c4068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f22d40ae000 tx=0x7f22d40b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:47.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.809+0000 7f22dbfff640 1 -- 172.21.15.88:0/1902237965 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f22e40b3f60 con 0x7f22e415cc60 2023-11-20T07:01:47.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.957+0000 7f22e91ab640 1 -- 172.21.15.88:0/1902237965 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22e40b3f60 con 0x7f22e415cc60 2023-11-20T07:01:47.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.957+0000 7f22dbfff640 1 -- 172.21.15.88:0/1902237965 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22e40b3f60 con 0x7f22e415cc60 2023-11-20T07:01:47.959 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.957+0000 7f22e91ab640 1 -- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f22c40664a0 msgr2=0x7f22c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.957+0000 7f22e91ab640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f22c40664a0 0x7f22c4068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f22d40ae000 tx=0x7f22d40b3040 comp rx=0 tx=0).stop 2023-11-20T07:01:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.957+0000 7f22e91ab640 1 -- 172.21.15.88:0/1902237965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e415cc60 msgr2=0x7f22e414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.957+0000 7f22e91ab640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e415cc60 0x7f22e414b330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00c3c0 tx=0x7f22cc00c880 comp rx=0 tx=0).stop 2023-11-20T07:01:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.957+0000 7f22e91ab640 1 -- 172.21.15.88:0/1902237965 shutdown_connections 2023-11-20T07:01:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.957+0000 7f22e91ab640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f22c40664a0 0x7f22c4068960 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.957+0000 7f22e91ab640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22e4161260 0x7f22e415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.957+0000 7f22e91ab640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e415cc60 0x7f22e414b330 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.957+0000 7f22e91ab640 1 --2- 172.21.15.88:0/1902237965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22e40ceda0 0x7f22e40b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.957+0000 7f22e91ab640 1 -- 172.21.15.88:0/1902237965 >> 172.21.15.88:0/1902237965 conn(0x7f22e406e570 msgr2=0x7f22e415f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.961+0000 7f22e91ab640 1 -- 172.21.15.88:0/1902237965 shutdown_connections 2023-11-20T07:01:47.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:47.961+0000 7f22e91ab640 1 -- 172.21.15.88:0/1902237965 wait complete. 2023-11-20T07:01:47.980 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:48.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.117+0000 7f982c06b640 1 Processor -- start 2023-11-20T07:01:48.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.117+0000 7f982c06b640 1 -- start start 2023-11-20T07:01:48.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f982c06b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f98240cb040 0x7f98240ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f982c06b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240cc330 con 0x7f98240cebd0 2023-11-20T07:01:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f982c06b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240cb4d0 con 0x7f982415cc60 2023-11-20T07:01:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f982c06b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98240cefe0 con 0x7f98240cb040 2023-11-20T07:01:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f982a608640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f98240cebd0 0x7f98240cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36394/0 (socket says 172.21.15.88:36394) 2023-11-20T07:01:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f982a608640 1 -- 172.21.15.88:0/1884353202 learned_addr learned my addr 172.21.15.88:0/1884353202 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f9829606640 1 --2- 172.21.15.88:0/1884353202 >> v2:172.21.15.175:3300/0 conn(0x7f98240cb040 0x7f98240ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f9828e05640 1 -- 172.21.15.88:0/1884353202 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911650999 0 0) 0x7f98240cc330 con 0x7f98240cebd0 2023-11-20T07:01:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f9828e05640 1 -- 172.21.15.88:0/1884353202 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9810003530 con 0x7f98240cebd0 2023-11-20T07:01:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f9828e05640 1 -- 172.21.15.88:0/1884353202 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460981022 0 0) 0x7f98240cb4d0 con 0x7f982415cc60 2023-11-20T07:01:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f9828e05640 1 -- 172.21.15.88:0/1884353202 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98240cc330 con 0x7f982415cc60 2023-11-20T07:01:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f9829606640 1 -- 172.21.15.88:0/1884353202 >> v1:172.21.15.175:6789/0 conn(0x7f982415cc60 legacy=0x7f9824161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f9829606640 1 -- 172.21.15.88:0/1884353202 >> v1:172.21.15.88:6789/0 conn(0x7f98240cebd0 legacy=0x7f98240cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.121+0000 7f9829606640 1 -- 172.21.15.88:0/1884353202 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240cb720 con 0x7f98240cb040 2023-11-20T07:01:48.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f9829606640 1 --2- 172.21.15.88:0/1884353202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98240cb040 0x7f98240ce690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f98140097c0 tx=0x7f981401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca5ba045e183864b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:48.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f9828e05640 1 -- 172.21.15.88:0/1884353202 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98140ab650 con 0x7f98240cb040 2023-11-20T07:01:48.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f9828e05640 1 -- 172.21.15.88:0/1884353202 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98140ab7b0 con 0x7f98240cb040 2023-11-20T07:01:48.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f9828e05640 1 -- 172.21.15.88:0/1884353202 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98140abb40 con 0x7f98240cb040 2023-11-20T07:01:48.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f982c06b640 1 -- 172.21.15.88:0/1884353202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98240cb040 msgr2=0x7f98240ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f982c06b640 1 --2- 172.21.15.88:0/1884353202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98240cb040 0x7f98240ce690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f98140097c0 tx=0x7f981401c450 comp rx=0 tx=0).stop 2023-11-20T07:01:48.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f982c06b640 1 -- 172.21.15.88:0/1884353202 shutdown_connections 2023-11-20T07:01:48.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f982c06b640 1 --2- 172.21.15.88:0/1884353202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98240cb040 0x7f98240ce690 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f982c06b640 1 -- 172.21.15.88:0/1884353202 >> 172.21.15.88:0/1884353202 conn(0x7f982406e570 msgr2=0x7f982406e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:48.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f982c06b640 1 -- 172.21.15.88:0/1884353202 shutdown_connections 2023-11-20T07:01:48.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f982c06b640 1 -- 172.21.15.88:0/1884353202 wait complete. 2023-11-20T07:01:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f982c06b640 1 Processor -- start 2023-11-20T07:01:48.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.125+0000 7f982c06b640 1 -- start start 2023-11-20T07:01:48.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f982c06b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98240cb040 0x7f982415da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f982c06b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98240cebd0 0x7f98240c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f982c06b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f982415cc60 0x7f98240c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f982c06b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982415ac10 con 0x7f98240cb040 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f982c06b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98241383e0 con 0x7f982415cc60 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f982c06b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98240b41c0 con 0x7f98240cebd0 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f9829e07640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98240cb040 0x7f982415da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f9829e07640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98240cb040 0x7f982415da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38074/0 (socket says 172.21.15.88:38074) 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f9829e07640 1 -- 172.21.15.88:0/3898202273 learned_addr learned my addr 172.21.15.88:0/3898202273 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f9829606640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98240cebd0 0x7f98240c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f982a608640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f982415cc60 0x7f98240c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f9829e07640 1 -- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98240cebd0 msgr2=0x7f98240c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f9829e07640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98240cebd0 0x7f98240c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f9829e07640 1 -- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f982415cc60 msgr2=0x7f98240c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f9829e07640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f982415cc60 0x7f98240c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f9829e07640 1 -- 172.21.15.88:0/3898202273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9814009420 con 0x7f98240cb040 2023-11-20T07:01:48.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f982a608640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f982415cc60 0x7f98240c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:48.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f9829e07640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98240cb040 0x7f982415da20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f982000c460 tx=0x7f982000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:48.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f981a7fc640 1 -- 172.21.15.88:0/3898202273 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98200052d0 con 0x7f98240cb040 2023-11-20T07:01:48.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f981a7fc640 1 -- 172.21.15.88:0/3898202273 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9820005450 con 0x7f98240cb040 2023-11-20T07:01:48.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f981a7fc640 1 -- 172.21.15.88:0/3898202273 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820012870 con 0x7f98240cb040 2023-11-20T07:01:48.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f982c06b640 1 -- 172.21.15.88:0/3898202273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98240b44a0 con 0x7f98240cb040 2023-11-20T07:01:48.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f982c06b640 1 -- 172.21.15.88:0/3898202273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98240b4a60 con 0x7f98240cb040 2023-11-20T07:01:48.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f982c06b640 1 -- 172.21.15.88:0/3898202273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982404e170 con 0x7f98240cb040 2023-11-20T07:01:48.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.129+0000 7f981a7fc640 1 -- 172.21.15.88:0/3898202273 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f98200129d0 con 0x7f98240cb040 2023-11-20T07:01:48.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.133+0000 7f981a7fc640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98080664a0 0x7f9808068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.133+0000 7f981a7fc640 1 -- 172.21.15.88:0/3898202273 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9820083ce0 con 0x7f98240cb040 2023-11-20T07:01:48.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.133+0000 7f9829606640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98080664a0 0x7f9808068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.133+0000 7f9829606640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98080664a0 0x7f9808068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f98140af000 tx=0x7f98140a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:48.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.137+0000 7f981a7fc640 1 -- 172.21.15.88:0/3898202273 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9820050d90 con 0x7f98240cb040 2023-11-20T07:01:48.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 -- 172.21.15.88:0/3898202273 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98240cdd70 con 0x7f98240cb040 2023-11-20T07:01:48.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f981a7fc640 1 -- 172.21.15.88:0/3898202273 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f98200543b0 con 0x7f98240cb040 2023-11-20T07:01:48.286 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:48.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 -- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98080664a0 msgr2=0x7f9808068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98080664a0 0x7f9808068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f98140af000 tx=0x7f98140a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:48.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 -- 172.21.15.88:0/3898202273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98240cb040 msgr2=0x7f982415da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98240cb040 0x7f982415da20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f982000c460 tx=0x7f982000c920 comp rx=0 tx=0).stop 2023-11-20T07:01:48.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 -- 172.21.15.88:0/3898202273 shutdown_connections 2023-11-20T07:01:48.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98080664a0 0x7f9808068960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98240cebd0 0x7f98240c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f982415cc60 0x7f98240c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 --2- 172.21.15.88:0/3898202273 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98240cb040 0x7f982415da20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 -- 172.21.15.88:0/3898202273 >> 172.21.15.88:0/3898202273 conn(0x7f982406e570 msgr2=0x7f98240c6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:48.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 -- 172.21.15.88:0/3898202273 shutdown_connections 2023-11-20T07:01:48.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.285+0000 7f982c06b640 1 -- 172.21.15.88:0/3898202273 wait complete. 2023-11-20T07:01:48.308 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:48.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.445+0000 7f4100e09640 1 Processor -- start 2023-11-20T07:01:48.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.445+0000 7f4100e09640 1 -- start start 2023-11-20T07:01:48.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f4100e09640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40fc06a5a0 0x7f40fc06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f4100e09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40fc0b3f00 0x7f40fc0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f4100e09640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc0b4370 con 0x7f40fc159900 2023-11-20T07:01:48.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f4100e09640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40fc0cd740 con 0x7f40fc06a5a0 2023-11-20T07:01:48.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f4100e09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0b4600 con 0x7f40fc0b3f00 2023-11-20T07:01:48.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f40f1d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40fc06a5a0 0x7f40fc06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f40f1d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40fc06a5a0 0x7f40fc06e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38078/0 (socket says 172.21.15.88:38078) 2023-11-20T07:01:48.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f40f1d9b640 1 -- 172.21.15.88:0/164044634 learned_addr learned my addr 172.21.15.88:0/164044634 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:48.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f40fad9d640 1 --2- 172.21.15.88:0/164044634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40fc0b3f00 0x7f40fc0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f40f1d9b640 1 -- 172.21.15.88:0/164044634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40fc0b3f00 msgr2=0x7f40fc0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:48.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f40f1d9b640 1 --2- 172.21.15.88:0/164044634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40fc0b3f00 0x7f40fc0c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f40f1d9b640 1 -- 172.21.15.88:0/164044634 >> v1:172.21.15.175:6789/0 conn(0x7f40fc159900 legacy=0x7f40fc069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f40f1d9b640 1 -- 172.21.15.88:0/164044634 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc0c8dd0 con 0x7f40fc06a5a0 2023-11-20T07:01:48.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f40f1d9b640 1 --2- 172.21.15.88:0/164044634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40fc06a5a0 0x7f40fc06e260 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f40e400bb10 tx=0x7f40e401ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a0e526e9c6f53a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:48.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f40f9d9b640 1 -- 172.21.15.88:0/164044634 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40a7cb0 con 0x7f40fc06a5a0 2023-11-20T07:01:48.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f40f9d9b640 1 -- 172.21.15.88:0/164044634 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40a7e10 con 0x7f40fc06a5a0 2023-11-20T07:01:48.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.449+0000 7f40f9d9b640 1 -- 172.21.15.88:0/164044634 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40af660 con 0x7f40fc06a5a0 2023-11-20T07:01:48.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 -- 172.21.15.88:0/164044634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40fc06a5a0 msgr2=0x7f40fc06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 --2- 172.21.15.88:0/164044634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40fc06a5a0 0x7f40fc06e260 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f40e400bb10 tx=0x7f40e401ebe0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 -- 172.21.15.88:0/164044634 shutdown_connections 2023-11-20T07:01:48.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 --2- 172.21.15.88:0/164044634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40fc0b3f00 0x7f40fc0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 --2- 172.21.15.88:0/164044634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40fc06a5a0 0x7f40fc06e260 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 -- 172.21.15.88:0/164044634 >> 172.21.15.88:0/164044634 conn(0x7f40fc0b0da0 msgr2=0x7f40fc0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:48.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 -- 172.21.15.88:0/164044634 shutdown_connections 2023-11-20T07:01:48.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 -- 172.21.15.88:0/164044634 wait complete. 2023-11-20T07:01:48.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 Processor -- start 2023-11-20T07:01:48.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 -- start start 2023-11-20T07:01:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40fc06a5a0 0x7f40fc151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40fc0b3f00 0x7f40fc157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40fc159900 0x7f40fc157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc153880 con 0x7f40fc0b3f00 2023-11-20T07:01:48.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc152c70 con 0x7f40fc159900 2023-11-20T07:01:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f4100e09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc152f50 con 0x7f40fc06a5a0 2023-11-20T07:01:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f40f1d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40fc0b3f00 0x7f40fc157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f40f1d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40fc0b3f00 0x7f40fc157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38082/0 (socket says 172.21.15.88:38082) 2023-11-20T07:01:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.453+0000 7f40f1d9b640 1 -- 172.21.15.88:0/2183401726 learned_addr learned my addr 172.21.15.88:0/2183401726 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40fa59c640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40fc06a5a0 0x7f40fc151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40fad9d640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40fc159900 0x7f40fc157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40f1d9b640 1 -- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40fc06a5a0 msgr2=0x7f40fc151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40f1d9b640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40fc06a5a0 0x7f40fc151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40f1d9b640 1 -- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40fc159900 msgr2=0x7f40fc157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40f1d9b640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40fc159900 0x7f40fc157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40f1d9b640 1 -- 172.21.15.88:0/2183401726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e400b770 con 0x7f40fc0b3f00 2023-11-20T07:01:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40f1d9b640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40fc0b3f00 0x7f40fc157720 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f40e400b2c0 tx=0x7f40e401b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40f37fe640 1 -- 172.21.15.88:0/2183401726 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40ba660 con 0x7f40fc0b3f00 2023-11-20T07:01:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40f37fe640 1 -- 172.21.15.88:0/2183401726 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40ba7c0 con 0x7f40fc0b3f00 2023-11-20T07:01:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f4100e09640 1 -- 172.21.15.88:0/2183401726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc153230 con 0x7f40fc0b3f00 2023-11-20T07:01:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40f37fe640 1 -- 172.21.15.88:0/2183401726 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40bab70 con 0x7f40fc0b3f00 2023-11-20T07:01:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f4100e09640 1 -- 172.21.15.88:0/2183401726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc1524a0 con 0x7f40fc0b3f00 2023-11-20T07:01:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f4100e09640 1 -- 172.21.15.88:0/2183401726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40fc1539f0 con 0x7f40fc0b3f00 2023-11-20T07:01:48.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40f37fe640 1 -- 172.21.15.88:0/2183401726 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f40e40c33b0 con 0x7f40fc0b3f00 2023-11-20T07:01:48.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.457+0000 7f40f37fe640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f40dc0664a0 0x7f40dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.461+0000 7f40f37fe640 1 -- 172.21.15.88:0/2183401726 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f40e411f330 con 0x7f40fc0b3f00 2023-11-20T07:01:48.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.461+0000 7f40fa59c640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f40dc0664a0 0x7f40dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.461+0000 7f40fa59c640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f40dc0664a0 0x7f40dc068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f40ec000f70 tx=0x7f40ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:48.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.461+0000 7f40f37fe640 1 -- 172.21.15.88:0/2183401726 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f40e40ec480 con 0x7f40fc0b3f00 2023-11-20T07:01:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 -- 172.21.15.88:0/2183401726 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40fc04e170 con 0x7f40fc0b3f00 2023-11-20T07:01:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f40f37fe640 1 -- 172.21.15.88:0/2183401726 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40e40efaa0 con 0x7f40fc0b3f00 2023-11-20T07:01:48.615 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 -- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f40dc0664a0 msgr2=0x7f40dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f40dc0664a0 0x7f40dc068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f40ec000f70 tx=0x7f40ec009040 comp rx=0 tx=0).stop 2023-11-20T07:01:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 -- 172.21.15.88:0/2183401726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40fc0b3f00 msgr2=0x7f40fc157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40fc0b3f00 0x7f40fc157720 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f40e400b2c0 tx=0x7f40e401b980 comp rx=0 tx=0).stop 2023-11-20T07:01:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 -- 172.21.15.88:0/2183401726 shutdown_connections 2023-11-20T07:01:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f40dc0664a0 0x7f40dc068960 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40fc159900 0x7f40fc157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40fc0b3f00 0x7f40fc157720 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 --2- 172.21.15.88:0/2183401726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40fc06a5a0 0x7f40fc151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 -- 172.21.15.88:0/2183401726 >> 172.21.15.88:0/2183401726 conn(0x7f40fc0b0da0 msgr2=0x7f40fc158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 -- 172.21.15.88:0/2183401726 shutdown_connections 2023-11-20T07:01:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.613+0000 7f4100e09640 1 -- 172.21.15.88:0/2183401726 wait complete. 2023-11-20T07:01:48.635 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.773+0000 7faa5f50f640 1 Processor -- start 2023-11-20T07:01:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.773+0000 7faa5f50f640 1 -- start start 2023-11-20T07:01:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5f50f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa5815cc60 0x7faa580cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5f50f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faa58161260 0x7faa580ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5f50f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa580cc330 con 0x7faa580cebd0 2023-11-20T07:01:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5f50f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa580cefe0 con 0x7faa58161260 2023-11-20T07:01:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5f50f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa580cb720 con 0x7faa5815cc60 2023-11-20T07:01:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5caaa640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faa58161260 0x7faa580ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5d2ab640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa5815cc60 0x7faa580cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5caaa640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faa58161260 0x7faa580ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:44024/0 (socket says 172.21.15.88:44024) 2023-11-20T07:01:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5caaa640 1 -- 172.21.15.88:0/3175823235 learned_addr learned my addr 172.21.15.88:0/3175823235 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5caaa640 1 -- 172.21.15.88:0/3175823235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa5815cc60 msgr2=0x7faa580cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5caaa640 1 --2- 172.21.15.88:0/3175823235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa5815cc60 0x7faa580cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5caaa640 1 -- 172.21.15.88:0/3175823235 >> v1:172.21.15.175:6789/0 conn(0x7faa580cebd0 legacy=0x7faa580b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5caaa640 1 -- 172.21.15.88:0/3175823235 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa580cba00 con 0x7faa58161260 2023-11-20T07:01:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa4ffff640 1 -- 172.21.15.88:0/3175823235 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297507182 0 0) 0x7faa580cc330 con 0x7faa580cebd0 2023-11-20T07:01:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.777+0000 7faa5d2ab640 1 --2- 172.21.15.88:0/3175823235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa5815cc60 0x7faa580cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.781+0000 7faa5caaa640 1 --2- 172.21.15.88:0/3175823235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa58161260 0x7faa580ce690 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa48009870 tx=0x7faa4801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f389828e439274a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:48.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.781+0000 7faa4ffff640 1 -- 172.21.15.88:0/3175823235 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480aa670 con 0x7faa58161260 2023-11-20T07:01:48.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.781+0000 7faa4ffff640 1 -- 172.21.15.88:0/3175823235 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa480aa7d0 con 0x7faa58161260 2023-11-20T07:01:48.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.781+0000 7faa4ffff640 1 -- 172.21.15.88:0/3175823235 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480aab60 con 0x7faa58161260 2023-11-20T07:01:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.781+0000 7faa5f50f640 1 -- 172.21.15.88:0/3175823235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa58161260 msgr2=0x7faa580ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.781+0000 7faa5f50f640 1 --2- 172.21.15.88:0/3175823235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa58161260 0x7faa580ce690 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa48009870 tx=0x7faa4801c510 comp rx=0 tx=0).stop 2023-11-20T07:01:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.781+0000 7faa5f50f640 1 -- 172.21.15.88:0/3175823235 shutdown_connections 2023-11-20T07:01:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.781+0000 7faa5f50f640 1 --2- 172.21.15.88:0/3175823235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa58161260 0x7faa580ce690 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.781+0000 7faa5f50f640 1 --2- 172.21.15.88:0/3175823235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa5815cc60 0x7faa580cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.781+0000 7faa5f50f640 1 -- 172.21.15.88:0/3175823235 >> 172.21.15.88:0/3175823235 conn(0x7faa5806e570 msgr2=0x7faa5806e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.781+0000 7faa5f50f640 1 -- 172.21.15.88:0/3175823235 shutdown_connections 2023-11-20T07:01:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.781+0000 7faa5f50f640 1 -- 172.21.15.88:0/3175823235 wait complete. 2023-11-20T07:01:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5f50f640 1 Processor -- start 2023-11-20T07:01:48.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5f50f640 1 -- start start 2023-11-20T07:01:48.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5f50f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa580cebd0 0x7faa5814fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5f50f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa5815cc60 0x7faa58159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5f50f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa58161260 0x7faa58156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5f50f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa580b3c90 con 0x7faa580cebd0 2023-11-20T07:01:48.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5f50f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5815a290 con 0x7faa5815cc60 2023-11-20T07:01:48.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5f50f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5815a570 con 0x7faa58161260 2023-11-20T07:01:48.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5d2ab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa580cebd0 0x7faa5814fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5d2ab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa580cebd0 0x7faa5814fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38090/0 (socket says 172.21.15.88:38090) 2023-11-20T07:01:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5d2ab640 1 -- 172.21.15.88:0/917856994 learned_addr learned my addr 172.21.15.88:0/917856994 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5caaa640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa5815cc60 0x7faa58159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5daac640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa58161260 0x7faa58156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5d2ab640 1 -- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa58161260 msgr2=0x7faa58156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5d2ab640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa58161260 0x7faa58156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5d2ab640 1 -- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa5815cc60 msgr2=0x7faa58159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5d2ab640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa5815cc60 0x7faa58159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5d2ab640 1 -- 172.21.15.88:0/917856994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54009420 con 0x7faa580cebd0 2023-11-20T07:01:48.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5d2ab640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa580cebd0 0x7faa5814fda0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faa5400ebe0 tx=0x7faa5400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa4dffb640 1 -- 172.21.15.88:0/917856994 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5400eee0 con 0x7faa580cebd0 2023-11-20T07:01:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa4dffb640 1 -- 172.21.15.88:0/917856994 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5400cc30 con 0x7faa580cebd0 2023-11-20T07:01:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5f50f640 1 -- 172.21.15.88:0/917856994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa480094d0 con 0x7faa580cebd0 2023-11-20T07:01:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa4dffb640 1 -- 172.21.15.88:0/917856994 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa54013470 con 0x7faa580cebd0 2023-11-20T07:01:48.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.785+0000 7faa5f50f640 1 -- 172.21.15.88:0/917856994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5815ab30 con 0x7faa580cebd0 2023-11-20T07:01:48.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.789+0000 7faa5f50f640 1 -- 172.21.15.88:0/917856994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5804e170 con 0x7faa580cebd0 2023-11-20T07:01:48.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.789+0000 7faa4dffb640 1 -- 172.21.15.88:0/917856994 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faa540135d0 con 0x7faa580cebd0 2023-11-20T07:01:48.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.789+0000 7faa4dffb640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faa3c0664a0 0x7faa3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:48.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.789+0000 7faa4dffb640 1 -- 172.21.15.88:0/917856994 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faa54084500 con 0x7faa580cebd0 2023-11-20T07:01:48.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.789+0000 7faa5caaa640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faa3c0664a0 0x7faa3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:48.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.789+0000 7faa5caaa640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faa3c0664a0 0x7faa3c068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faa480ae000 tx=0x7faa480b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:48.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.793+0000 7faa4dffb640 1 -- 172.21.15.88:0/917856994 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faa54051660 con 0x7faa580cebd0 2023-11-20T07:01:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.941+0000 7faa5f50f640 1 -- 172.21.15.88:0/917856994 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faa580b6830 con 0x7faa580cebd0 2023-11-20T07:01:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.941+0000 7faa4dffb640 1 -- 172.21.15.88:0/917856994 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7faa54054c80 con 0x7faa580cebd0 2023-11-20T07:01:48.943 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.945+0000 7faa5f50f640 1 -- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faa3c0664a0 msgr2=0x7faa3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.945+0000 7faa5f50f640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faa3c0664a0 0x7faa3c068960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faa480ae000 tx=0x7faa480b5040 comp rx=0 tx=0).stop 2023-11-20T07:01:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.945+0000 7faa5f50f640 1 -- 172.21.15.88:0/917856994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa580cebd0 msgr2=0x7faa5814fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.945+0000 7faa5f50f640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa580cebd0 0x7faa5814fda0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faa5400ebe0 tx=0x7faa5400c520 comp rx=0 tx=0).stop 2023-11-20T07:01:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.945+0000 7faa5f50f640 1 -- 172.21.15.88:0/917856994 shutdown_connections 2023-11-20T07:01:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.945+0000 7faa5f50f640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faa3c0664a0 0x7faa3c068960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.945+0000 7faa5f50f640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa58161260 0x7faa58156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.945+0000 7faa5f50f640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa5815cc60 0x7faa58159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.945+0000 7faa5f50f640 1 --2- 172.21.15.88:0/917856994 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa580cebd0 0x7faa5814fda0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.945+0000 7faa5f50f640 1 -- 172.21.15.88:0/917856994 >> 172.21.15.88:0/917856994 conn(0x7faa5806e570 msgr2=0x7faa580b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.945+0000 7faa5f50f640 1 -- 172.21.15.88:0/917856994 shutdown_connections 2023-11-20T07:01:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:48.945+0000 7faa5f50f640 1 -- 172.21.15.88:0/917856994 wait complete. 2023-11-20T07:01:48.965 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T07:01:49.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.101+0000 7fb836c9c640 1 Processor -- start 2023-11-20T07:01:49.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.101+0000 7fb836c9c640 1 -- start start 2023-11-20T07:01:49.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.101+0000 7fb836c9c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb83015cb30 0x7fb8301608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.101+0000 7fb836c9c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb830065a80 0x7fb830160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.101+0000 7fb836c9c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8300ccbd0 con 0x7fb83015cf10 2023-11-20T07:01:49.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.101+0000 7fb836c9c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83006b180 con 0x7fb830065a80 2023-11-20T07:01:49.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.101+0000 7fb836c9c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83006b460 con 0x7fb83015cb30 2023-11-20T07:01:49.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.101+0000 7fb835239640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb83015cf10 0x7fb830069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36402/0 (socket says 172.21.15.88:36402) 2023-11-20T07:01:49.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.101+0000 7fb835239640 1 -- 172.21.15.88:0/3823733680 learned_addr learned my addr 172.21.15.88:0/3823733680 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:49.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.101+0000 7fb834a38640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb83015cb30 0x7fb8301608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb827fff640 1 --2- 172.21.15.88:0/3823733680 >> v2:172.21.15.175:3300/0 conn(0x7fb830065a80 0x7fb830160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551760255 0 0) 0x7fb8300ccbd0 con 0x7fb83015cf10 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb818003530 con 0x7fb83015cf10 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3069364080 0 0) 0x7fb818003530 con 0x7fb83015cf10 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb83015cb30 msgr2=0x7fb8301608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb83015cb30 0x7fb8301608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 >> v2:172.21.15.175:3300/0 conn(0x7fb830065a80 msgr2=0x7fb830160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 --2- 172.21.15.88:0/3823733680 >> v2:172.21.15.175:3300/0 conn(0x7fb830065a80 0x7fb830160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83006c6e0 con 0x7fb83015cf10 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fb828001a00 con 0x7fb83015cf10 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 >> v1:172.21.15.88:6789/0 conn(0x7fb83015cf10 legacy=0x7fb830069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb818003980 0x7fb818003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8180047d0 0x7fb818004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb83015cb30 0x7fb818005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83006b180 con 0x7fb8180047d0 2023-11-20T07:01:49.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83006b460 con 0x7fb818003980 2023-11-20T07:01:49.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81800b990 con 0x7fb83015cb30 2023-11-20T07:01:49.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb827fff640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8180047d0 0x7fb818004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb834a38640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb818003980 0x7fb818003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb835239640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb83015cb30 0x7fb818005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb827fff640 1 -- 172.21.15.88:0/3823733680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb83015cb30 msgr2=0x7fb818005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:49.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb827fff640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb83015cb30 0x7fb818005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb827fff640 1 -- 172.21.15.88:0/3823733680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb818003980 msgr2=0x7fb818003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:49.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb827fff640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb818003980 0x7fb818003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb827fff640 1 -- 172.21.15.88:0/3823733680 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb818003530 con 0x7fb8180047d0 2023-11-20T07:01:49.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.105+0000 7fb835239640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb83015cb30 0x7fb818005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:49.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb827fff640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8180047d0 0x7fb818004c50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb820009ae0 tx=0x7fb82001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b215257a4dade4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8200a55a0 con 0x7fb8180047d0 2023-11-20T07:01:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8200a5700 con 0x7fb8180047d0 2023-11-20T07:01:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb8277fe640 1 -- 172.21.15.88:0/3823733680 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8200a5ab0 con 0x7fb8180047d0 2023-11-20T07:01:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 -- 172.21.15.88:0/3823733680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8180047d0 msgr2=0x7fb818004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 --2- 172.21.15.88:0/3823733680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8180047d0 0x7fb818004c50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb820009ae0 tx=0x7fb82001ca90 comp rx=0 tx=0).stop 2023-11-20T07:01:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb835239640 1 -- 172.21.15.88:0/3823733680 reap_dead start 2023-11-20T07:01:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 -- 172.21.15.88:0/3823733680 shutdown_connections 2023-11-20T07:01:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 -- 172.21.15.88:0/3823733680 >> 172.21.15.88:0/3823733680 conn(0x7fb8300b0880 msgr2=0x7fb8300b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 -- 172.21.15.88:0/3823733680 shutdown_connections 2023-11-20T07:01:49.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 -- 172.21.15.88:0/3823733680 wait complete. 2023-11-20T07:01:49.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 Processor -- start 2023-11-20T07:01:49.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 -- start start 2023-11-20T07:01:49.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8180047d0 0x7fb8300c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb830159d50 0x7fb8300b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300b1da0 0x7fb8300b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301f3360 con 0x7fb8300b1da0 2023-11-20T07:01:49.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8300b2220 con 0x7fb830159d50 2023-11-20T07:01:49.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.109+0000 7fb836c9c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301f2750 con 0x7fb8180047d0 2023-11-20T07:01:49.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb835239640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300b1da0 0x7fb8300b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb835239640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300b1da0 0x7fb8300b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38108/0 (socket says 172.21.15.88:38108) 2023-11-20T07:01:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb835239640 1 -- 172.21.15.88:0/929920292 learned_addr learned my addr 172.21.15.88:0/929920292 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb834a38640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8180047d0 0x7fb8300c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb827fff640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb830159d50 0x7fb8300b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb835239640 1 -- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8180047d0 msgr2=0x7fb8300c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb835239640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8180047d0 0x7fb8300c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb835239640 1 -- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb830159d50 msgr2=0x7fb8300b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb835239640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb830159d50 0x7fb8300b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb835239640 1 -- 172.21.15.88:0/929920292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8301f2a30 con 0x7fb8300b1da0 2023-11-20T07:01:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb834a38640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8180047d0 0x7fb8300c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb827fff640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb830159d50 0x7fb8300b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:49.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb835239640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300b1da0 0x7fb8300b2d10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb8300ced20 tx=0x7fb828011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb8257fa640 1 -- 172.21.15.88:0/929920292 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800f8a0 con 0x7fb8300b1da0 2023-11-20T07:01:49.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb8257fa640 1 -- 172.21.15.88:0/929920292 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82800fa00 con 0x7fb8300b1da0 2023-11-20T07:01:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb836c9c640 1 -- 172.21.15.88:0/929920292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8301f2d10 con 0x7fb8300b1da0 2023-11-20T07:01:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb8257fa640 1 -- 172.21.15.88:0/929920292 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800fdb0 con 0x7fb8300b1da0 2023-11-20T07:01:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb836c9c640 1 -- 172.21.15.88:0/929920292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83015a1d0 con 0x7fb8300b1da0 2023-11-20T07:01:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb836c9c640 1 -- 172.21.15.88:0/929920292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb830066540 con 0x7fb8300b1da0 2023-11-20T07:01:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb8257fa640 1 -- 172.21.15.88:0/929920292 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb82801f460 con 0x7fb8300b1da0 2023-11-20T07:01:49.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.113+0000 7fb8257fa640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb81c0664d0 0x7fb81c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.117+0000 7fb8257fa640 1 -- 172.21.15.88:0/929920292 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb828087250 con 0x7fb8300b1da0 2023-11-20T07:01:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.117+0000 7fb834a38640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb81c0664d0 0x7fb81c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.117+0000 7fb834a38640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb81c0664d0 0x7fb81c068990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb83009f2f0 tx=0x7fb82c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:49.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.117+0000 7fb8257fa640 1 -- 172.21.15.88:0/929920292 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb828054270 con 0x7fb8300b1da0 2023-11-20T07:01:49.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.277+0000 7fb836c9c640 1 -- 172.21.15.88:0/929920292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb8300c2470 con 0x7fb8300b1da0 2023-11-20T07:01:49.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.277+0000 7fb8257fa640 1 -- 172.21.15.88:0/929920292 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb828057890 con 0x7fb8300b1da0 2023-11-20T07:01:49.280 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-20T07:01:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.281+0000 7fb836c9c640 1 -- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb81c0664d0 msgr2=0x7fb81c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.281+0000 7fb836c9c640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb81c0664d0 0x7fb81c068990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb83009f2f0 tx=0x7fb82c008040 comp rx=0 tx=0).stop 2023-11-20T07:01:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.281+0000 7fb836c9c640 1 -- 172.21.15.88:0/929920292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300b1da0 msgr2=0x7fb8300b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.281+0000 7fb836c9c640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300b1da0 0x7fb8300b2d10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb8300ced20 tx=0x7fb828011c20 comp rx=0 tx=0).stop 2023-11-20T07:01:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.281+0000 7fb836c9c640 1 -- 172.21.15.88:0/929920292 shutdown_connections 2023-11-20T07:01:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.281+0000 7fb836c9c640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb81c0664d0 0x7fb81c068990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.281+0000 7fb836c9c640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300b1da0 0x7fb8300b2d10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.281+0000 7fb836c9c640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb830159d50 0x7fb8300b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.281+0000 7fb836c9c640 1 --2- 172.21.15.88:0/929920292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8180047d0 0x7fb8300c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.281+0000 7fb836c9c640 1 -- 172.21.15.88:0/929920292 >> 172.21.15.88:0/929920292 conn(0x7fb8300b0880 msgr2=0x7fb83015bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.281+0000 7fb836c9c640 1 -- 172.21.15.88:0/929920292 shutdown_connections 2023-11-20T07:01:49.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.281+0000 7fb836c9c640 1 -- 172.21.15.88:0/929920292 wait complete. 2023-11-20T07:01:49.302 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:01:49.302 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:49.311 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:49.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.485+0000 7f455706b640 1 Processor -- start 2023-11-20T07:01:49.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.485+0000 7f455706b640 1 -- start start 2023-11-20T07:01:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f455706b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45501591e0 0x7f45500c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f455706b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45500b00e0 0x7f45500b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f455706b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45500b0a50 con 0x7f45500ca430 2023-11-20T07:01:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f455706b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4550071020 con 0x7f45501591e0 2023-11-20T07:01:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f455706b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45500c8e50 con 0x7f45500b00e0 2023-11-20T07:01:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f4554e07640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45501591e0 0x7f45500c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f4554e07640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f45501591e0 0x7f45500c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38124/0 (socket says 172.21.15.88:38124) 2023-11-20T07:01:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f4554e07640 1 -- 172.21.15.88:0/3444563879 learned_addr learned my addr 172.21.15.88:0/3444563879 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f4555608640 1 --2- 172.21.15.88:0/3444563879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45500b00e0 0x7f45500b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f4554e07640 1 -- 172.21.15.88:0/3444563879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45500b00e0 msgr2=0x7f45500b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f4554e07640 1 --2- 172.21.15.88:0/3444563879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45500b00e0 0x7f45500b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f4554e07640 1 -- 172.21.15.88:0/3444563879 >> v1:172.21.15.175:6789/0 conn(0x7f45500ca430 legacy=0x7f4550071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.489+0000 7f4554e07640 1 -- 172.21.15.88:0/3444563879 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45500c9130 con 0x7f45501591e0 2023-11-20T07:01:49.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f4554e07640 1 --2- 172.21.15.88:0/3444563879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45501591e0 0x7f45500c9ef0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4544009870 tx=0x7f454401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4596e97e574861f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:49.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f454f7fe640 1 -- 172.21.15.88:0/3444563879 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45440ab600 con 0x7f45501591e0 2023-11-20T07:01:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f454f7fe640 1 -- 172.21.15.88:0/3444563879 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45440a7050 con 0x7f45501591e0 2023-11-20T07:01:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f454f7fe640 1 -- 172.21.15.88:0/3444563879 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45440ab980 con 0x7f45501591e0 2023-11-20T07:01:49.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f455706b640 1 -- 172.21.15.88:0/3444563879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45501591e0 msgr2=0x7f45500c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f455706b640 1 --2- 172.21.15.88:0/3444563879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45501591e0 0x7f45500c9ef0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4544009870 tx=0x7f454401c500 comp rx=0 tx=0).stop 2023-11-20T07:01:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f455706b640 1 -- 172.21.15.88:0/3444563879 shutdown_connections 2023-11-20T07:01:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f455706b640 1 --2- 172.21.15.88:0/3444563879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45500b00e0 0x7f45500b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f455706b640 1 --2- 172.21.15.88:0/3444563879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45501591e0 0x7f45500c9ef0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f455706b640 1 -- 172.21.15.88:0/3444563879 >> 172.21.15.88:0/3444563879 conn(0x7f455006c190 msgr2=0x7f455006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f455706b640 1 -- 172.21.15.88:0/3444563879 shutdown_connections 2023-11-20T07:01:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f455706b640 1 -- 172.21.15.88:0/3444563879 wait complete. 2023-11-20T07:01:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f455706b640 1 Processor -- start 2023-11-20T07:01:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.493+0000 7f455706b640 1 -- start start 2023-11-20T07:01:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f455706b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45500b00e0 0x7f45500c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f455706b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45500ca430 0x7f455015d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f455706b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45501591e0 0x7f4550157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f455706b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500c7940 con 0x7f45500ca430 2023-11-20T07:01:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f455706b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45501f6440 con 0x7f45500b00e0 2023-11-20T07:01:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f455706b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45500c6cc0 con 0x7f45501591e0 2023-11-20T07:01:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f454ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45500ca430 0x7f455015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f454ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45500ca430 0x7f455015d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38130/0 (socket says 172.21.15.88:38130) 2023-11-20T07:01:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f454ffff640 1 -- 172.21.15.88:0/4108280043 learned_addr learned my addr 172.21.15.88:0/4108280043 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f4555608640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45501591e0 0x7f4550157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f4554e07640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45500b00e0 0x7f45500c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f454ffff640 1 -- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45501591e0 msgr2=0x7f4550157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f454ffff640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45501591e0 0x7f4550157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f454ffff640 1 -- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45500b00e0 msgr2=0x7f45500c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f454ffff640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45500b00e0 0x7f45500c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f454ffff640 1 -- 172.21.15.88:0/4108280043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45440094d0 con 0x7f45500ca430 2023-11-20T07:01:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f454ffff640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45500ca430 0x7f455015d250 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f453c00c410 tx=0x7f453c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:49.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f454d7fa640 1 -- 172.21.15.88:0/4108280043 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c011790 con 0x7f45500ca430 2023-11-20T07:01:49.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f454d7fa640 1 -- 172.21.15.88:0/4108280043 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c0118f0 con 0x7f45500ca430 2023-11-20T07:01:49.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f455706b640 1 -- 172.21.15.88:0/4108280043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45500c6fa0 con 0x7f45500ca430 2023-11-20T07:01:49.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f454d7fa640 1 -- 172.21.15.88:0/4108280043 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c011ce0 con 0x7f45500ca430 2023-11-20T07:01:49.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f455706b640 1 -- 172.21.15.88:0/4108280043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45500c7560 con 0x7f45500ca430 2023-11-20T07:01:49.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.497+0000 7f455706b640 1 -- 172.21.15.88:0/4108280043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45500c7a80 con 0x7f45500ca430 2023-11-20T07:01:49.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.501+0000 7f454d7fa640 1 -- 172.21.15.88:0/4108280043 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f453c01c460 con 0x7f45500ca430 2023-11-20T07:01:49.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.501+0000 7f454d7fa640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f45340664a0 0x7f4534068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.501+0000 7f454d7fa640 1 -- 172.21.15.88:0/4108280043 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f453c083ea0 con 0x7f45500ca430 2023-11-20T07:01:49.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.501+0000 7f4554e07640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f45340664a0 0x7f4534068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.501+0000 7f4554e07640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f45340664a0 0x7f4534068960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f45440ad000 tx=0x7f4544008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:49.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.505+0000 7f454d7fa640 1 -- 172.21.15.88:0/4108280043 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f45500c7a80 con 0x7f45500ca430 2023-11-20T07:01:49.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.657+0000 7f455706b640 1 -- 172.21.15.88:0/4108280043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45500c7a80 con 0x7f45500ca430 2023-11-20T07:01:49.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.657+0000 7f454d7fa640 1 -- 172.21.15.88:0/4108280043 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f45500c7a80 con 0x7f45500ca430 2023-11-20T07:01:49.660 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:49.661 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:49.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.661+0000 7f455706b640 1 -- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f45340664a0 msgr2=0x7f4534068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.661+0000 7f455706b640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f45340664a0 0x7f4534068960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f45440ad000 tx=0x7f4544008040 comp rx=0 tx=0).stop 2023-11-20T07:01:49.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.661+0000 7f455706b640 1 -- 172.21.15.88:0/4108280043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45500ca430 msgr2=0x7f455015d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.661+0000 7f455706b640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45500ca430 0x7f455015d250 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f453c00c410 tx=0x7f453c00c8d0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.661+0000 7f455706b640 1 -- 172.21.15.88:0/4108280043 shutdown_connections 2023-11-20T07:01:49.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.661+0000 7f455706b640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f45340664a0 0x7f4534068960 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.661+0000 7f455706b640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45501591e0 0x7f4550157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.661+0000 7f455706b640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45500ca430 0x7f455015d250 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.661+0000 7f455706b640 1 --2- 172.21.15.88:0/4108280043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45500b00e0 0x7f45500c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.661+0000 7f455706b640 1 -- 172.21.15.88:0/4108280043 >> 172.21.15.88:0/4108280043 conn(0x7f455006c190 msgr2=0x7f455014ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:49.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.661+0000 7f455706b640 1 -- 172.21.15.88:0/4108280043 shutdown_connections 2023-11-20T07:01:49.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.661+0000 7f455706b640 1 -- 172.21.15.88:0/4108280043 wait complete. 2023-11-20T07:01:49.683 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:49.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:49.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c16e32640 1 Processor -- start 2023-11-20T07:01:49.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c16e32640 1 -- start start 2023-11-20T07:01:49.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c16e32640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c100ceda0 0x7f5c10167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c16e32640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c100cc330 con 0x7f5c1015cc60 2023-11-20T07:01:49.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c16e32640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c100cb4d0 con 0x7f5c100cb040 2023-11-20T07:01:49.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c16e32640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c100cb720 con 0x7f5c100ceda0 2023-11-20T07:01:49.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c14bce640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5c1015cc60 0x7f5c10161260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36410/0 (socket says 172.21.15.88:36410) 2023-11-20T07:01:49.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c14bce640 1 -- 172.21.15.88:0/1635388858 learned_addr learned my addr 172.21.15.88:0/1635388858 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:49.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986256020 0 0) 0x7f5c100cc330 con 0x7f5c1015cc60 2023-11-20T07:01:49.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c00003530 con 0x7f5c1015cc60 2023-11-20T07:01:49.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c153cf640 1 --2- 172.21.15.88:0/1635388858 >> v2:172.21.15.175:3300/0 conn(0x7f5c100ceda0 0x7f5c10167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1606093174 0 0) 0x7f5c00003530 con 0x7f5c1015cc60 2023-11-20T07:01:49.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 >> v2:172.21.15.175:3300/0 conn(0x7f5c100ceda0 msgr2=0x7f5c10167be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:49.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 --2- 172.21.15.88:0/1635388858 >> v2:172.21.15.175:3300/0 conn(0x7f5c100ceda0 0x7f5c10167be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 >> v1:172.21.15.175:6789/0 conn(0x7f5c100cb040 legacy=0x7f5c100ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:49.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100cba00 con 0x7f5c1015cc60 2023-11-20T07:01:49.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f5c04001680 con 0x7f5c1015cc60 2023-11-20T07:01:49.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 >> v1:172.21.15.88:6789/0 conn(0x7f5c1015cc60 legacy=0x7f5c10161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 --2- 172.21.15.88:0/1635388858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c00003980 0x7f5c00003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 --2- 172.21.15.88:0/1635388858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c000047d0 0x7f5c00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 --2- 172.21.15.88:0/1635388858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c00005190 0x7f5c0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100cb720 con 0x7f5c00005190 2023-11-20T07:01:49.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0000c0e0 con 0x7f5c000047d0 2023-11-20T07:01:49.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0000c2a0 con 0x7f5c00003980 2023-11-20T07:01:49.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c153cf640 1 --2- 172.21.15.88:0/1635388858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c00005190 0x7f5c0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c14bce640 1 --2- 172.21.15.88:0/1635388858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c00003980 0x7f5c00003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c0ffff640 1 --2- 172.21.15.88:0/1635388858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c000047d0 0x7f5c00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c153cf640 1 -- 172.21.15.88:0/1635388858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c00003980 msgr2=0x7f5c00003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:49.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c153cf640 1 --2- 172.21.15.88:0/1635388858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c00003980 0x7f5c00003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c153cf640 1 -- 172.21.15.88:0/1635388858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c000047d0 msgr2=0x7f5c00004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:49.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c153cf640 1 --2- 172.21.15.88:0/1635388858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c000047d0 0x7f5c00004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c153cf640 1 -- 172.21.15.88:0/1635388858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c00003530 con 0x7f5c00005190 2023-11-20T07:01:49.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.825+0000 7f5c14bce640 1 --2- 172.21.15.88:0/1635388858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c00003980 0x7f5c00003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:49.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.829+0000 7f5c153cf640 1 -- 172.21.15.88:0/1635388858 reap_dead start 2023-11-20T07:01:49.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.829+0000 7f5c153cf640 1 --2- 172.21.15.88:0/1635388858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c00005190 0x7f5c0000b990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5c08007360 tx=0x7f5c0801ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8735cfd59f1642b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:49.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.829+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080a5d60 con 0x7f5c00005190 2023-11-20T07:01:49.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.829+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c080039a0 con 0x7f5c00005190 2023-11-20T07:01:49.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.829+0000 7f5c0f7fe640 1 -- 172.21.15.88:0/1635388858 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08003d50 con 0x7f5c00005190 2023-11-20T07:01:49.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.829+0000 7f5c16e32640 1 -- 172.21.15.88:0/1635388858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c00005190 msgr2=0x7f5c0000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.829+0000 7f5c16e32640 1 --2- 172.21.15.88:0/1635388858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c00005190 0x7f5c0000b990 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5c08007360 tx=0x7f5c0801ce60 comp rx=0 tx=0).stop 2023-11-20T07:01:49.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.829+0000 7f5c16e32640 1 -- 172.21.15.88:0/1635388858 shutdown_connections 2023-11-20T07:01:49.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.829+0000 7f5c16e32640 1 --2- 172.21.15.88:0/1635388858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c00005190 0x7f5c0000b990 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.829+0000 7f5c16e32640 1 -- 172.21.15.88:0/1635388858 >> 172.21.15.88:0/1635388858 conn(0x7f5c1006e570 msgr2=0x7f5c1006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.829+0000 7f5c16e32640 1 -- 172.21.15.88:0/1635388858 shutdown_connections 2023-11-20T07:01:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.829+0000 7f5c16e32640 1 -- 172.21.15.88:0/1635388858 wait complete. 2023-11-20T07:01:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c16e32640 1 Processor -- start 2023-11-20T07:01:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c16e32640 1 -- start start 2023-11-20T07:01:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c16e32640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c00005190 0x7f5c100c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c16e32640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c1015b7d0 0x7f5c100b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c16e32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c100b2800 0x7f5c1015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c16e32640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100c9780 con 0x7f5c100b2800 2023-11-20T07:01:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c16e32640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100c9a60 con 0x7f5c1015b7d0 2023-11-20T07:01:49.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c16e32640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c100c9d40 con 0x7f5c00005190 2023-11-20T07:01:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c153cf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c100b2800 0x7f5c1015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c153cf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c100b2800 0x7f5c1015aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38150/0 (socket says 172.21.15.88:38150) 2023-11-20T07:01:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c153cf640 1 -- 172.21.15.88:0/970763121 learned_addr learned my addr 172.21.15.88:0/970763121 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c14bce640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c00005190 0x7f5c100c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c0ffff640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c1015b7d0 0x7f5c100b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c153cf640 1 -- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c00005190 msgr2=0x7f5c100c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c153cf640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c00005190 0x7f5c100c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c153cf640 1 -- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c1015b7d0 msgr2=0x7f5c100b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c153cf640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c1015b7d0 0x7f5c100b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c153cf640 1 -- 172.21.15.88:0/970763121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c100ca020 con 0x7f5c100b2800 2023-11-20T07:01:49.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c153cf640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c100b2800 0x7f5c1015aa30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5c0801cc90 tx=0x7f5c08019c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c0d7fa640 1 -- 172.21.15.88:0/970763121 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080b5600 con 0x7f5c100b2800 2023-11-20T07:01:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c0d7fa640 1 -- 172.21.15.88:0/970763121 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c080b5780 con 0x7f5c100b2800 2023-11-20T07:01:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c16e32640 1 -- 172.21.15.88:0/970763121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c100ca300 con 0x7f5c100b2800 2023-11-20T07:01:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c0d7fa640 1 -- 172.21.15.88:0/970763121 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c080b5b30 con 0x7f5c100b2800 2023-11-20T07:01:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.833+0000 7f5c16e32640 1 -- 172.21.15.88:0/970763121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1015af70 con 0x7f5c100b2800 2023-11-20T07:01:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.837+0000 7f5c16e32640 1 -- 172.21.15.88:0/970763121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1004e170 con 0x7f5c100b2800 2023-11-20T07:01:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.837+0000 7f5c0d7fa640 1 -- 172.21.15.88:0/970763121 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5c080bd3f0 con 0x7f5c100b2800 2023-11-20T07:01:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.837+0000 7f5c0d7fa640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bf40664a0 0x7f5bf4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.837+0000 7f5c0d7fa640 1 -- 172.21.15.88:0/970763121 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5c0811e950 con 0x7f5c100b2800 2023-11-20T07:01:49.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.837+0000 7f5c14bce640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bf40664a0 0x7f5bf4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:49.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.837+0000 7f5c14bce640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bf40664a0 0x7f5bf4068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5c04000c10 tx=0x7f5c04007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:49.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.841+0000 7f5c0d7fa640 1 -- 172.21.15.88:0/970763121 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5c080eb990 con 0x7f5c100b2800 2023-11-20T07:01:49.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.989+0000 7f5c16e32640 1 -- 172.21.15.88:0/970763121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c101e6790 con 0x7f5c100b2800 2023-11-20T07:01:49.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.989+0000 7f5c0d7fa640 1 -- 172.21.15.88:0/970763121 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c080eefb0 con 0x7f5c100b2800 2023-11-20T07:01:49.992 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:49.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.993+0000 7f5c16e32640 1 -- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bf40664a0 msgr2=0x7f5bf4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.993+0000 7f5c16e32640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bf40664a0 0x7f5bf4068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5c04000c10 tx=0x7f5c04007040 comp rx=0 tx=0).stop 2023-11-20T07:01:49.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.993+0000 7f5c16e32640 1 -- 172.21.15.88:0/970763121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c100b2800 msgr2=0x7f5c1015aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.993+0000 7f5c16e32640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c100b2800 0x7f5c1015aa30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5c0801cc90 tx=0x7f5c08019c00 comp rx=0 tx=0).stop 2023-11-20T07:01:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.993+0000 7f5c16e32640 1 -- 172.21.15.88:0/970763121 shutdown_connections 2023-11-20T07:01:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.993+0000 7f5c16e32640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bf40664a0 0x7f5bf4068960 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.993+0000 7f5c16e32640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c100b2800 0x7f5c1015aa30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.993+0000 7f5c16e32640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c1015b7d0 0x7f5c100b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.993+0000 7f5c16e32640 1 --2- 172.21.15.88:0/970763121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c00005190 0x7f5c100c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.993+0000 7f5c16e32640 1 -- 172.21.15.88:0/970763121 >> 172.21.15.88:0/970763121 conn(0x7f5c1006e570 msgr2=0x7f5c1006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.993+0000 7f5c16e32640 1 -- 172.21.15.88:0/970763121 shutdown_connections 2023-11-20T07:01:49.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:49.993+0000 7f5c16e32640 1 -- 172.21.15.88:0/970763121 wait complete. 2023-11-20T07:01:50.014 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:50.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c9994640 1 Processor -- start 2023-11-20T07:01:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c9994640 1 -- start start 2023-11-20T07:01:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c9994640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f88c4069e90 0x7f88c406d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c9994640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88c406a270 0x7f88c40c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c9994640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c415ae30 con 0x7f88c40702f0 2023-11-20T07:01:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c9994640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c40cb090 con 0x7f88c4069e90 2023-11-20T07:01:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c9994640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40ca510 con 0x7f88c406a270 2023-11-20T07:01:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c2ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f88c4069e90 0x7f88c406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c27fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88c406a270 0x7f88c40c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c37fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f88c40702f0 0x7f88c4070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:45720/0 (socket says 172.21.15.88:45720) 2023-11-20T07:01:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c37fe640 1 -- 172.21.15.88:0/194327483 learned_addr learned my addr 172.21.15.88:0/194327483 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c2ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f88c4069e90 0x7f88c406d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:44090/0 (socket says 172.21.15.88:44090) 2023-11-20T07:01:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c27fc640 1 -- 172.21.15.88:0/194327483 >> v2:172.21.15.175:3300/0 conn(0x7f88c4069e90 msgr2=0x7f88c406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c27fc640 1 --2- 172.21.15.88:0/194327483 >> v2:172.21.15.175:3300/0 conn(0x7f88c4069e90 0x7f88c406d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c27fc640 1 -- 172.21.15.88:0/194327483 >> v1:172.21.15.175:6789/0 conn(0x7f88c40702f0 legacy=0x7f88c4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c27fc640 1 -- 172.21.15.88:0/194327483 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40ca7f0 con 0x7f88c406a270 2023-11-20T07:01:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.157+0000 7f88c2ffd640 1 --2- 172.21.15.88:0/194327483 >> v2:172.21.15.175:3300/0 conn(0x7f88c4069e90 0x7f88c406d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:50.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.161+0000 7f88c27fc640 1 --2- 172.21.15.88:0/194327483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88c406a270 0x7f88c40c9ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f88b80097c0 tx=0x7f88b801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36bc498fac12af12 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:50.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.161+0000 7f88c1ffb640 1 -- 172.21.15.88:0/194327483 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80ab650 con 0x7f88c406a270 2023-11-20T07:01:50.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.161+0000 7f88c1ffb640 1 -- 172.21.15.88:0/194327483 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b80ab7b0 con 0x7f88c406a270 2023-11-20T07:01:50.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.161+0000 7f88c1ffb640 1 -- 172.21.15.88:0/194327483 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80abb40 con 0x7f88c406a270 2023-11-20T07:01:50.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.161+0000 7f88c9994640 1 -- 172.21.15.88:0/194327483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88c406a270 msgr2=0x7f88c40c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.161+0000 7f88c9994640 1 --2- 172.21.15.88:0/194327483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88c406a270 0x7f88c40c9ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f88b80097c0 tx=0x7f88b801c450 comp rx=0 tx=0).stop 2023-11-20T07:01:50.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.161+0000 7f88c9994640 1 -- 172.21.15.88:0/194327483 shutdown_connections 2023-11-20T07:01:50.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.161+0000 7f88c9994640 1 --2- 172.21.15.88:0/194327483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88c406a270 0x7f88c40c9ce0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.161+0000 7f88c9994640 1 --2- 172.21.15.88:0/194327483 >> v2:172.21.15.175:3300/0 conn(0x7f88c4069e90 0x7f88c406d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.161+0000 7f88c9994640 1 -- 172.21.15.88:0/194327483 >> 172.21.15.88:0/194327483 conn(0x7f88c40b0da0 msgr2=0x7f88c40ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:50.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.161+0000 7f88c9994640 1 -- 172.21.15.88:0/194327483 shutdown_connections 2023-11-20T07:01:50.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.161+0000 7f88c9994640 1 -- 172.21.15.88:0/194327483 wait complete. 2023-11-20T07:01:50.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c9994640 1 Processor -- start 2023-11-20T07:01:50.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c9994640 1 -- start start 2023-11-20T07:01:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c9994640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88c4069e90 0x7f88c4153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c9994640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c406a270 0x7f88c40c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c9994640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88c40702f0 0x7f88c40c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c9994640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c413ffa0 con 0x7f88c406a270 2023-11-20T07:01:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c9994640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c413f690 con 0x7f88c4069e90 2023-11-20T07:01:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c9994640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40c9da0 con 0x7f88c40702f0 2023-11-20T07:01:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c27fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c406a270 0x7f88c40c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c27fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c406a270 0x7f88c40c9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38160/0 (socket says 172.21.15.88:38160) 2023-11-20T07:01:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c27fc640 1 -- 172.21.15.88:0/4063799702 learned_addr learned my addr 172.21.15.88:0/4063799702 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c2ffd640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88c4069e90 0x7f88c4153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c37fe640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88c40702f0 0x7f88c40c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c27fc640 1 -- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88c40702f0 msgr2=0x7f88c40c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c27fc640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88c40702f0 0x7f88c40c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c27fc640 1 -- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88c4069e90 msgr2=0x7f88c4153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c27fc640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88c4069e90 0x7f88c4153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c27fc640 1 -- 172.21.15.88:0/4063799702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4009420 con 0x7f88c406a270 2023-11-20T07:01:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c2ffd640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88c4069e90 0x7f88c4153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:50.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c27fc640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c406a270 0x7f88c40c9560 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f88b80097c0 tx=0x7f88b801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:50.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88abfff640 1 -- 172.21.15.88:0/4063799702 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80b5810 con 0x7f88c406a270 2023-11-20T07:01:50.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88abfff640 1 -- 172.21.15.88:0/4063799702 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b80b5990 con 0x7f88c406a270 2023-11-20T07:01:50.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c9994640 1 -- 172.21.15.88:0/4063799702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b8009420 con 0x7f88c406a270 2023-11-20T07:01:50.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88abfff640 1 -- 172.21.15.88:0/4063799702 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b80b5d40 con 0x7f88c406a270 2023-11-20T07:01:50.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.165+0000 7f88c9994640 1 -- 172.21.15.88:0/4063799702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c413fbc0 con 0x7f88c406a270 2023-11-20T07:01:50.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.169+0000 7f88c9994640 1 -- 172.21.15.88:0/4063799702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c41400e0 con 0x7f88c406a270 2023-11-20T07:01:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.169+0000 7f88abfff640 1 -- 172.21.15.88:0/4063799702 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f88b80bf410 con 0x7f88c406a270 2023-11-20T07:01:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.169+0000 7f88abfff640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f88b00664a0 0x7f88b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.169+0000 7f88abfff640 1 -- 172.21.15.88:0/4063799702 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f88b811f170 con 0x7f88c406a270 2023-11-20T07:01:50.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.169+0000 7f88c2ffd640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f88b00664a0 0x7f88b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.173+0000 7f88c2ffd640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f88b00664a0 0x7f88b0068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009d40 tx=0x7f88b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:50.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.173+0000 7f88abfff640 1 -- 172.21.15.88:0/4063799702 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f88c41400e0 con 0x7f88c406a270 2023-11-20T07:01:50.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.329+0000 7f88c9994640 1 -- 172.21.15.88:0/4063799702 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88c41400e0 con 0x7f88c406a270 2023-11-20T07:01:50.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.329+0000 7f88abfff640 1 -- 172.21.15.88:0/4063799702 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88c41400e0 con 0x7f88c406a270 2023-11-20T07:01:50.331 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:50.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.333+0000 7f88c9994640 1 -- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f88b00664a0 msgr2=0x7f88b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.333+0000 7f88c9994640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f88b00664a0 0x7f88b0068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009d40 tx=0x7f88b4008040 comp rx=0 tx=0).stop 2023-11-20T07:01:50.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.333+0000 7f88c9994640 1 -- 172.21.15.88:0/4063799702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c406a270 msgr2=0x7f88c40c9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.333+0000 7f88c9994640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c406a270 0x7f88c40c9560 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f88b80097c0 tx=0x7f88b801ac90 comp rx=0 tx=0).stop 2023-11-20T07:01:50.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.333+0000 7f88c9994640 1 -- 172.21.15.88:0/4063799702 shutdown_connections 2023-11-20T07:01:50.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.333+0000 7f88c9994640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f88b00664a0 0x7f88b0068960 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.333+0000 7f88c9994640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88c40702f0 0x7f88c40c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.333+0000 7f88c9994640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c406a270 0x7f88c40c9560 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.333+0000 7f88c9994640 1 --2- 172.21.15.88:0/4063799702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88c4069e90 0x7f88c4153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.333+0000 7f88c9994640 1 -- 172.21.15.88:0/4063799702 >> 172.21.15.88:0/4063799702 conn(0x7f88c40b0da0 msgr2=0x7f88c40cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:50.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.333+0000 7f88c9994640 1 -- 172.21.15.88:0/4063799702 shutdown_connections 2023-11-20T07:01:50.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.333+0000 7f88c9994640 1 -- 172.21.15.88:0/4063799702 wait complete. 2023-11-20T07:01:50.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:50.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.493+0000 7fb96bb2a640 1 Processor -- start 2023-11-20T07:01:50.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.493+0000 7fb96bb2a640 1 -- start start 2023-11-20T07:01:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.493+0000 7fb96bb2a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9640b84e0 0x7fb9640d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.493+0000 7fb96bb2a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640d1670 con 0x7fb96415cba0 2023-11-20T07:01:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.493+0000 7fb96bb2a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640d1950 con 0x7fb9640d0210 2023-11-20T07:01:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.493+0000 7fb96bb2a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640d1460 con 0x7fb9640b84e0 2023-11-20T07:01:50.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9698c6640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb96415cba0 0x7fb9640cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36424/0 (socket says 172.21.15.88:36424) 2023-11-20T07:01:50.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9698c6640 1 -- 172.21.15.88:0/1961321336 learned_addr learned my addr 172.21.15.88:0/1961321336 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:50.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb96a0c7640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9640b84e0 0x7fb9640d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573808101 0 0) 0x7fb9640d1670 con 0x7fb96415cba0 2023-11-20T07:01:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb950003530 con 0x7fb96415cba0 2023-11-20T07:01:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162670245 0 0) 0x7fb9640d1950 con 0x7fb9640d0210 2023-11-20T07:01:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9640d1670 con 0x7fb9640d0210 2023-11-20T07:01:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3690900587 0 0) 0x7fb950003530 con 0x7fb96415cba0 2023-11-20T07:01:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9640b84e0 msgr2=0x7fb9640d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9640b84e0 0x7fb9640d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 >> v1:172.21.15.175:6789/0 conn(0x7fb9640d0210 legacy=0x7fb9640b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640d1c30 con 0x7fb96415cba0 2023-11-20T07:01:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fb960001680 con 0x7fb96415cba0 2023-11-20T07:01:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb96a0c7640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9640b84e0 0x7fb9640d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:50.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 >> v1:172.21.15.88:6789/0 conn(0x7fb96415cba0 legacy=0x7fb9640cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb950003b40 0x7fb950003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9500047d0 0x7fb950004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9640b84e0 0x7fb950005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640d1460 con 0x7fb950003b40 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95000b9c0 con 0x7fb9500047d0 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95000bb80 con 0x7fb9640b84e0 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9698c6640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb950003b40 0x7fb950003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9690c5640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9500047d0 0x7fb950004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb96a0c7640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9640b84e0 0x7fb950005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9698c6640 1 -- 172.21.15.88:0/1961321336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9640b84e0 msgr2=0x7fb950005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9698c6640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9640b84e0 0x7fb950005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9698c6640 1 -- 172.21.15.88:0/1961321336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9500047d0 msgr2=0x7fb950004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:50.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9698c6640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9500047d0 0x7fb950004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.497+0000 7fb9698c6640 1 -- 172.21.15.88:0/1961321336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c009a70 con 0x7fb950003b40 2023-11-20T07:01:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb9698c6640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb950003b40 0x7fb950003f40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb960001ec0 tx=0x7fb96001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3e39d79f9a1864 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600058e0 con 0x7fb950003b40 2023-11-20T07:01:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb960005a60 con 0x7fb950003b40 2023-11-20T07:01:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb9688c4640 1 -- 172.21.15.88:0/1961321336 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb960005e10 con 0x7fb950003b40 2023-11-20T07:01:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb96bb2a640 1 -- 172.21.15.88:0/1961321336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb950003b40 msgr2=0x7fb950003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb96bb2a640 1 --2- 172.21.15.88:0/1961321336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb950003b40 0x7fb950003f40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb960001ec0 tx=0x7fb96001cb80 comp rx=0 tx=0).stop 2023-11-20T07:01:50.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb96a0c7640 1 -- 172.21.15.88:0/1961321336 reap_dead start 2023-11-20T07:01:50.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb96bb2a640 1 -- 172.21.15.88:0/1961321336 shutdown_connections 2023-11-20T07:01:50.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb96bb2a640 1 -- 172.21.15.88:0/1961321336 >> 172.21.15.88:0/1961321336 conn(0x7fb9640719c0 msgr2=0x7fb964071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:50.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb96bb2a640 1 -- 172.21.15.88:0/1961321336 shutdown_connections 2023-11-20T07:01:50.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb96bb2a640 1 -- 172.21.15.88:0/1961321336 wait complete. 2023-11-20T07:01:50.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb96bb2a640 1 Processor -- start 2023-11-20T07:01:50.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.501+0000 7fb96bb2a640 1 -- start start 2023-11-20T07:01:50.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb96bb2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb950003b40 0x7fb96414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb96bb2a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9641585c0 0x7fb96415dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb96bb2a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb96415e4f0 0x7fb9641529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb96bb2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb964158170 con 0x7fb950003b40 2023-11-20T07:01:50.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb96bb2a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb964160070 con 0x7fb9641585c0 2023-11-20T07:01:50.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb96bb2a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96415ec80 con 0x7fb96415e4f0 2023-11-20T07:01:50.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb9698c6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb950003b40 0x7fb96414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb9698c6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb950003b40 0x7fb96414a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38172/0 (socket says 172.21.15.88:38172) 2023-11-20T07:01:50.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb9698c6640 1 -- 172.21.15.88:0/3232096858 learned_addr learned my addr 172.21.15.88:0/3232096858 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:50.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb9690c5640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9641585c0 0x7fb96415dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb96a0c7640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb96415e4f0 0x7fb9641529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb9698c6640 1 -- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb96415e4f0 msgr2=0x7fb9641529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb9698c6640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb96415e4f0 0x7fb9641529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb9698c6640 1 -- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9641585c0 msgr2=0x7fb96415dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb9698c6640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9641585c0 0x7fb96415dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb9698c6640 1 -- 172.21.15.88:0/3232096858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96415ef60 con 0x7fb950003b40 2023-11-20T07:01:50.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb9698c6640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb950003b40 0x7fb96414a300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb9600ab040 tx=0x7fb950005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:50.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb95a7fc640 1 -- 172.21.15.88:0/3232096858 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600047f0 con 0x7fb950003b40 2023-11-20T07:01:50.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb95a7fc640 1 -- 172.21.15.88:0/3232096858 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb960004950 con 0x7fb950003b40 2023-11-20T07:01:50.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb96bb2a640 1 -- 172.21.15.88:0/3232096858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96415e970 con 0x7fb950003b40 2023-11-20T07:01:50.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb95a7fc640 1 -- 172.21.15.88:0/3232096858 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb960004cc0 con 0x7fb950003b40 2023-11-20T07:01:50.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb96bb2a640 1 -- 172.21.15.88:0/3232096858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96414a840 con 0x7fb950003b40 2023-11-20T07:01:50.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.505+0000 7fb96bb2a640 1 -- 172.21.15.88:0/3232096858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96404e170 con 0x7fb950003b40 2023-11-20T07:01:50.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.509+0000 7fb95a7fc640 1 -- 172.21.15.88:0/3232096858 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb960007070 con 0x7fb950003b40 2023-11-20T07:01:50.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.509+0000 7fb95a7fc640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb9480664d0 0x7fb948068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.509+0000 7fb95a7fc640 1 -- 172.21.15.88:0/3232096858 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb96011d730 con 0x7fb950003b40 2023-11-20T07:01:50.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.509+0000 7fb9690c5640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb9480664d0 0x7fb948068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.509+0000 7fb9690c5640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb9480664d0 0x7fb948068990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb96415db40 tx=0x7fb954009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:50.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.513+0000 7fb95a7fc640 1 -- 172.21.15.88:0/3232096858 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb9600ea780 con 0x7fb950003b40 2023-11-20T07:01:50.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.661+0000 7fb96bb2a640 1 -- 172.21.15.88:0/3232096858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb96415a910 con 0x7fb950003b40 2023-11-20T07:01:50.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.661+0000 7fb95a7fc640 1 -- 172.21.15.88:0/3232096858 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb9600edda0 con 0x7fb950003b40 2023-11-20T07:01:50.663 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:50.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.665+0000 7fb96bb2a640 1 -- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb9480664d0 msgr2=0x7fb948068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.665+0000 7fb96bb2a640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb9480664d0 0x7fb948068990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb96415db40 tx=0x7fb954009040 comp rx=0 tx=0).stop 2023-11-20T07:01:50.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.665+0000 7fb96bb2a640 1 -- 172.21.15.88:0/3232096858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb950003b40 msgr2=0x7fb96414a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.665+0000 7fb96bb2a640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb950003b40 0x7fb96414a300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb9600ab040 tx=0x7fb950005800 comp rx=0 tx=0).stop 2023-11-20T07:01:50.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.665+0000 7fb96bb2a640 1 -- 172.21.15.88:0/3232096858 shutdown_connections 2023-11-20T07:01:50.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.665+0000 7fb96bb2a640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb9480664d0 0x7fb948068990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.665+0000 7fb96bb2a640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb96415e4f0 0x7fb9641529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.665+0000 7fb96bb2a640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9641585c0 0x7fb96415dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.665+0000 7fb96bb2a640 1 --2- 172.21.15.88:0/3232096858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb950003b40 0x7fb96414a300 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.665+0000 7fb96bb2a640 1 -- 172.21.15.88:0/3232096858 >> 172.21.15.88:0/3232096858 conn(0x7fb9640719c0 msgr2=0x7fb96415d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:50.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.665+0000 7fb96bb2a640 1 -- 172.21.15.88:0/3232096858 shutdown_connections 2023-11-20T07:01:50.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.665+0000 7fb96bb2a640 1 -- 172.21.15.88:0/3232096858 wait complete. 2023-11-20T07:01:50.684 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:50.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.821+0000 7f9987bc5640 1 Processor -- start 2023-11-20T07:01:50.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.821+0000 7f9987bc5640 1 -- start start 2023-11-20T07:01:50.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9987bc5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f998015cb60 0x7f99800c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9987bc5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f998015cf40 0x7f998006ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9987bc5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998006f390 0x7f9980071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9987bc5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99800723f0 con 0x7f998015cf40 2023-11-20T07:01:50.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9987bc5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998006f7e0 con 0x7f998015cb60 2023-11-20T07:01:50.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9987bc5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998006ac10 con 0x7f998006f390 2023-11-20T07:01:50.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9985160640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f998015cf40 0x7f998006ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9985160640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f998015cf40 0x7f998006ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38176/0 (socket says 172.21.15.88:38176) 2023-11-20T07:01:50.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9985160640 1 -- 172.21.15.88:0/574481869 learned_addr learned my addr 172.21.15.88:0/574481869 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:50.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9986162640 1 --2- 172.21.15.88:0/574481869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998006f390 0x7f9980071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9985961640 1 --2- 172.21.15.88:0/574481869 >> v2:172.21.15.175:3300/0 conn(0x7f998015cb60 0x7f99800c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9985160640 1 -- 172.21.15.88:0/574481869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998006f390 msgr2=0x7f9980071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:50.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9985160640 1 --2- 172.21.15.88:0/574481869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998006f390 0x7f9980071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9985160640 1 -- 172.21.15.88:0/574481869 >> v2:172.21.15.175:3300/0 conn(0x7f998015cb60 msgr2=0x7f99800c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:50.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9985160640 1 --2- 172.21.15.88:0/574481869 >> v2:172.21.15.175:3300/0 conn(0x7f998015cb60 0x7f99800c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9985160640 1 -- 172.21.15.88:0/574481869 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9980072110 con 0x7f998015cf40 2023-11-20T07:01:50.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9986162640 1 --2- 172.21.15.88:0/574481869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998006f390 0x7f9980071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:50.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9985961640 1 --2- 172.21.15.88:0/574481869 >> v2:172.21.15.175:3300/0 conn(0x7f998015cb60 0x7f99800c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:50.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.825+0000 7f9985160640 1 --2- 172.21.15.88:0/574481869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998015cf40 0x7f998006ee50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f99800d0370 tx=0x7f997001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33b43a722c3cee7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:50.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f998495f640 1 -- 172.21.15.88:0/574481869 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99700aa5f0 con 0x7f998015cf40 2023-11-20T07:01:50.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f998495f640 1 -- 172.21.15.88:0/574481869 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99700aa750 con 0x7f998015cf40 2023-11-20T07:01:50.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f998495f640 1 -- 172.21.15.88:0/574481869 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99700aaae0 con 0x7f998015cf40 2023-11-20T07:01:50.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 -- 172.21.15.88:0/574481869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998015cf40 msgr2=0x7f998006ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 --2- 172.21.15.88:0/574481869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998015cf40 0x7f998006ee50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f99800d0370 tx=0x7f997001c4d0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 -- 172.21.15.88:0/574481869 shutdown_connections 2023-11-20T07:01:50.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 --2- 172.21.15.88:0/574481869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998006f390 0x7f9980071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 --2- 172.21.15.88:0/574481869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998015cf40 0x7f998006ee50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 --2- 172.21.15.88:0/574481869 >> v2:172.21.15.175:3300/0 conn(0x7f998015cb60 0x7f99800c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 -- 172.21.15.88:0/574481869 >> 172.21.15.88:0/574481869 conn(0x7f99800cf7a0 msgr2=0x7f99800cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:50.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 -- 172.21.15.88:0/574481869 shutdown_connections 2023-11-20T07:01:50.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 -- 172.21.15.88:0/574481869 wait complete. 2023-11-20T07:01:50.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 Processor -- start 2023-11-20T07:01:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 -- start start 2023-11-20T07:01:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998006f390 0x7f99800cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998015cb60 0x7f99800c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f998015cf40 0x7f99800c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99801f8d70 con 0x7f998015cb60 2023-11-20T07:01:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99801f9050 con 0x7f998015cf40 2023-11-20T07:01:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9987bc5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99801f9330 con 0x7f998006f390 2023-11-20T07:01:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9985160640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998015cb60 0x7f99800c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9985160640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998015cb60 0x7f99800c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38178/0 (socket says 172.21.15.88:38178) 2023-11-20T07:01:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.829+0000 7f9985160640 1 -- 172.21.15.88:0/2453447156 learned_addr learned my addr 172.21.15.88:0/2453447156 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9986162640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f998015cf40 0x7f99800c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9985961640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998006f390 0x7f99800cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9985160640 1 -- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998006f390 msgr2=0x7f99800cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9985160640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998006f390 0x7f99800cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9985160640 1 -- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f998015cf40 msgr2=0x7f99800c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9985160640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f998015cf40 0x7f99800c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9985160640 1 -- 172.21.15.88:0/2453447156 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99700094d0 con 0x7f998015cb60 2023-11-20T07:01:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9985961640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998006f390 0x7f99800cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9985160640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998015cb60 0x7f99800c5360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f99700ac040 tx=0x7f997001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f99767fc640 1 -- 172.21.15.88:0/2453447156 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99700b3800 con 0x7f998015cb60 2023-11-20T07:01:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f99767fc640 1 -- 172.21.15.88:0/2453447156 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99700b3980 con 0x7f998015cb60 2023-11-20T07:01:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f99767fc640 1 -- 172.21.15.88:0/2453447156 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99700b3d30 con 0x7f998015cb60 2023-11-20T07:01:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9987bc5640 1 -- 172.21.15.88:0/2453447156 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99801f9610 con 0x7f998015cb60 2023-11-20T07:01:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9987bc5640 1 -- 172.21.15.88:0/2453447156 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99800cb1a0 con 0x7f998015cb60 2023-11-20T07:01:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9987bc5640 1 -- 172.21.15.88:0/2453447156 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998006f060 con 0x7f998015cb60 2023-11-20T07:01:50.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f99767fc640 1 -- 172.21.15.88:0/2453447156 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f99700bd3f0 con 0x7f998015cb60 2023-11-20T07:01:50.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f99767fc640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99640664a0 0x7f9964068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:50.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f99767fc640 1 -- 172.21.15.88:0/2453447156 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f99700a7070 con 0x7f998015cb60 2023-11-20T07:01:50.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.833+0000 7f9985961640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99640664a0 0x7f9964068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:50.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.837+0000 7f9985961640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99640664a0 0x7f9964068960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f997c006fd0 tx=0x7f997c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:50.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.837+0000 7f99767fc640 1 -- 172.21.15.88:0/2453447156 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f99700ebed0 con 0x7f998015cb60 2023-11-20T07:01:50.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 -- 172.21.15.88:0/2453447156 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f99801f9470 con 0x7f998015cb60 2023-11-20T07:01:50.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f99767fc640 1 -- 172.21.15.88:0/2453447156 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f99801f9470 con 0x7f998015cb60 2023-11-20T07:01:50.991 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:50.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 -- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99640664a0 msgr2=0x7f9964068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99640664a0 0x7f9964068960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f997c006fd0 tx=0x7f997c008040 comp rx=0 tx=0).stop 2023-11-20T07:01:50.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 -- 172.21.15.88:0/2453447156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998015cb60 msgr2=0x7f99800c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:50.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998015cb60 0x7f99800c5360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f99700ac040 tx=0x7f997001ad10 comp rx=0 tx=0).stop 2023-11-20T07:01:50.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 -- 172.21.15.88:0/2453447156 shutdown_connections 2023-11-20T07:01:50.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99640664a0 0x7f9964068960 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f998015cf40 0x7f99800c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f998015cb60 0x7f99800c5360 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 --2- 172.21.15.88:0/2453447156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998006f390 0x7f99800cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:50.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 -- 172.21.15.88:0/2453447156 >> 172.21.15.88:0/2453447156 conn(0x7f99800cf7a0 msgr2=0x7f998015f050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:50.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 -- 172.21.15.88:0/2453447156 shutdown_connections 2023-11-20T07:01:50.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:50.989+0000 7f9987bc5640 1 -- 172.21.15.88:0/2453447156 wait complete. 2023-11-20T07:01:51.011 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T07:01:51.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4d1d80640 1 Processor -- start 2023-11-20T07:01:51.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4d1d80640 1 -- start start 2023-11-20T07:01:51.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4d1d80640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe4cc15cb90 0x7fe4cc0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4d1d80640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4cc0d3010 0x7fe4cc0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4d1d80640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc0ce770 con 0x7fe4cc0d1400 2023-11-20T07:01:51.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4d1d80640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc0d1890 con 0x7fe4cc15cb90 2023-11-20T07:01:51.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4d1d80640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0d0600 con 0x7fe4cc0d3010 2023-11-20T07:01:51.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4cbfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe4cc0d1400 0x7fe4cc0cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36440/0 (socket says 172.21.15.88:36440) 2023-11-20T07:01:51.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4cbfff640 1 -- 172.21.15.88:0/1115901383 learned_addr learned my addr 172.21.15.88:0/1115901383 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:51.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4c3fff640 1 --2- 172.21.15.88:0/1115901383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4cc0d3010 0x7fe4cc0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4cb7fe640 1 --2- 172.21.15.88:0/1115901383 >> v2:172.21.15.175:3300/0 conn(0x7fe4cc15cb90 0x7fe4cc0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4caffd640 1 -- 172.21.15.88:0/1115901383 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266810412 0 0) 0x7fe4cc0ce770 con 0x7fe4cc0d1400 2023-11-20T07:01:51.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.149+0000 7fe4caffd640 1 -- 172.21.15.88:0/1115901383 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b8003530 con 0x7fe4cc0d1400 2023-11-20T07:01:51.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.153+0000 7fe4cb7fe640 1 -- 172.21.15.88:0/1115901383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4cc0d3010 msgr2=0x7fe4cc0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:51.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.153+0000 7fe4cb7fe640 1 --2- 172.21.15.88:0/1115901383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4cc0d3010 0x7fe4cc0d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.153+0000 7fe4cb7fe640 1 -- 172.21.15.88:0/1115901383 >> v1:172.21.15.88:6789/0 conn(0x7fe4cc0d1400 legacy=0x7fe4cc0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.153+0000 7fe4cb7fe640 1 -- 172.21.15.88:0/1115901383 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc0c6450 con 0x7fe4cc15cb90 2023-11-20T07:01:51.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.153+0000 7fe4c3fff640 1 --2- 172.21.15.88:0/1115901383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4cc0d3010 0x7fe4cc0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:51.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.153+0000 7fe4cb7fe640 1 --2- 172.21.15.88:0/1115901383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc15cb90 0x7fe4cc0cfb10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0097a0 tx=0x7fe4bc01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa27da6f944eee75 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:51.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.153+0000 7fe4caffd640 1 -- 172.21.15.88:0/1115901383 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0ac600 con 0x7fe4cc15cb90 2023-11-20T07:01:51.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.153+0000 7fe4caffd640 1 -- 172.21.15.88:0/1115901383 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc0a8050 con 0x7fe4cc15cb90 2023-11-20T07:01:51.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.153+0000 7fe4caffd640 1 -- 172.21.15.88:0/1115901383 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0ac980 con 0x7fe4cc15cb90 2023-11-20T07:01:51.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 -- 172.21.15.88:0/1115901383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc15cb90 msgr2=0x7fe4cc0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 --2- 172.21.15.88:0/1115901383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc15cb90 0x7fe4cc0cfb10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0097a0 tx=0x7fe4bc01c3a0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 -- 172.21.15.88:0/1115901383 shutdown_connections 2023-11-20T07:01:51.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 --2- 172.21.15.88:0/1115901383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4cc0d3010 0x7fe4cc0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 --2- 172.21.15.88:0/1115901383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc15cb90 0x7fe4cc0cfb10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 -- 172.21.15.88:0/1115901383 >> 172.21.15.88:0/1115901383 conn(0x7fe4cc09bc50 msgr2=0x7fe4cc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:51.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 -- 172.21.15.88:0/1115901383 shutdown_connections 2023-11-20T07:01:51.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 -- 172.21.15.88:0/1115901383 wait complete. 2023-11-20T07:01:51.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 Processor -- start 2023-11-20T07:01:51.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 -- start start 2023-11-20T07:01:51.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4cc0d1400 0x7fe4cc14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4cc0d3010 0x7fe4cc14b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc15cb90 0x7fe4cc0c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc15ac20 con 0x7fe4cc0d1400 2023-11-20T07:01:51.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc14b7a0 con 0x7fe4cc15cb90 2023-11-20T07:01:51.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4d1d80640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc157c00 con 0x7fe4cc0d3010 2023-11-20T07:01:51.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4cb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4cc0d1400 0x7fe4cc14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4cb7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4cc0d1400 0x7fe4cc14f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38188/0 (socket says 172.21.15.88:38188) 2023-11-20T07:01:51.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4cb7fe640 1 -- 172.21.15.88:0/3185888530 learned_addr learned my addr 172.21.15.88:0/3185888530 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:51.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4c3fff640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4cc0d3010 0x7fe4cc14b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4cbfff640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc15cb90 0x7fe4cc0c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4cb7fe640 1 -- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4cc0d3010 msgr2=0x7fe4cc14b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4cb7fe640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4cc0d3010 0x7fe4cc14b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4cb7fe640 1 -- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc15cb90 msgr2=0x7fe4cc0c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4cb7fe640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc15cb90 0x7fe4cc0c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4cb7fe640 1 -- 172.21.15.88:0/3185888530 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b4009420 con 0x7fe4cc0d1400 2023-11-20T07:01:51.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4c3fff640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4cc0d3010 0x7fe4cc14b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:51.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.157+0000 7fe4cbfff640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc15cb90 0x7fe4cc0c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:51.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.161+0000 7fe4cb7fe640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4cc0d1400 0x7fe4cc14f4b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0af040 tx=0x7fe4bc01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:51.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.161+0000 7fe4c8ff9640 1 -- 172.21.15.88:0/3185888530 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0b7420 con 0x7fe4cc0d1400 2023-11-20T07:01:51.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.161+0000 7fe4c8ff9640 1 -- 172.21.15.88:0/3185888530 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc0b7580 con 0x7fe4cc0d1400 2023-11-20T07:01:51.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.161+0000 7fe4c8ff9640 1 -- 172.21.15.88:0/3185888530 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0b7930 con 0x7fe4cc0d1400 2023-11-20T07:01:51.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.161+0000 7fe4d1d80640 1 -- 172.21.15.88:0/3185888530 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4bc0093b0 con 0x7fe4cc0d1400 2023-11-20T07:01:51.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.161+0000 7fe4d1d80640 1 -- 172.21.15.88:0/3185888530 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc1581c0 con 0x7fe4cc0d1400 2023-11-20T07:01:51.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.161+0000 7fe4d1d80640 1 -- 172.21.15.88:0/3185888530 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc074010 con 0x7fe4cc0d1400 2023-11-20T07:01:51.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.161+0000 7fe4c8ff9640 1 -- 172.21.15.88:0/3185888530 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe4bc0b3040 con 0x7fe4cc0d1400 2023-11-20T07:01:51.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.161+0000 7fe4c8ff9640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe4ac0664d0 0x7fe4ac068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.161+0000 7fe4c8ff9640 1 -- 172.21.15.88:0/3185888530 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe4bc11e5a0 con 0x7fe4cc0d1400 2023-11-20T07:01:51.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.165+0000 7fe4c3fff640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe4ac0664d0 0x7fe4ac068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.165+0000 7fe4c3fff640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe4ac0664d0 0x7fe4ac068990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0c8ea0 tx=0x7fe4b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:51.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.165+0000 7fe4c8ff9640 1 -- 172.21.15.88:0/3185888530 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe4bc0eb650 con 0x7fe4cc0d1400 2023-11-20T07:01:51.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 -- 172.21.15.88:0/3185888530 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe4cc09c030 con 0x7fe4cc0d1400 2023-11-20T07:01:51.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4c8ff9640 1 -- 172.21.15.88:0/3185888530 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe4bc0eec70 con 0x7fe4cc0d1400 2023-11-20T07:01:51.331 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-20T07:01:51.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 -- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe4ac0664d0 msgr2=0x7fe4ac068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe4ac0664d0 0x7fe4ac068990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0c8ea0 tx=0x7fe4b4008040 comp rx=0 tx=0).stop 2023-11-20T07:01:51.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 -- 172.21.15.88:0/3185888530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4cc0d1400 msgr2=0x7fe4cc14f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4cc0d1400 0x7fe4cc14f4b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0af040 tx=0x7fe4bc01abe0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 -- 172.21.15.88:0/3185888530 shutdown_connections 2023-11-20T07:01:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe4ac0664d0 0x7fe4ac068990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4cc0d3010 0x7fe4cc14b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4cc15cb90 0x7fe4cc0c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 --2- 172.21.15.88:0/3185888530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4cc0d1400 0x7fe4cc14f4b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 -- 172.21.15.88:0/3185888530 >> 172.21.15.88:0/3185888530 conn(0x7fe4cc09bc50 msgr2=0x7fe4cc1556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 -- 172.21.15.88:0/3185888530 shutdown_connections 2023-11-20T07:01:51.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.329+0000 7fe4d1d80640 1 -- 172.21.15.88:0/3185888530 wait complete. 2023-11-20T07:01:51.351 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2023-11-20T07:01:51.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:51.352 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-20T07:01:51.373 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:01:51.373 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T07:01:51.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:51.374 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-20T07:01:51.425 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:01:51.425 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:51.435 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:01:51.435 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:51.488 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:51.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.625+0000 7f76ea046640 1 Processor -- start 2023-11-20T07:01:51.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.625+0000 7f76ea046640 1 -- start start 2023-11-20T07:01:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.625+0000 7f76ea046640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f76e415cb90 0x7f76e40cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.625+0000 7f76ea046640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 0x7f76e40c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.625+0000 7f76ea046640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e40ce770 con 0x7f76e40d3010 2023-11-20T07:01:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.625+0000 7f76ea046640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e40d0600 con 0x7f76e415cb90 2023-11-20T07:01:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.625+0000 7f76ea046640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40c6450 con 0x7f76e40d15d0 2023-11-20T07:01:51.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.625+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 0x7f76e40c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.625+0000 7f76e37fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f76e415cb90 0x7f76e40cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.625+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 0x7f76e40c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:59552/0 (socket says 172.21.15.88:59552) 2023-11-20T07:01:51.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.625+0000 7f76e3fff640 1 -- 172.21.15.88:0/684357971 learned_addr learned my addr 172.21.15.88:0/684357971 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:51.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.625+0000 7f76dbfff640 1 --1- 172.21.15.88:0/684357971 >> v1:172.21.15.175:6789/0 conn(0x7f76e40d3010 0x7f76e40d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:45738/0 (socket says 172.21.15.88:45738) 2023-11-20T07:01:51.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.629+0000 7f76e37fe640 1 -- 172.21.15.88:0/684357971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 msgr2=0x7f76e40c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:51.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.629+0000 7f76e37fe640 1 --2- 172.21.15.88:0/684357971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 0x7f76e40c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.629+0000 7f76e37fe640 1 -- 172.21.15.88:0/684357971 >> v1:172.21.15.175:6789/0 conn(0x7f76e40d3010 legacy=0x7f76e40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.629+0000 7f76e37fe640 1 -- 172.21.15.88:0/684357971 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e40d08a0 con 0x7f76e415cb90 2023-11-20T07:01:51.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.629+0000 7f76e2ffd640 1 -- 172.21.15.88:0/684357971 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049699807 0 0) 0x7f76e40ce770 con 0x7f76e40d3010 2023-11-20T07:01:51.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.629+0000 7f76e3fff640 1 --2- 172.21.15.88:0/684357971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 0x7f76e40c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:51.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.629+0000 7f76e37fe640 1 --2- 172.21.15.88:0/684357971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e415cb90 0x7f76e40cfb10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76d40097a0 tx=0x7f76d401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eeed9cb2a8085e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:51.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.629+0000 7f76e2ffd640 1 -- 172.21.15.88:0/684357971 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40ac600 con 0x7f76e415cb90 2023-11-20T07:01:51.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.629+0000 7f76e2ffd640 1 -- 172.21.15.88:0/684357971 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d40a8050 con 0x7f76e415cb90 2023-11-20T07:01:51.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.629+0000 7f76e2ffd640 1 -- 172.21.15.88:0/684357971 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40ac980 con 0x7f76e415cb90 2023-11-20T07:01:51.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.629+0000 7f76ea046640 1 -- 172.21.15.88:0/684357971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e415cb90 msgr2=0x7f76e40cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.629+0000 7f76ea046640 1 --2- 172.21.15.88:0/684357971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e415cb90 0x7f76e40cfb10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76d40097a0 tx=0x7f76d401c3a0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 -- 172.21.15.88:0/684357971 shutdown_connections 2023-11-20T07:01:51.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 --2- 172.21.15.88:0/684357971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 0x7f76e40c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 --2- 172.21.15.88:0/684357971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e415cb90 0x7f76e40cfb10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 -- 172.21.15.88:0/684357971 >> 172.21.15.88:0/684357971 conn(0x7f76e409bc50 msgr2=0x7f76e40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:51.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 -- 172.21.15.88:0/684357971 shutdown_connections 2023-11-20T07:01:51.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 -- 172.21.15.88:0/684357971 wait complete. 2023-11-20T07:01:51.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 Processor -- start 2023-11-20T07:01:51.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 -- start start 2023-11-20T07:01:51.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 0x7f76e40b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e40d3010 0x7f76e415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e415cb90 0x7f76e41554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e415c180 con 0x7f76e415cb90 2023-11-20T07:01:51.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e415b500 con 0x7f76e40d3010 2023-11-20T07:01:51.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76ea046640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e415b7e0 con 0x7f76e40d15d0 2023-11-20T07:01:51.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e415cb90 0x7f76e41554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e415cb90 0x7f76e41554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38192/0 (socket says 172.21.15.88:38192) 2023-11-20T07:01:51.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76e3fff640 1 -- 172.21.15.88:0/3999764879 learned_addr learned my addr 172.21.15.88:0/3999764879 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:51.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76dbfff640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e40d3010 0x7f76e415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76e37fe640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 0x7f76e40b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76e3fff640 1 -- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 msgr2=0x7f76e40b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76e3fff640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 0x7f76e40b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76e3fff640 1 -- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e40d3010 msgr2=0x7f76e415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76e3fff640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e40d3010 0x7f76e415aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76e3fff640 1 -- 172.21.15.88:0/3999764879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc009b30 con 0x7f76e415cb90 2023-11-20T07:01:51.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76e37fe640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 0x7f76e40b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:51.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.633+0000 7f76e3fff640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e415cb90 0x7f76e41554e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00ef90 tx=0x7f76dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:51.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.637+0000 7f76e0ff9640 1 -- 172.21.15.88:0/3999764879 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc018070 con 0x7f76e415cb90 2023-11-20T07:01:51.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.637+0000 7f76e0ff9640 1 -- 172.21.15.88:0/3999764879 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc00f040 con 0x7f76e415cb90 2023-11-20T07:01:51.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.637+0000 7f76ea046640 1 -- 172.21.15.88:0/3999764879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d40093b0 con 0x7f76e415cb90 2023-11-20T07:01:51.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.637+0000 7f76e0ff9640 1 -- 172.21.15.88:0/3999764879 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00ce00 con 0x7f76e415cb90 2023-11-20T07:01:51.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.637+0000 7f76ea046640 1 -- 172.21.15.88:0/3999764879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e40a0360 con 0x7f76e415cb90 2023-11-20T07:01:51.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.637+0000 7f76ea046640 1 -- 172.21.15.88:0/3999764879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e415bbd0 con 0x7f76e415cb90 2023-11-20T07:01:51.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.637+0000 7f76e0ff9640 1 -- 172.21.15.88:0/3999764879 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f76dc014480 con 0x7f76e415cb90 2023-11-20T07:01:51.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.637+0000 7f76e0ff9640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f76c40664a0 0x7f76c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.637+0000 7f76e0ff9640 1 -- 172.21.15.88:0/3999764879 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f76dc084470 con 0x7f76e415cb90 2023-11-20T07:01:51.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.637+0000 7f76e37fe640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f76c40664a0 0x7f76c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.641+0000 7f76e37fe640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f76c40664a0 0x7f76c4068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f76d40ae000 tx=0x7f76d40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:51.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.641+0000 7f76e0ff9640 1 -- 172.21.15.88:0/3999764879 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f76dc0515c0 con 0x7f76e415cb90 2023-11-20T07:01:51.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.793+0000 7f76ea046640 1 -- 172.21.15.88:0/3999764879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76e415b9a0 con 0x7f76e415cb90 2023-11-20T07:01:51.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76e0ff9640 1 -- 172.21.15.88:0/3999764879 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f76dc054be0 con 0x7f76e415cb90 2023-11-20T07:01:51.797 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:51.798 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:51.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76ea046640 1 -- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f76c40664a0 msgr2=0x7f76c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76ea046640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f76c40664a0 0x7f76c4068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f76d40ae000 tx=0x7f76d40a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:51.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76ea046640 1 -- 172.21.15.88:0/3999764879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e415cb90 msgr2=0x7f76e41554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76ea046640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e415cb90 0x7f76e41554e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00ef90 tx=0x7f76dc00c490 comp rx=0 tx=0).stop 2023-11-20T07:01:51.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76ea046640 1 -- 172.21.15.88:0/3999764879 shutdown_connections 2023-11-20T07:01:51.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76ea046640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f76c40664a0 0x7f76c4068960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76ea046640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76e415cb90 0x7f76e41554e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76ea046640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e40d3010 0x7f76e415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76ea046640 1 --2- 172.21.15.88:0/3999764879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e40d15d0 0x7f76e40b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76ea046640 1 -- 172.21.15.88:0/3999764879 >> 172.21.15.88:0/3999764879 conn(0x7f76e409bc50 msgr2=0x7f76e40cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:51.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76ea046640 1 -- 172.21.15.88:0/3999764879 shutdown_connections 2023-11-20T07:01:51.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.797+0000 7f76ea046640 1 -- 172.21.15.88:0/3999764879 wait complete. 2023-11-20T07:01:51.819 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:51.819 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:51.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.957+0000 7f8991701640 1 Processor -- start 2023-11-20T07:01:51.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.957+0000 7f8991701640 1 -- start start 2023-11-20T07:01:51.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.957+0000 7f8991701640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f898c15cba0 0x7f898c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f8991701640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f898c0d0210 0x7f898c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f8991701640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898c0d1670 con 0x7f898c0b84e0 2023-11-20T07:01:51.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f8991701640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898c0d1460 con 0x7f898c15cba0 2023-11-20T07:01:51.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f8991701640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0d1950 con 0x7f898c0d0210 2023-11-20T07:01:51.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f89827fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f898c0b84e0 0x7f898c0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36442/0 (socket says 172.21.15.88:36442) 2023-11-20T07:01:51.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f89827fc640 1 -- 172.21.15.88:0/3871485239 learned_addr learned my addr 172.21.15.88:0/3871485239 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:51.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f898affd640 1 --2- 172.21.15.88:0/3871485239 >> v2:172.21.15.175:3300/0 conn(0x7f898c15cba0 0x7f898c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f898b7fe640 1 --2- 172.21.15.88:0/3871485239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f898c0d0210 0x7f898c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f898a7fc640 1 -- 172.21.15.88:0/3871485239 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438958772 0 0) 0x7f898c0d1670 con 0x7f898c0b84e0 2023-11-20T07:01:51.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f898a7fc640 1 -- 172.21.15.88:0/3871485239 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8978003530 con 0x7f898c0b84e0 2023-11-20T07:01:51.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f898affd640 1 -- 172.21.15.88:0/3871485239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f898c0d0210 msgr2=0x7f898c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:51.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f898affd640 1 --2- 172.21.15.88:0/3871485239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f898c0d0210 0x7f898c0b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f898affd640 1 -- 172.21.15.88:0/3871485239 >> v1:172.21.15.88:6789/0 conn(0x7f898c0b84e0 legacy=0x7f898c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f898affd640 1 -- 172.21.15.88:0/3871485239 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c0d1c30 con 0x7f898c15cba0 2023-11-20T07:01:51.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.961+0000 7f898b7fe640 1 --2- 172.21.15.88:0/3871485239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f898c0d0210 0x7f898c0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:51.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.965+0000 7f898affd640 1 --2- 172.21.15.88:0/3871485239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f898c15cba0 0x7f898c0d0f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f897c0097c0 tx=0x7f897c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98807c20d4ab2c83 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:51.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.965+0000 7f898a7fc640 1 -- 172.21.15.88:0/3871485239 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c0ab680 con 0x7f898c15cba0 2023-11-20T07:01:51.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.965+0000 7f898a7fc640 1 -- 172.21.15.88:0/3871485239 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c0ab7e0 con 0x7f898c15cba0 2023-11-20T07:01:51.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.965+0000 7f898a7fc640 1 -- 172.21.15.88:0/3871485239 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c0abb70 con 0x7f898c15cba0 2023-11-20T07:01:51.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.965+0000 7f8991701640 1 -- 172.21.15.88:0/3871485239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f898c15cba0 msgr2=0x7f898c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.965+0000 7f8991701640 1 --2- 172.21.15.88:0/3871485239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f898c15cba0 0x7f898c0d0f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f897c0097c0 tx=0x7f897c01c480 comp rx=0 tx=0).stop 2023-11-20T07:01:51.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.965+0000 7f8991701640 1 -- 172.21.15.88:0/3871485239 shutdown_connections 2023-11-20T07:01:51.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.965+0000 7f8991701640 1 --2- 172.21.15.88:0/3871485239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f898c0d0210 0x7f898c0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.965+0000 7f8991701640 1 --2- 172.21.15.88:0/3871485239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f898c15cba0 0x7f898c0d0f20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.965+0000 7f8991701640 1 -- 172.21.15.88:0/3871485239 >> 172.21.15.88:0/3871485239 conn(0x7f898c0719c0 msgr2=0x7f898c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:51.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.965+0000 7f8991701640 1 -- 172.21.15.88:0/3871485239 shutdown_connections 2023-11-20T07:01:51.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.965+0000 7f8991701640 1 -- 172.21.15.88:0/3871485239 wait complete. 2023-11-20T07:01:51.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8991701640 1 Processor -- start 2023-11-20T07:01:51.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8991701640 1 -- start start 2023-11-20T07:01:51.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8991701640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f898c0b84e0 0x7f898c14fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8991701640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f898c0d0210 0x7f898c15a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8991701640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f898c15cba0 0x7f898c15a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8991701640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0b4300 con 0x7f898c0b84e0 2023-11-20T07:01:51.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8991701640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0b36f0 con 0x7f898c15cba0 2023-11-20T07:01:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8991701640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0b39d0 con 0x7f898c0d0210 2023-11-20T07:01:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f898affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f898c0b84e0 0x7f898c14fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f898affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f898c0b84e0 0x7f898c14fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38204/0 (socket says 172.21.15.88:38204) 2023-11-20T07:01:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f898affd640 1 -- 172.21.15.88:0/2932365152 learned_addr learned my addr 172.21.15.88:0/2932365152 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f898b7fe640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f898c15cba0 0x7f898c15a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f898affd640 1 -- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f898c0d0210 msgr2=0x7f898c15a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f898affd640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f898c0d0210 0x7f898c15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f898affd640 1 -- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f898c15cba0 msgr2=0x7f898c15a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f898affd640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f898c15cba0 0x7f898c15a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f898affd640 1 -- 172.21.15.88:0/2932365152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8984009a70 con 0x7f898c0b84e0 2023-11-20T07:01:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f898b7fe640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f898c15cba0 0x7f898c15a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:51.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f898affd640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f898c0b84e0 0x7f898c14fb60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f897c0ad040 tx=0x7f897c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:51.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8983fff640 1 -- 172.21.15.88:0/2932365152 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c0bf610 con 0x7f898c0b84e0 2023-11-20T07:01:51.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8983fff640 1 -- 172.21.15.88:0/2932365152 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c0bf790 con 0x7f898c0b84e0 2023-11-20T07:01:51.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8983fff640 1 -- 172.21.15.88:0/2932365152 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c0bfb40 con 0x7f898c0b84e0 2023-11-20T07:01:51.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8991701640 1 -- 172.21.15.88:0/2932365152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c009420 con 0x7f898c0b84e0 2023-11-20T07:01:51.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.969+0000 7f8991701640 1 -- 172.21.15.88:0/2932365152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898c0b3f90 con 0x7f898c0b84e0 2023-11-20T07:01:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.973+0000 7f8991701640 1 -- 172.21.15.88:0/2932365152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898c0672e0 con 0x7f898c0b84e0 2023-11-20T07:01:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.973+0000 7f8983fff640 1 -- 172.21.15.88:0/2932365152 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f897c0b5400 con 0x7f898c0b84e0 2023-11-20T07:01:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.973+0000 7f8983fff640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f896c0664a0 0x7f896c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.973+0000 7f8983fff640 1 -- 172.21.15.88:0/2932365152 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f897c11ed00 con 0x7f898c0b84e0 2023-11-20T07:01:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.973+0000 7f89827fc640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f896c0664a0 0x7f896c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.973+0000 7f89827fc640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f896c0664a0 0x7f896c068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8974007fd0 tx=0x7f8974007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:51.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:51.977+0000 7f8983fff640 1 -- 172.21.15.88:0/2932365152 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f897c0ebe50 con 0x7f898c0b84e0 2023-11-20T07:01:52.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.125+0000 7f8991701640 1 -- 172.21.15.88:0/2932365152 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f898c04e170 con 0x7f898c0b84e0 2023-11-20T07:01:52.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.125+0000 7f8983fff640 1 -- 172.21.15.88:0/2932365152 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f897c0ef470 con 0x7f898c0b84e0 2023-11-20T07:01:52.127 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:52.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.129+0000 7f8991701640 1 -- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f896c0664a0 msgr2=0x7f896c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.129+0000 7f8991701640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f896c0664a0 0x7f896c068960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8974007fd0 tx=0x7f8974007900 comp rx=0 tx=0).stop 2023-11-20T07:01:52.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.129+0000 7f8991701640 1 -- 172.21.15.88:0/2932365152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f898c0b84e0 msgr2=0x7f898c14fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.129+0000 7f8991701640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f898c0b84e0 0x7f898c14fb60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f897c0ad040 tx=0x7f897c01acc0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.129+0000 7f8991701640 1 -- 172.21.15.88:0/2932365152 shutdown_connections 2023-11-20T07:01:52.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.129+0000 7f8991701640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f896c0664a0 0x7f896c068960 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.129+0000 7f8991701640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f898c0d0210 0x7f898c15a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.129+0000 7f8991701640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f898c15cba0 0x7f898c15a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.129+0000 7f8991701640 1 --2- 172.21.15.88:0/2932365152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f898c0b84e0 0x7f898c14fb60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.129+0000 7f8991701640 1 -- 172.21.15.88:0/2932365152 >> 172.21.15.88:0/2932365152 conn(0x7f898c0719c0 msgr2=0x7f898c15b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:52.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.129+0000 7f8991701640 1 -- 172.21.15.88:0/2932365152 shutdown_connections 2023-11-20T07:01:52.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.129+0000 7f8991701640 1 -- 172.21.15.88:0/2932365152 wait complete. 2023-11-20T07:01:52.150 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:52.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5f55c5640 1 Processor -- start 2023-11-20T07:01:52.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5f55c5640 1 -- start start 2023-11-20T07:01:52.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5f55c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5f00c36c0 0x7fa5f0165570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5f55c5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f015ae30 con 0x7fa5f0069e90 2023-11-20T07:01:52.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5f55c5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f00ca510 con 0x7fa5f006d010 2023-11-20T07:01:52.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5f55c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00cb090 con 0x7fa5f00c36c0 2023-11-20T07:01:52.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5eeffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa5f0069e90 0x7fa5f006a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36446/0 (socket says 172.21.15.88:36446) 2023-11-20T07:01:52.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5eeffd640 1 -- 172.21.15.88:0/699458495 learned_addr learned my addr 172.21.15.88:0/699458495 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:52.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ef7fe640 1 --2- 172.21.15.88:0/699458495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5f00c36c0 0x7fa5f0165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827575395 0 0) 0x7fa5f015ae30 con 0x7fa5f0069e90 2023-11-20T07:01:52.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5dc003530 con 0x7fa5f0069e90 2023-11-20T07:01:52.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4109600997 0 0) 0x7fa5dc003530 con 0x7fa5f0069e90 2023-11-20T07:01:52.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5f00c36c0 msgr2=0x7fa5f0165570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:52.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 --2- 172.21.15.88:0/699458495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5f00c36c0 0x7fa5f0165570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 >> v1:172.21.15.175:6789/0 conn(0x7fa5f006d010 legacy=0x7fa5f00c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00ca7f0 con 0x7fa5f0069e90 2023-11-20T07:01:52.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fa5e0001680 con 0x7fa5f0069e90 2023-11-20T07:01:52.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 >> v1:172.21.15.88:6789/0 conn(0x7fa5f0069e90 legacy=0x7fa5f006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 --2- 172.21.15.88:0/699458495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5dc0039b0 0x7fa5dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 --2- 172.21.15.88:0/699458495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5f00c36c0 0x7fa5dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 --2- 172.21.15.88:0/699458495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc004d10 0x7fa5dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00cb090 con 0x7fa5dc004d10 2023-11-20T07:01:52.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc00b9c0 con 0x7fa5dc0039b0 2023-11-20T07:01:52.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc00bb80 con 0x7fa5f00c36c0 2023-11-20T07:01:52.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ef7fe640 1 --2- 172.21.15.88:0/699458495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc004d10 0x7fa5dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5eeffd640 1 --2- 172.21.15.88:0/699458495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5dc0039b0 0x7fa5dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5e67fc640 1 --2- 172.21.15.88:0/699458495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5f00c36c0 0x7fa5dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ef7fe640 1 -- 172.21.15.88:0/699458495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5f00c36c0 msgr2=0x7fa5dc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:52.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.289+0000 7fa5ef7fe640 1 --2- 172.21.15.88:0/699458495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5f00c36c0 0x7fa5dc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5ef7fe640 1 -- 172.21.15.88:0/699458495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5dc0039b0 msgr2=0x7fa5dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:52.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5ef7fe640 1 --2- 172.21.15.88:0/699458495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5dc0039b0 0x7fa5dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5ef7fe640 1 -- 172.21.15.88:0/699458495 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc003530 con 0x7fa5dc004d10 2023-11-20T07:01:52.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5ef7fe640 1 --2- 172.21.15.88:0/699458495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc004d10 0x7fa5dc005190 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009f90 tx=0x7fa5e801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1f7009c36f0188 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:52.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80a5c30 con 0x7fa5dc004d10 2023-11-20T07:01:52.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e800f040 con 0x7fa5dc004d10 2023-11-20T07:01:52.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5ee7fc640 1 -- 172.21.15.88:0/699458495 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80ad440 con 0x7fa5dc004d10 2023-11-20T07:01:52.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5f55c5640 1 -- 172.21.15.88:0/699458495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc004d10 msgr2=0x7fa5dc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5f55c5640 1 --2- 172.21.15.88:0/699458495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc004d10 0x7fa5dc005190 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009f90 tx=0x7fa5e801cc20 comp rx=0 tx=0).stop 2023-11-20T07:01:52.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5ef7fe640 1 -- 172.21.15.88:0/699458495 reap_dead start 2023-11-20T07:01:52.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5f55c5640 1 -- 172.21.15.88:0/699458495 shutdown_connections 2023-11-20T07:01:52.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5f55c5640 1 -- 172.21.15.88:0/699458495 >> 172.21.15.88:0/699458495 conn(0x7fa5f00b0da0 msgr2=0x7fa5f00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:52.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5f55c5640 1 -- 172.21.15.88:0/699458495 shutdown_connections 2023-11-20T07:01:52.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.293+0000 7fa5f55c5640 1 -- 172.21.15.88:0/699458495 wait complete. 2023-11-20T07:01:52.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5f55c5640 1 Processor -- start 2023-11-20T07:01:52.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5f55c5640 1 -- start start 2023-11-20T07:01:52.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5f55c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc004d10 0x7fa5f00cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5f55c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5f00ce7a0 0x7fa5f00c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5f55c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5f00c5b10 0x7fa5f00c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5f55c5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00ccc50 con 0x7fa5dc004d10 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5f55c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00cce80 con 0x7fa5f00c5b10 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5f55c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00cd160 con 0x7fa5f00ce7a0 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5eeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc004d10 0x7fa5f00cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5eeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc004d10 0x7fa5f00cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38224/0 (socket says 172.21.15.88:38224) 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5eeffd640 1 -- 172.21.15.88:0/1403721692 learned_addr learned my addr 172.21.15.88:0/1403721692 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5eeffd640 1 -- 172.21.15.88:0/1403721692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5f00ce7a0 msgr2=0x7fa5f00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5eeffd640 1 --2- 172.21.15.88:0/1403721692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5f00ce7a0 0x7fa5f00c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5eeffd640 1 -- 172.21.15.88:0/1403721692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5f00c5b10 msgr2=0x7fa5f00c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5eeffd640 1 --2- 172.21.15.88:0/1403721692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5f00c5b10 0x7fa5f00c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5eeffd640 1 -- 172.21.15.88:0/1403721692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00cd440 con 0x7fa5dc004d10 2023-11-20T07:01:52.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5eeffd640 1 --2- 172.21.15.88:0/1403721692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc004d10 0x7fa5f00cc710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000e780 tx=0x7fa5e000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:52.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5e7fff640 1 -- 172.21.15.88:0/1403721692 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000ee90 con 0x7fa5dc004d10 2023-11-20T07:01:52.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5e7fff640 1 -- 172.21.15.88:0/1403721692 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e000c850 con 0x7fa5dc004d10 2023-11-20T07:01:52.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5f55c5640 1 -- 172.21.15.88:0/1403721692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00cd720 con 0x7fa5dc004d10 2023-11-20T07:01:52.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5e7fff640 1 -- 172.21.15.88:0/1403721692 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000cc00 con 0x7fa5dc004d10 2023-11-20T07:01:52.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.297+0000 7fa5f55c5640 1 -- 172.21.15.88:0/1403721692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f00c64d0 con 0x7fa5dc004d10 2023-11-20T07:01:52.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.301+0000 7fa5f55c5640 1 -- 172.21.15.88:0/1403721692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f00cdc40 con 0x7fa5dc004d10 2023-11-20T07:01:52.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.301+0000 7fa5e7fff640 1 -- 172.21.15.88:0/1403721692 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa5e001d460 con 0x7fa5dc004d10 2023-11-20T07:01:52.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.301+0000 7fa5e7fff640 1 --2- 172.21.15.88:0/1403721692 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa5d00664a0 0x7fa5d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.301+0000 7fa5e7fff640 1 -- 172.21.15.88:0/1403721692 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa5e0084170 con 0x7fa5dc004d10 2023-11-20T07:01:52.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.301+0000 7fa5e67fc640 1 --2- 172.21.15.88:0/1403721692 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa5d00664a0 0x7fa5d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.301+0000 7fa5e67fc640 1 --2- 172.21.15.88:0/1403721692 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa5d00664a0 0x7fa5d0068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00ad600 tx=0x7fa5d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:52.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.305+0000 7fa5e7fff640 1 -- 172.21.15.88:0/1403721692 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5f00cdc40 con 0x7fa5dc004d10 2023-11-20T07:01:52.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.453+0000 7fa5f55c5640 1 -- 172.21.15.88:0/1403721692 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5f00cdc40 con 0x7fa5dc004d10 2023-11-20T07:01:52.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.453+0000 7fa5e7fff640 1 -- 172.21.15.88:0/1403721692 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5f00cdc40 con 0x7fa5dc004d10 2023-11-20T07:01:52.456 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:52.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.457+0000 7fa5f55c5640 1 -- 172.21.15.88:0/1403721692 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa5d00664a0 msgr2=0x7fa5d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.457+0000 7fa5f55c5640 1 --2- 172.21.15.88:0/1403721692 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa5d00664a0 0x7fa5d0068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00ad600 tx=0x7fa5d8009040 comp rx=0 tx=0).stop 2023-11-20T07:01:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.457+0000 7fa5f55c5640 1 -- 172.21.15.88:0/1403721692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc004d10 msgr2=0x7fa5f00cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.457+0000 7fa5f55c5640 1 --2- 172.21.15.88:0/1403721692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc004d10 0x7fa5f00cc710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000e780 tx=0x7fa5e000ec40 comp rx=0 tx=0).stop 2023-11-20T07:01:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.457+0000 7fa5f55c5640 1 -- 172.21.15.88:0/1403721692 shutdown_connections 2023-11-20T07:01:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.457+0000 7fa5f55c5640 1 --2- 172.21.15.88:0/1403721692 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa5d00664a0 0x7fa5d0068960 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.457+0000 7fa5f55c5640 1 --2- 172.21.15.88:0/1403721692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5f00ce7a0 0x7fa5f00c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.457+0000 7fa5f55c5640 1 --2- 172.21.15.88:0/1403721692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5f00c5b10 0x7fa5f00c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.457+0000 7fa5f55c5640 1 --2- 172.21.15.88:0/1403721692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc004d10 0x7fa5f00cc710 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.457+0000 7fa5f55c5640 1 -- 172.21.15.88:0/1403721692 >> 172.21.15.88:0/1403721692 conn(0x7fa5f00b0da0 msgr2=0x7fa5f00c2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.457+0000 7fa5f55c5640 1 -- 172.21.15.88:0/1403721692 shutdown_connections 2023-11-20T07:01:52.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.457+0000 7fa5f55c5640 1 -- 172.21.15.88:0/1403721692 wait complete. 2023-11-20T07:01:52.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:52.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcba49b7640 1 Processor -- start 2023-11-20T07:01:52.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcba49b7640 1 -- start start 2023-11-20T07:01:52.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcba49b7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcba00cd910 0x7fcba00d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcba49b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcba00d2b80 0x7fcba006ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcba49b7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba015ce60 con 0x7fcba015ca80 2023-11-20T07:01:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcba49b7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba006b310 con 0x7fcba00cd910 2023-11-20T07:01:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcba49b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba006b5f0 con 0x7fcba00d2b80 2023-11-20T07:01:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcb9f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcba00d2b80 0x7fcba006ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcb9e59c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcba00cd910 0x7fcba00d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcb9f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcba00d2b80 0x7fcba006ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:59626/0 (socket says 172.21.15.88:59626) 2023-11-20T07:01:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcb9f59e640 1 -- 172.21.15.88:0/2935986585 learned_addr learned my addr 172.21.15.88:0/2935986585 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcb9ed9d640 1 --1- 172.21.15.88:0/2935986585 >> v1:172.21.15.175:6789/0 conn(0x7fcba015ca80 0x7fcba00cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:45756/0 (socket says 172.21.15.88:45756) 2023-11-20T07:01:52.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcb9e59c640 1 -- 172.21.15.88:0/2935986585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcba00d2b80 msgr2=0x7fcba006ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:52.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcb9e59c640 1 --2- 172.21.15.88:0/2935986585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcba00d2b80 0x7fcba006ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcb9e59c640 1 -- 172.21.15.88:0/2935986585 >> v1:172.21.15.175:6789/0 conn(0x7fcba015ca80 legacy=0x7fcba00cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcb9e59c640 1 -- 172.21.15.88:0/2935986585 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba00cf160 con 0x7fcba00cd910 2023-11-20T07:01:52.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.617+0000 7fcb9f59e640 1 --2- 172.21.15.88:0/2935986585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcba00d2b80 0x7fcba006ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:52.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.621+0000 7fcb9e59c640 1 --2- 172.21.15.88:0/2935986585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcba00cd910 0x7fcba00d2640 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcb940097c0 tx=0x7fcb9401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4534c3df017d090c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:52.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.621+0000 7fcb9dd9b640 1 -- 172.21.15.88:0/2935986585 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb940ab5f0 con 0x7fcba00cd910 2023-11-20T07:01:52.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.621+0000 7fcb9dd9b640 1 -- 172.21.15.88:0/2935986585 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb940ab750 con 0x7fcba00cd910 2023-11-20T07:01:52.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.621+0000 7fcb9dd9b640 1 -- 172.21.15.88:0/2935986585 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb940abae0 con 0x7fcba00cd910 2023-11-20T07:01:52.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.621+0000 7fcba49b7640 1 -- 172.21.15.88:0/2935986585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcba00cd910 msgr2=0x7fcba00d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.621+0000 7fcba49b7640 1 --2- 172.21.15.88:0/2935986585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcba00cd910 0x7fcba00d2640 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcb940097c0 tx=0x7fcb9401c3f0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.621+0000 7fcba49b7640 1 -- 172.21.15.88:0/2935986585 shutdown_connections 2023-11-20T07:01:52.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.621+0000 7fcba49b7640 1 --2- 172.21.15.88:0/2935986585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcba00d2b80 0x7fcba006ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.621+0000 7fcba49b7640 1 --2- 172.21.15.88:0/2935986585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcba00cd910 0x7fcba00d2640 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.621+0000 7fcba49b7640 1 -- 172.21.15.88:0/2935986585 >> 172.21.15.88:0/2935986585 conn(0x7fcba008c230 msgr2=0x7fcba009bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:52.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.621+0000 7fcba49b7640 1 -- 172.21.15.88:0/2935986585 shutdown_connections 2023-11-20T07:01:52.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.621+0000 7fcba49b7640 1 -- 172.21.15.88:0/2935986585 wait complete. 2023-11-20T07:01:52.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcba49b7640 1 Processor -- start 2023-11-20T07:01:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcba49b7640 1 -- start start 2023-11-20T07:01:52.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcba49b7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcba00cd910 0x7fcba0152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcba49b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcba00d2b80 0x7fcba015e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcba49b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcba015ca80 0x7fcba00c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcba49b7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba0152f70 con 0x7fcba00cd910 2023-11-20T07:01:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcba49b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba0153430 con 0x7fcba015ca80 2023-11-20T07:01:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcba49b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba0153710 con 0x7fcba00d2b80 2023-11-20T07:01:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcb9ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcba00cd910 0x7fcba0152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcb9ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcba00cd910 0x7fcba0152a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38238/0 (socket says 172.21.15.88:38238) 2023-11-20T07:01:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcb9ed9d640 1 -- 172.21.15.88:0/1066867780 learned_addr learned my addr 172.21.15.88:0/1066867780 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcb9ed9d640 1 -- 172.21.15.88:0/1066867780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcba00d2b80 msgr2=0x7fcba015e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcb9ed9d640 1 --2- 172.21.15.88:0/1066867780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcba00d2b80 0x7fcba015e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcb9ed9d640 1 -- 172.21.15.88:0/1066867780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcba015ca80 msgr2=0x7fcba00c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcb9ed9d640 1 --2- 172.21.15.88:0/1066867780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcba015ca80 0x7fcba00c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcb9ed9d640 1 -- 172.21.15.88:0/1066867780 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb98009b30 con 0x7fcba00cd910 2023-11-20T07:01:52.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcb9ed9d640 1 --2- 172.21.15.88:0/1066867780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcba00cd910 0x7fcba0152a30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000c3e0 tx=0x7fcb9000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:52.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcb877fe640 1 -- 172.21.15.88:0/1066867780 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90005c80 con 0x7fcba00cd910 2023-11-20T07:01:52.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcb877fe640 1 -- 172.21.15.88:0/1066867780 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb90005de0 con 0x7fcba00cd910 2023-11-20T07:01:52.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcb877fe640 1 -- 172.21.15.88:0/1066867780 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb900072d0 con 0x7fcba00cd910 2023-11-20T07:01:52.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcba49b7640 1 -- 172.21.15.88:0/1066867780 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb94009420 con 0x7fcba00cd910 2023-11-20T07:01:52.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.625+0000 7fcba49b7640 1 -- 172.21.15.88:0/1066867780 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba0153cd0 con 0x7fcba00cd910 2023-11-20T07:01:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.629+0000 7fcba49b7640 1 -- 172.21.15.88:0/1066867780 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba004e9c0 con 0x7fcba00cd910 2023-11-20T07:01:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.629+0000 7fcb877fe640 1 -- 172.21.15.88:0/1066867780 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcb90007430 con 0x7fcba00cd910 2023-11-20T07:01:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.629+0000 7fcb877fe640 1 --2- 172.21.15.88:0/1066867780 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcb8c0664d0 0x7fcb8c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.629+0000 7fcb877fe640 1 -- 172.21.15.88:0/1066867780 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb900834d0 con 0x7fcba00cd910 2023-11-20T07:01:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.629+0000 7fcb9e59c640 1 --2- 172.21.15.88:0/1066867780 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcb8c0664d0 0x7fcb8c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.629+0000 7fcb9e59c640 1 --2- 172.21.15.88:0/1066867780 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcb8c0664d0 0x7fcb8c068990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcb940af000 tx=0x7fcb94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:52.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.633+0000 7fcb877fe640 1 -- 172.21.15.88:0/1066867780 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcb90050640 con 0x7fcba00cd910 2023-11-20T07:01:52.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 -- 172.21.15.88:0/1066867780 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcba00cccb0 con 0x7fcba00cd910 2023-11-20T07:01:52.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcb877fe640 1 -- 172.21.15.88:0/1066867780 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb90053c60 con 0x7fcba00cd910 2023-11-20T07:01:52.786 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:52.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 -- 172.21.15.88:0/1066867780 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcb8c0664d0 msgr2=0x7fcb8c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 --2- 172.21.15.88:0/1066867780 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcb8c0664d0 0x7fcb8c068990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcb940af000 tx=0x7fcb94008040 comp rx=0 tx=0).stop 2023-11-20T07:01:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 -- 172.21.15.88:0/1066867780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcba00cd910 msgr2=0x7fcba0152a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 --2- 172.21.15.88:0/1066867780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcba00cd910 0x7fcba0152a30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcb9000c3e0 tx=0x7fcb9000c8a0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 -- 172.21.15.88:0/1066867780 shutdown_connections 2023-11-20T07:01:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 --2- 172.21.15.88:0/1066867780 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcb8c0664d0 0x7fcb8c068990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 --2- 172.21.15.88:0/1066867780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcba00d2b80 0x7fcba015e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 --2- 172.21.15.88:0/1066867780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcba015ca80 0x7fcba00c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 --2- 172.21.15.88:0/1066867780 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcba00cd910 0x7fcba0152a30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 -- 172.21.15.88:0/1066867780 >> 172.21.15.88:0/1066867780 conn(0x7fcba008c230 msgr2=0x7fcba00af930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 -- 172.21.15.88:0/1066867780 shutdown_connections 2023-11-20T07:01:52.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.785+0000 7fcba49b7640 1 -- 172.21.15.88:0/1066867780 wait complete. 2023-11-20T07:01:52.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:52.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.945+0000 7f12fa965640 1 Processor -- start 2023-11-20T07:01:52.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.945+0000 7f12fa965640 1 -- start start 2023-11-20T07:01:52.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.949+0000 7f12fa965640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f12f41590d0 0x7f12f406df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.949+0000 7f12fa965640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f40c9600 con 0x7f12f4070a00 2023-11-20T07:01:52.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.949+0000 7f12fa965640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f40c98e0 con 0x7f12f40c8dd0 2023-11-20T07:01:52.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.949+0000 7f12fa965640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f40c9bc0 con 0x7f12f41590d0 2023-11-20T07:01:52.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.949+0000 7f12f3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f12f41590d0 0x7f12f406df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.949+0000 7f12f3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f12f41590d0 0x7f12f406df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38246/0 (socket says 172.21.15.88:38246) 2023-11-20T07:01:52.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.949+0000 7f12f3fff640 1 -- 172.21.15.88:0/2456241838 learned_addr learned my addr 172.21.15.88:0/2456241838 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:52.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.949+0000 7f12f8f02640 1 --1- 172.21.15.88:0/2456241838 >> v1:172.21.15.88:6789/0 conn(0x7f12f4070a00 0x7f12f40cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36458/0 (socket says 172.21.15.88:36458) 2023-11-20T07:01:52.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.949+0000 7f12f3fff640 1 -- 172.21.15.88:0/2456241838 >> v1:172.21.15.175:6789/0 conn(0x7f12f40c8dd0 legacy=0x7f12f40702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:52.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.949+0000 7f12f3fff640 1 -- 172.21.15.88:0/2456241838 >> v1:172.21.15.88:6789/0 conn(0x7f12f4070a00 legacy=0x7f12f40cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.949+0000 7f12f3fff640 1 -- 172.21.15.88:0/2456241838 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f40c9ea0 con 0x7f12f41590d0 2023-11-20T07:01:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12f3fff640 1 --2- 172.21.15.88:0/2456241838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12f41590d0 0x7f12f406df40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009870 tx=0x7f12e401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f3f00b4e599aeb server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12f2ffd640 1 -- 172.21.15.88:0/2456241838 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e40aa450 con 0x7f12f41590d0 2023-11-20T07:01:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12f2ffd640 1 -- 172.21.15.88:0/2456241838 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e40aa5b0 con 0x7f12f41590d0 2023-11-20T07:01:52.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12f2ffd640 1 -- 172.21.15.88:0/2456241838 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e40aa940 con 0x7f12f41590d0 2023-11-20T07:01:52.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12fa965640 1 -- 172.21.15.88:0/2456241838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12f41590d0 msgr2=0x7f12f406df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12fa965640 1 --2- 172.21.15.88:0/2456241838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12f41590d0 0x7f12f406df40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009870 tx=0x7f12e401c4d0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12fa965640 1 -- 172.21.15.88:0/2456241838 shutdown_connections 2023-11-20T07:01:52.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12fa965640 1 --2- 172.21.15.88:0/2456241838 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12f41590d0 0x7f12f406df40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12fa965640 1 -- 172.21.15.88:0/2456241838 >> 172.21.15.88:0/2456241838 conn(0x7f12f40b0da0 msgr2=0x7f12f40ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:52.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12fa965640 1 -- 172.21.15.88:0/2456241838 shutdown_connections 2023-11-20T07:01:52.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12fa965640 1 -- 172.21.15.88:0/2456241838 wait complete. 2023-11-20T07:01:52.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12fa965640 1 Processor -- start 2023-11-20T07:01:52.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.953+0000 7f12fa965640 1 -- start start 2023-11-20T07:01:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12fa965640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12f4070a00 0x7f12f4151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12fa965640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f40c8dd0 0x7f12f4156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12fa965640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12f41590d0 0x7f12f4159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12fa965640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f41f5090 con 0x7f12f41590d0 2023-11-20T07:01:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12fa965640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f41f8a20 con 0x7f12f40c8dd0 2023-11-20T07:01:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12fa965640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f41f8d00 con 0x7f12f4070a00 2023-11-20T07:01:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f8f02640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12f41590d0 0x7f12f4159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f8f02640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12f41590d0 0x7f12f4159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38258/0 (socket says 172.21.15.88:38258) 2023-11-20T07:01:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f8f02640 1 -- 172.21.15.88:0/1823529684 learned_addr learned my addr 172.21.15.88:0/1823529684 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f37fe640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f40c8dd0 0x7f12f4156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f3fff640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12f4070a00 0x7f12f4151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f8f02640 1 -- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12f4070a00 msgr2=0x7f12f4151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f8f02640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12f4070a00 0x7f12f4151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f8f02640 1 -- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f40c8dd0 msgr2=0x7f12f4156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:52.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f8f02640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f40c8dd0 0x7f12f4156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:52.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f8f02640 1 -- 172.21.15.88:0/1823529684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e40094d0 con 0x7f12f41590d0 2023-11-20T07:01:52.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f8f02640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12f41590d0 0x7f12f4159710 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00c7a0 tx=0x7f12ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:52.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f0ff9640 1 -- 172.21.15.88:0/1823529684 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec00a640 con 0x7f12f41590d0 2023-11-20T07:01:52.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f0ff9640 1 -- 172.21.15.88:0/1823529684 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec00a7a0 con 0x7f12f41590d0 2023-11-20T07:01:52.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12fa965640 1 -- 172.21.15.88:0/1823529684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f40ca820 con 0x7f12f41590d0 2023-11-20T07:01:52.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f0ff9640 1 -- 172.21.15.88:0/1823529684 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec00ab10 con 0x7f12f41590d0 2023-11-20T07:01:52.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12fa965640 1 -- 172.21.15.88:0/1823529684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f41f92c0 con 0x7f12f41590d0 2023-11-20T07:01:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12fa965640 1 -- 172.21.15.88:0/1823529684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f40c9210 con 0x7f12f41590d0 2023-11-20T07:01:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f0ff9640 1 -- 172.21.15.88:0/1823529684 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f12ec00ac70 con 0x7f12f41590d0 2023-11-20T07:01:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.957+0000 7f12f0ff9640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f12e00664a0 0x7f12e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.961+0000 7f12f0ff9640 1 -- 172.21.15.88:0/1823529684 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f12ec0839f0 con 0x7f12f41590d0 2023-11-20T07:01:52.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.961+0000 7f12f3fff640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f12e00664a0 0x7f12e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:52.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.961+0000 7f12f3fff640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f12e00664a0 0x7f12e0068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f12e40ae000 tx=0x7f12e40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:52.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:52.965+0000 7f12f0ff9640 1 -- 172.21.15.88:0/1823529684 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f12f40c9210 con 0x7f12f41590d0 2023-11-20T07:01:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.109+0000 7f12fa965640 1 -- 172.21.15.88:0/1823529684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f12f41f51d0 con 0x7f12f41590d0 2023-11-20T07:01:53.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.109+0000 7f12f0ff9640 1 -- 172.21.15.88:0/1823529684 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f12f41f51d0 con 0x7f12f41590d0 2023-11-20T07:01:53.112 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:53.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.113+0000 7f12fa965640 1 -- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f12e00664a0 msgr2=0x7f12e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.113+0000 7f12fa965640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f12e00664a0 0x7f12e0068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f12e40ae000 tx=0x7f12e40a7000 comp rx=0 tx=0).stop 2023-11-20T07:01:53.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.113+0000 7f12fa965640 1 -- 172.21.15.88:0/1823529684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12f41590d0 msgr2=0x7f12f4159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.113+0000 7f12fa965640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12f41590d0 0x7f12f4159710 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00c7a0 tx=0x7f12ec00cc60 comp rx=0 tx=0).stop 2023-11-20T07:01:53.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.113+0000 7f12fa965640 1 -- 172.21.15.88:0/1823529684 shutdown_connections 2023-11-20T07:01:53.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.113+0000 7f12fa965640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f12e00664a0 0x7f12e0068960 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.113+0000 7f12fa965640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12f41590d0 0x7f12f4159710 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.113+0000 7f12fa965640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12f40c8dd0 0x7f12f4156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.113+0000 7f12fa965640 1 --2- 172.21.15.88:0/1823529684 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12f4070a00 0x7f12f4151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.113+0000 7f12fa965640 1 -- 172.21.15.88:0/1823529684 >> 172.21.15.88:0/1823529684 conn(0x7f12f40b0da0 msgr2=0x7f12f40701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:53.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.113+0000 7f12fa965640 1 -- 172.21.15.88:0/1823529684 shutdown_connections 2023-11-20T07:01:53.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.113+0000 7f12fa965640 1 -- 172.21.15.88:0/1823529684 wait complete. 2023-11-20T07:01:53.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T07:01:53.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.269+0000 7f9985a09640 1 Processor -- start 2023-11-20T07:01:53.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.269+0000 7f9985a09640 1 -- start start 2023-11-20T07:01:53.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f9985a09640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99800d15d0 0x7f99800cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f9985a09640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f99800d3010 0x7f99800c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f9985a09640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99800ce770 con 0x7f998015cb90 2023-11-20T07:01:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f9985a09640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99800d0600 con 0x7f99800d3010 2023-11-20T07:01:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f9985a09640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99800c6450 con 0x7f99800d15d0 2023-11-20T07:01:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f997effd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f998015cb90 0x7f99800d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36466/0 (socket says 172.21.15.88:36466) 2023-11-20T07:01:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f997effd640 1 -- 172.21.15.88:0/4143284190 learned_addr learned my addr 172.21.15.88:0/4143284190 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f997f7fe640 1 --2- 172.21.15.88:0/4143284190 >> v2:172.21.15.88:3300/0 conn(0x7f99800d3010 0x7f99800c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f99767fc640 1 --2- 172.21.15.88:0/4143284190 >> v2:172.21.15.175:3300/0 conn(0x7f99800d15d0 0x7f99800cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f997e7fc640 1 -- 172.21.15.88:0/4143284190 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075770694 0 0) 0x7f99800ce770 con 0x7f998015cb90 2023-11-20T07:01:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f997e7fc640 1 -- 172.21.15.88:0/4143284190 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f996c003530 con 0x7f998015cb90 2023-11-20T07:01:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f997f7fe640 1 -- 172.21.15.88:0/4143284190 >> v2:172.21.15.175:3300/0 conn(0x7f99800d15d0 msgr2=0x7f99800cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f997f7fe640 1 --2- 172.21.15.88:0/4143284190 >> v2:172.21.15.175:3300/0 conn(0x7f99800d15d0 0x7f99800cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f997f7fe640 1 -- 172.21.15.88:0/4143284190 >> v1:172.21.15.88:6789/0 conn(0x7f998015cb90 legacy=0x7f99800d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f997f7fe640 1 -- 172.21.15.88:0/4143284190 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99800d08a0 con 0x7f99800d3010 2023-11-20T07:01:53.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.273+0000 7f997f7fe640 1 --2- 172.21.15.88:0/4143284190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99800d3010 0x7f99800c6c10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f998008a880 tx=0x7f997801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad38f46537891311 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:53.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f997e7fc640 1 -- 172.21.15.88:0/4143284190 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99780a5910 con 0x7f99800d3010 2023-11-20T07:01:53.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f997e7fc640 1 -- 172.21.15.88:0/4143284190 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99780a5a70 con 0x7f99800d3010 2023-11-20T07:01:53.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f997e7fc640 1 -- 172.21.15.88:0/4143284190 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99780a5e00 con 0x7f99800d3010 2023-11-20T07:01:53.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 -- 172.21.15.88:0/4143284190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99800d3010 msgr2=0x7f99800c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 --2- 172.21.15.88:0/4143284190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99800d3010 0x7f99800c6c10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f998008a880 tx=0x7f997801c850 comp rx=0 tx=0).stop 2023-11-20T07:01:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 -- 172.21.15.88:0/4143284190 shutdown_connections 2023-11-20T07:01:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 --2- 172.21.15.88:0/4143284190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99800d3010 0x7f99800c6c10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 --2- 172.21.15.88:0/4143284190 >> v2:172.21.15.175:3300/0 conn(0x7f99800d15d0 0x7f99800cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 -- 172.21.15.88:0/4143284190 >> 172.21.15.88:0/4143284190 conn(0x7f998009bc50 msgr2=0x7f99800d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 -- 172.21.15.88:0/4143284190 shutdown_connections 2023-11-20T07:01:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 -- 172.21.15.88:0/4143284190 wait complete. 2023-11-20T07:01:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 Processor -- start 2023-11-20T07:01:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 -- start start 2023-11-20T07:01:53.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99800d15d0 0x7f9980155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99800d3010 0x7f99800b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998015cb90 0x7f9980158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9980156200 con 0x7f99800d15d0 2023-11-20T07:01:53.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9980141d30 con 0x7f99800d3010 2023-11-20T07:01:53.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f9985a09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9980142010 con 0x7f998015cb90 2023-11-20T07:01:53.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f997effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99800d15d0 0x7f9980155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f997effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99800d15d0 0x7f9980155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38282/0 (socket says 172.21.15.88:38282) 2023-11-20T07:01:53.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.277+0000 7f997effd640 1 -- 172.21.15.88:0/2712858980 learned_addr learned my addr 172.21.15.88:0/2712858980 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:53.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f997effd640 1 -- 172.21.15.88:0/2712858980 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998015cb90 msgr2=0x7f9980158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f997effd640 1 --2- 172.21.15.88:0/2712858980 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998015cb90 0x7f9980158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f997effd640 1 -- 172.21.15.88:0/2712858980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99800d3010 msgr2=0x7f99800b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f997effd640 1 --2- 172.21.15.88:0/2712858980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99800d3010 0x7f99800b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f997effd640 1 -- 172.21.15.88:0/2712858980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978009a70 con 0x7f99800d15d0 2023-11-20T07:01:53.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f997effd640 1 --2- 172.21.15.88:0/2712858980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99800d15d0 0x7f9980155cc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9968001270 tx=0x7f996800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:53.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f997cff9640 1 -- 172.21.15.88:0/2712858980 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99680074e0 con 0x7f99800d15d0 2023-11-20T07:01:53.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f997cff9640 1 -- 172.21.15.88:0/2712858980 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9968007640 con 0x7f99800d15d0 2023-11-20T07:01:53.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f997cff9640 1 -- 172.21.15.88:0/2712858980 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99680059b0 con 0x7f99800d15d0 2023-11-20T07:01:53.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f9985a09640 1 -- 172.21.15.88:0/2712858980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99801422f0 con 0x7f99800d15d0 2023-11-20T07:01:53.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f9985a09640 1 -- 172.21.15.88:0/2712858980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99801428b0 con 0x7f99800d15d0 2023-11-20T07:01:53.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f9985a09640 1 -- 172.21.15.88:0/2712858980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9980142aa0 con 0x7f99800d15d0 2023-11-20T07:01:53.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f997cff9640 1 -- 172.21.15.88:0/2712858980 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9968005b10 con 0x7f99800d15d0 2023-11-20T07:01:53.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f997cff9640 1 --2- 172.21.15.88:0/2712858980 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99600664a0 0x7f9960068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.281+0000 7f997cff9640 1 -- 172.21.15.88:0/2712858980 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9968083870 con 0x7f99800d15d0 2023-11-20T07:01:53.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.285+0000 7f99767fc640 1 --2- 172.21.15.88:0/2712858980 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99600664a0 0x7f9960068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.285+0000 7f99767fc640 1 --2- 172.21.15.88:0/2712858980 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99600664a0 0x7f9960068960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f99800cc2f0 tx=0x7f9970008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:53.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.285+0000 7f997cff9640 1 -- 172.21.15.88:0/2712858980 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f99680543c0 con 0x7f99800d15d0 2023-11-20T07:01:53.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 -- 172.21.15.88:0/2712858980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9980074010 con 0x7f99800d15d0 2023-11-20T07:01:53.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f997cff9640 1 -- 172.21.15.88:0/2712858980 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9968017020 con 0x7f99800d15d0 2023-11-20T07:01:53.450 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-20T07:01:53.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 -- 172.21.15.88:0/2712858980 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99600664a0 msgr2=0x7f9960068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 --2- 172.21.15.88:0/2712858980 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99600664a0 0x7f9960068960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f99800cc2f0 tx=0x7f9970008040 comp rx=0 tx=0).stop 2023-11-20T07:01:53.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 -- 172.21.15.88:0/2712858980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99800d15d0 msgr2=0x7f9980155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 --2- 172.21.15.88:0/2712858980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99800d15d0 0x7f9980155cc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9968001270 tx=0x7f996800c8e0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 -- 172.21.15.88:0/2712858980 shutdown_connections 2023-11-20T07:01:53.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 --2- 172.21.15.88:0/2712858980 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99600664a0 0x7f9960068960 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 --2- 172.21.15.88:0/2712858980 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f998015cb90 0x7f9980158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 --2- 172.21.15.88:0/2712858980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99800d3010 0x7f99800b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 --2- 172.21.15.88:0/2712858980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99800d15d0 0x7f9980155cc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 -- 172.21.15.88:0/2712858980 >> 172.21.15.88:0/2712858980 conn(0x7f998009bc50 msgr2=0x7f99800d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:53.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 -- 172.21.15.88:0/2712858980 shutdown_connections 2023-11-20T07:01:53.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.449+0000 7f9985a09640 1 -- 172.21.15.88:0/2712858980 wait complete. 2023-11-20T07:01:53.472 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:01:53.472 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:53.482 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:53.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff745fb5640 1 Processor -- start 2023-11-20T07:01:53.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff745fb5640 1 -- start start 2023-11-20T07:01:53.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff745fb5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff7400d3170 0x7ff7400d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff745fb5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400cefe0 0x7ff7400cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff745fb5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7400ce730 con 0x7ff74015c910 2023-11-20T07:01:53.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff745fb5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7400cf9d0 con 0x7ff7400d3170 2023-11-20T07:01:53.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff745fb5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400ce540 con 0x7ff7400cefe0 2023-11-20T07:01:53.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff744fb3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff74015c910 0x7ff7400cde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36470/0 (socket says 172.21.15.88:36470) 2023-11-20T07:01:53.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff744fb3640 1 -- 172.21.15.88:0/501193453 learned_addr learned my addr 172.21.15.88:0/501193453 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:53.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73ffff640 1 --2- 172.21.15.88:0/501193453 >> v2:172.21.15.175:3300/0 conn(0x7ff7400d3170 0x7ff7400d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff7457b4640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400cefe0 0x7ff7400cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182390175 0 0) 0x7ff7400ce730 con 0x7ff74015c910 2023-11-20T07:01:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff730003530 con 0x7ff74015c910 2023-11-20T07:01:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1709181347 0 0) 0x7ff730003530 con 0x7ff74015c910 2023-11-20T07:01:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400cefe0 msgr2=0x7ff7400cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400cefe0 0x7ff7400cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 >> v2:172.21.15.175:3300/0 conn(0x7ff7400d3170 msgr2=0x7ff7400d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 --2- 172.21.15.88:0/501193453 >> v2:172.21.15.175:3300/0 conn(0x7ff7400d3170 0x7ff7400d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7400d0dd0 con 0x7ff74015c910 2023-11-20T07:01:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7ff734001800 con 0x7ff74015c910 2023-11-20T07:01:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 >> v1:172.21.15.88:6789/0 conn(0x7ff74015c910 legacy=0x7ff7400cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff730003a90 0x7ff730003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7300047d0 0x7ff730004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400cefe0 0x7ff730005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400cf9d0 con 0x7ff7300047d0 2023-11-20T07:01:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73000ba40 con 0x7ff730003a90 2023-11-20T07:01:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73000bc00 con 0x7ff7400cefe0 2023-11-20T07:01:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73ffff640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7300047d0 0x7ff730004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff7457b4640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400cefe0 0x7ff730005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff744fb3640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff730003a90 0x7ff730003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73ffff640 1 -- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400cefe0 msgr2=0x7ff730005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73ffff640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400cefe0 0x7ff730005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73ffff640 1 -- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff730003a90 msgr2=0x7ff730003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73ffff640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff730003a90 0x7ff730003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff73ffff640 1 -- 172.21.15.88:0/501193453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730003530 con 0x7ff7300047d0 2023-11-20T07:01:53.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff7457b4640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400cefe0 0x7ff730005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:53.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.621+0000 7ff744fb3640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff730003a90 0x7ff730003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.625+0000 7ff73ffff640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7300047d0 0x7ff730004c50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff7400d35b0 tx=0x7ff72c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101eae635c1ba573 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.625+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c0a8450 con 0x7ff7300047d0 2023-11-20T07:01:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.625+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c0a85b0 con 0x7ff7300047d0 2023-11-20T07:01:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.625+0000 7ff73f7fe640 1 -- 172.21.15.88:0/501193453 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c0a8920 con 0x7ff7300047d0 2023-11-20T07:01:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.625+0000 7ff745fb5640 1 -- 172.21.15.88:0/501193453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7300047d0 msgr2=0x7ff730004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.625+0000 7ff745fb5640 1 --2- 172.21.15.88:0/501193453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7300047d0 0x7ff730004c50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff7400d35b0 tx=0x7ff72c01ca10 comp rx=0 tx=0).stop 2023-11-20T07:01:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.625+0000 7ff7457b4640 1 -- 172.21.15.88:0/501193453 reap_dead start 2023-11-20T07:01:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.625+0000 7ff745fb5640 1 -- 172.21.15.88:0/501193453 shutdown_connections 2023-11-20T07:01:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.625+0000 7ff745fb5640 1 -- 172.21.15.88:0/501193453 >> 172.21.15.88:0/501193453 conn(0x7ff74009bb50 msgr2=0x7ff7400d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:53.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.625+0000 7ff745fb5640 1 -- 172.21.15.88:0/501193453 shutdown_connections 2023-11-20T07:01:53.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.625+0000 7ff745fb5640 1 -- 172.21.15.88:0/501193453 wait complete. 2023-11-20T07:01:53.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff745fb5640 1 Processor -- start 2023-11-20T07:01:53.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff745fb5640 1 -- start start 2023-11-20T07:01:53.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff745fb5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7300047d0 0x7ff740156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff745fb5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400b7f70 0x7ff7401f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff745fb5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff740155ff0 0x7ff7400b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff745fb5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c9bc0 con 0x7ff740155ff0 2023-11-20T07:01:53.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff745fb5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c9ea0 con 0x7ff7300047d0 2023-11-20T07:01:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff745fb5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400ca180 con 0x7ff7400b7f70 2023-11-20T07:01:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff7457b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff740155ff0 0x7ff7400b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff7457b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff740155ff0 0x7ff7400b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38300/0 (socket says 172.21.15.88:38300) 2023-11-20T07:01:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff7457b4640 1 -- 172.21.15.88:0/53462904 learned_addr learned my addr 172.21.15.88:0/53462904 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff73ffff640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400b7f70 0x7ff7401f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff744fb3640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7300047d0 0x7ff740156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff7457b4640 1 -- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400b7f70 msgr2=0x7ff7401f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff7457b4640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400b7f70 0x7ff7401f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff7457b4640 1 -- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7300047d0 msgr2=0x7ff740156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff7457b4640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7300047d0 0x7ff740156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff7457b4640 1 -- 172.21.15.88:0/53462904 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7400ca460 con 0x7ff740155ff0 2023-11-20T07:01:53.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff7457b4640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff740155ff0 0x7ff7400b4270 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff7400d2420 tx=0x7ff738010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:53.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff73d7fa640 1 -- 172.21.15.88:0/53462904 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73801b070 con 0x7ff740155ff0 2023-11-20T07:01:53.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff73d7fa640 1 -- 172.21.15.88:0/53462904 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73800f040 con 0x7ff740155ff0 2023-11-20T07:01:53.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff745fb5640 1 -- 172.21.15.88:0/53462904 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7400ca740 con 0x7ff740155ff0 2023-11-20T07:01:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff73d7fa640 1 -- 172.21.15.88:0/53462904 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73800e050 con 0x7ff740155ff0 2023-11-20T07:01:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.629+0000 7ff745fb5640 1 -- 172.21.15.88:0/53462904 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7400c9870 con 0x7ff740155ff0 2023-11-20T07:01:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.633+0000 7ff745fb5640 1 -- 172.21.15.88:0/53462904 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff740161370 con 0x7ff740155ff0 2023-11-20T07:01:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.633+0000 7ff73d7fa640 1 -- 172.21.15.88:0/53462904 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff7380039a0 con 0x7ff740155ff0 2023-11-20T07:01:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.633+0000 7ff73d7fa640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff7240664a0 0x7ff724068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.633+0000 7ff73d7fa640 1 -- 172.21.15.88:0/53462904 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff7380845d0 con 0x7ff740155ff0 2023-11-20T07:01:53.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.633+0000 7ff744fb3640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff7240664a0 0x7ff724068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.633+0000 7ff744fb3640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff7240664a0 0x7ff724068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff7340010f0 tx=0x7ff734009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:53.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.637+0000 7ff73d7fa640 1 -- 172.21.15.88:0/53462904 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff738051730 con 0x7ff740155ff0 2023-11-20T07:01:53.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.789+0000 7ff745fb5640 1 -- 172.21.15.88:0/53462904 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff74004e9c0 con 0x7ff740155ff0 2023-11-20T07:01:53.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff73d7fa640 1 -- 172.21.15.88:0/53462904 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7ff738054d50 con 0x7ff740155ff0 2023-11-20T07:01:53.793 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:53.793 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff745fb5640 1 -- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff7240664a0 msgr2=0x7ff724068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff745fb5640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff7240664a0 0x7ff724068960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff7340010f0 tx=0x7ff734009040 comp rx=0 tx=0).stop 2023-11-20T07:01:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff745fb5640 1 -- 172.21.15.88:0/53462904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff740155ff0 msgr2=0x7ff7400b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff745fb5640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff740155ff0 0x7ff7400b4270 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff7400d2420 tx=0x7ff738010590 comp rx=0 tx=0).stop 2023-11-20T07:01:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff745fb5640 1 -- 172.21.15.88:0/53462904 shutdown_connections 2023-11-20T07:01:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff745fb5640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff7240664a0 0x7ff724068960 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff745fb5640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7400b7f70 0x7ff7401f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff745fb5640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff740155ff0 0x7ff7400b4270 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff745fb5640 1 --2- 172.21.15.88:0/53462904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7300047d0 0x7ff740156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff745fb5640 1 -- 172.21.15.88:0/53462904 >> 172.21.15.88:0/53462904 conn(0x7ff74009bb50 msgr2=0x7ff7400b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:53.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff745fb5640 1 -- 172.21.15.88:0/53462904 shutdown_connections 2023-11-20T07:01:53.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.793+0000 7ff745fb5640 1 -- 172.21.15.88:0/53462904 wait complete. 2023-11-20T07:01:53.814 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:53.815 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:53.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.953+0000 7f0ea4ac9640 1 Processor -- start 2023-11-20T07:01:53.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.953+0000 7f0ea4ac9640 1 -- start start 2023-11-20T07:01:53.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.953+0000 7f0ea4ac9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ea0069e90 0x7f0ea006d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.953+0000 7f0ea4ac9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0ea006a270 0x7f0ea00c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.953+0000 7f0ea4ac9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea015ae30 con 0x7f0ea00702f0 2023-11-20T07:01:53.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.953+0000 7f0ea4ac9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea00cb090 con 0x7f0ea0069e90 2023-11-20T07:01:53.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.953+0000 7f0ea4ac9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea00ca510 con 0x7f0ea006a270 2023-11-20T07:01:53.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9e59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ea0069e90 0x7f0ea006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9e59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ea0069e90 0x7f0ea006d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38312/0 (socket says 172.21.15.88:38312) 2023-11-20T07:01:53.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9e59c640 1 -- 172.21.15.88:0/3839674222 learned_addr learned my addr 172.21.15.88:0/3839674222 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:53.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9ed9d640 1 --1- 172.21.15.88:0/3839674222 >> v1:172.21.15.88:6789/0 conn(0x7f0ea00702f0 0x7f0ea0070740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36476/0 (socket says 172.21.15.88:36476) 2023-11-20T07:01:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e95d9b640 1 --2- 172.21.15.88:0/3839674222 >> v2:172.21.15.175:3300/0 conn(0x7f0ea006a270 0x7f0ea00c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9e59c640 1 -- 172.21.15.88:0/3839674222 >> v2:172.21.15.175:3300/0 conn(0x7f0ea006a270 msgr2=0x7f0ea00c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9e59c640 1 --2- 172.21.15.88:0/3839674222 >> v2:172.21.15.175:3300/0 conn(0x7f0ea006a270 0x7f0ea00c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9e59c640 1 -- 172.21.15.88:0/3839674222 >> v1:172.21.15.88:6789/0 conn(0x7f0ea00702f0 legacy=0x7f0ea0070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9e59c640 1 -- 172.21.15.88:0/3839674222 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea00ca7f0 con 0x7f0ea0069e90 2023-11-20T07:01:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e95d9b640 1 --2- 172.21.15.88:0/3839674222 >> v2:172.21.15.175:3300/0 conn(0x7f0ea006a270 0x7f0ea00c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:53.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9dd9b640 1 -- 172.21.15.88:0/3839674222 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31977293 0 0) 0x7f0ea015ae30 con 0x7f0ea00702f0 2023-11-20T07:01:53.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9e59c640 1 --2- 172.21.15.88:0/3839674222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ea0069e90 0x7f0ea006d010 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0ea006ada0 tx=0x7f0e9001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f20242cd1dae14 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:53.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9dd9b640 1 -- 172.21.15.88:0/3839674222 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e900a5860 con 0x7f0ea0069e90 2023-11-20T07:01:53.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9dd9b640 1 -- 172.21.15.88:0/3839674222 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e900a59c0 con 0x7f0ea0069e90 2023-11-20T07:01:53.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.957+0000 7f0e9dd9b640 1 -- 172.21.15.88:0/3839674222 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e900a5d50 con 0x7f0ea0069e90 2023-11-20T07:01:53.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/3839674222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ea0069e90 msgr2=0x7f0ea006d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 --2- 172.21.15.88:0/3839674222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ea0069e90 0x7f0ea006d010 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0ea006ada0 tx=0x7f0e9001c9a0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/3839674222 shutdown_connections 2023-11-20T07:01:53.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 --2- 172.21.15.88:0/3839674222 >> v2:172.21.15.175:3300/0 conn(0x7f0ea006a270 0x7f0ea00c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 --2- 172.21.15.88:0/3839674222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ea0069e90 0x7f0ea006d010 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/3839674222 >> 172.21.15.88:0/3839674222 conn(0x7f0ea00b0da0 msgr2=0x7f0ea00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:53.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/3839674222 shutdown_connections 2023-11-20T07:01:53.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/3839674222 wait complete. 2023-11-20T07:01:53.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 Processor -- start 2023-11-20T07:01:53.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 -- start start 2023-11-20T07:01:53.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ea0069e90 0x7f0ea0147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ea006a270 0x7f0ea0158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ea00702f0 0x7f0ea0154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea01f9a40 con 0x7f0ea00702f0 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea01f8b70 con 0x7f0ea0069e90 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0ea4ac9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea01f8dc0 con 0x7f0ea006a270 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0e9ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ea00702f0 0x7f0ea0154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0e9ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ea00702f0 0x7f0ea0154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38324/0 (socket says 172.21.15.88:38324) 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0e9ed9d640 1 -- 172.21.15.88:0/1226233935 learned_addr learned my addr 172.21.15.88:0/1226233935 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0e95d9b640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ea006a270 0x7f0ea0158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0e9e59c640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ea0069e90 0x7f0ea0147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0e9ed9d640 1 -- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ea006a270 msgr2=0x7f0ea0158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.961+0000 7f0e9ed9d640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ea006a270 0x7f0ea0158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0e9ed9d640 1 -- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ea0069e90 msgr2=0x7f0ea0147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:53.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0e9ed9d640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ea0069e90 0x7f0ea0147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:53.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0e9ed9d640 1 -- 172.21.15.88:0/1226233935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e90009b30 con 0x7f0ea00702f0 2023-11-20T07:01:53.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0e9ed9d640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ea00702f0 0x7f0ea0154210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c3f0 tx=0x7f0e9800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:53.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0e977fe640 1 -- 172.21.15.88:0/1226233935 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980074e0 con 0x7f0ea00702f0 2023-11-20T07:01:53.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0e977fe640 1 -- 172.21.15.88:0/1226233935 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98007640 con 0x7f0ea00702f0 2023-11-20T07:01:53.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0e977fe640 1 -- 172.21.15.88:0/1226233935 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98004a30 con 0x7f0ea00702f0 2023-11-20T07:01:53.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/1226233935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea01f90a0 con 0x7f0ea00702f0 2023-11-20T07:01:53.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/1226233935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea01f9660 con 0x7f0ea00702f0 2023-11-20T07:01:53.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/1226233935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea004e170 con 0x7f0ea00702f0 2023-11-20T07:01:53.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0e977fe640 1 -- 172.21.15.88:0/1226233935 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0e98004b90 con 0x7f0ea00702f0 2023-11-20T07:01:53.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0e977fe640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0e800664a0 0x7f0e80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:53.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0e977fe640 1 -- 172.21.15.88:0/1226233935 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e98083eb0 con 0x7f0ea00702f0 2023-11-20T07:01:53.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.965+0000 7f0e9e59c640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0e800664a0 0x7f0e80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:53.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.969+0000 7f0e9e59c640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0e800664a0 0x7f0e80068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0e900ae000 tx=0x7f0e900a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:53.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:53.969+0000 7f0e977fe640 1 -- 172.21.15.88:0/1226233935 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e98054ab0 con 0x7f0ea00702f0 2023-11-20T07:01:54.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/1226233935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ea0165350 con 0x7f0ea00702f0 2023-11-20T07:01:54.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0e977fe640 1 -- 172.21.15.88:0/1226233935 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e98054640 con 0x7f0ea00702f0 2023-11-20T07:01:54.121 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:54.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0e800664a0 msgr2=0x7f0e80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0e800664a0 0x7f0e80068960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0e900ae000 tx=0x7f0e900a7070 comp rx=0 tx=0).stop 2023-11-20T07:01:54.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/1226233935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ea00702f0 msgr2=0x7f0ea0154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ea00702f0 0x7f0ea0154210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c3f0 tx=0x7f0e9800c8b0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/1226233935 shutdown_connections 2023-11-20T07:01:54.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0e800664a0 0x7f0e80068960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ea006a270 0x7f0ea0158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ea00702f0 0x7f0ea0154210 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 --2- 172.21.15.88:0/1226233935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ea0069e90 0x7f0ea0147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/1226233935 >> 172.21.15.88:0/1226233935 conn(0x7f0ea00b0da0 msgr2=0x7f0ea00aba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:54.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/1226233935 shutdown_connections 2023-11-20T07:01:54.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.121+0000 7f0ea4ac9640 1 -- 172.21.15.88:0/1226233935 wait complete. 2023-11-20T07:01:54.142 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:54.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.281+0000 7f6513980640 1 Processor -- start 2023-11-20T07:01:54.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.281+0000 7f6513980640 1 -- start start 2023-11-20T07:01:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.281+0000 7f6513980640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f650c069e90 0x7f650c06d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.281+0000 7f6513980640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f650c06a270 0x7f650c0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.281+0000 7f6513980640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f650c15ae30 con 0x7f650c0702f0 2023-11-20T07:01:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.281+0000 7f6513980640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c0cb090 con 0x7f650c06a270 2023-11-20T07:01:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.281+0000 7f6513980640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0ca510 con 0x7f650c069e90 2023-11-20T07:01:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.281+0000 7f6510f1b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f650c06a270 0x7f650c0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.281+0000 7f6510f1b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f650c06a270 0x7f650c0c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38340/0 (socket says 172.21.15.88:38340) 2023-11-20T07:01:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.285+0000 7f6510f1b640 1 -- 172.21.15.88:0/4085276656 learned_addr learned my addr 172.21.15.88:0/4085276656 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.285+0000 7f651171c640 1 --2- 172.21.15.88:0/4085276656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f650c069e90 0x7f650c06d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.285+0000 7f6510f1b640 1 -- 172.21.15.88:0/4085276656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f650c069e90 msgr2=0x7f650c06d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:54.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.285+0000 7f6510f1b640 1 --2- 172.21.15.88:0/4085276656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f650c069e90 0x7f650c06d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.285+0000 7f6510f1b640 1 -- 172.21.15.88:0/4085276656 >> v1:172.21.15.175:6789/0 conn(0x7f650c0702f0 legacy=0x7f650c070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.285+0000 7f6510f1b640 1 -- 172.21.15.88:0/4085276656 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c0ca7f0 con 0x7f650c06a270 2023-11-20T07:01:54.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.285+0000 7f6510f1b640 1 --2- 172.21.15.88:0/4085276656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650c06a270 0x7f650c0c9ce0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009870 tx=0x7f64fc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63d502e4dc46530 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:54.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.285+0000 7f6503fff640 1 -- 172.21.15.88:0/4085276656 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0aa670 con 0x7f650c06a270 2023-11-20T07:01:54.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.285+0000 7f6503fff640 1 -- 172.21.15.88:0/4085276656 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc0aa7d0 con 0x7f650c06a270 2023-11-20T07:01:54.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.285+0000 7f6503fff640 1 -- 172.21.15.88:0/4085276656 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0aab60 con 0x7f650c06a270 2023-11-20T07:01:54.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 -- 172.21.15.88:0/4085276656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650c06a270 msgr2=0x7f650c0c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 --2- 172.21.15.88:0/4085276656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650c06a270 0x7f650c0c9ce0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009870 tx=0x7f64fc01c510 comp rx=0 tx=0).stop 2023-11-20T07:01:54.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 -- 172.21.15.88:0/4085276656 shutdown_connections 2023-11-20T07:01:54.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 --2- 172.21.15.88:0/4085276656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650c06a270 0x7f650c0c9ce0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 --2- 172.21.15.88:0/4085276656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f650c069e90 0x7f650c06d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 -- 172.21.15.88:0/4085276656 >> 172.21.15.88:0/4085276656 conn(0x7f650c0b0da0 msgr2=0x7f650c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:54.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 -- 172.21.15.88:0/4085276656 shutdown_connections 2023-11-20T07:01:54.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 -- 172.21.15.88:0/4085276656 wait complete. 2023-11-20T07:01:54.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 Processor -- start 2023-11-20T07:01:54.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 -- start start 2023-11-20T07:01:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f650c069e90 0x7f650c152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650c06a270 0x7f650c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f650c0702f0 0x7f650c0cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0c6420 con 0x7f650c06a270 2023-11-20T07:01:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0c6700 con 0x7f650c0702f0 2023-11-20T07:01:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6513980640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c0c69e0 con 0x7f650c069e90 2023-11-20T07:01:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6510f1b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650c06a270 0x7f650c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6510f1b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650c06a270 0x7f650c153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38342/0 (socket says 172.21.15.88:38342) 2023-11-20T07:01:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6510f1b640 1 -- 172.21.15.88:0/3534569024 learned_addr learned my addr 172.21.15.88:0/3534569024 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f651171c640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f650c069e90 0x7f650c152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6511f1d640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f650c0702f0 0x7f650c0cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6510f1b640 1 -- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f650c069e90 msgr2=0x7f650c152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6510f1b640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f650c069e90 0x7f650c152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6510f1b640 1 -- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f650c0702f0 msgr2=0x7f650c0cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6510f1b640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f650c0702f0 0x7f650c0cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6510f1b640 1 -- 172.21.15.88:0/3534569024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0094d0 con 0x7f650c06a270 2023-11-20T07:01:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.289+0000 7f6511f1d640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f650c0702f0 0x7f650c0cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.293+0000 7f6510f1b640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650c06a270 0x7f650c153b40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0ac040 tx=0x7f64fc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:54.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.293+0000 7f6501ffb640 1 -- 172.21.15.88:0/3534569024 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0aa670 con 0x7f650c06a270 2023-11-20T07:01:54.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.293+0000 7f6501ffb640 1 -- 172.21.15.88:0/3534569024 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc0b3820 con 0x7f650c06a270 2023-11-20T07:01:54.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.293+0000 7f6513980640 1 -- 172.21.15.88:0/3534569024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f650c0c6cc0 con 0x7f650c06a270 2023-11-20T07:01:54.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.293+0000 7f6501ffb640 1 -- 172.21.15.88:0/3534569024 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0b3bd0 con 0x7f650c06a270 2023-11-20T07:01:54.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.293+0000 7f6513980640 1 -- 172.21.15.88:0/3534569024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650c1531e0 con 0x7f650c06a270 2023-11-20T07:01:54.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.293+0000 7f6513980640 1 -- 172.21.15.88:0/3534569024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f650c0c6b20 con 0x7f650c06a270 2023-11-20T07:01:54.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.293+0000 7f6501ffb640 1 -- 172.21.15.88:0/3534569024 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f64fc0b3d30 con 0x7f650c06a270 2023-11-20T07:01:54.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.293+0000 7f6501ffb640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f64f00664d0 0x7f64f0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.293+0000 7f6501ffb640 1 -- 172.21.15.88:0/3534569024 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f64fc11ee90 con 0x7f650c06a270 2023-11-20T07:01:54.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.293+0000 7f651171c640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f64f00664d0 0x7f64f0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.297+0000 7f651171c640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f64f00664d0 0x7f64f0068990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6508009b60 tx=0x7f6508009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:54.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.297+0000 7f6501ffb640 1 -- 172.21.15.88:0/3534569024 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f650c0c6b20 con 0x7f650c06a270 2023-11-20T07:01:54.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.449+0000 7f6513980640 1 -- 172.21.15.88:0/3534569024 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f650c0c6b20 con 0x7f650c06a270 2023-11-20T07:01:54.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6501ffb640 1 -- 172.21.15.88:0/3534569024 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f650c0c6b20 con 0x7f650c06a270 2023-11-20T07:01:54.453 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6513980640 1 -- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f64f00664d0 msgr2=0x7f64f0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6513980640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f64f00664d0 0x7f64f0068990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6508009b60 tx=0x7f6508009190 comp rx=0 tx=0).stop 2023-11-20T07:01:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6513980640 1 -- 172.21.15.88:0/3534569024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650c06a270 msgr2=0x7f650c153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6513980640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650c06a270 0x7f650c153b40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f64fc0ac040 tx=0x7f64fc01ad50 comp rx=0 tx=0).stop 2023-11-20T07:01:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6513980640 1 -- 172.21.15.88:0/3534569024 shutdown_connections 2023-11-20T07:01:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6513980640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f64f00664d0 0x7f64f0068990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6513980640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f650c0702f0 0x7f650c0cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6513980640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650c06a270 0x7f650c153b40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6513980640 1 --2- 172.21.15.88:0/3534569024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f650c069e90 0x7f650c152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6513980640 1 -- 172.21.15.88:0/3534569024 >> 172.21.15.88:0/3534569024 conn(0x7f650c0b0da0 msgr2=0x7f650c0ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:54.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6513980640 1 -- 172.21.15.88:0/3534569024 shutdown_connections 2023-11-20T07:01:54.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.453+0000 7f6513980640 1 -- 172.21.15.88:0/3534569024 wait complete. 2023-11-20T07:01:54.474 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:54.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.617+0000 7f663d09a640 1 Processor -- start 2023-11-20T07:01:54.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.617+0000 7f663d09a640 1 -- start start 2023-11-20T07:01:54.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.617+0000 7f663d09a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f663815cc60 0x7f66380cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.617+0000 7f663d09a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66380cc330 con 0x7f66380ceda0 2023-11-20T07:01:54.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.617+0000 7f663d09a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66380cb720 con 0x7f6638161260 2023-11-20T07:01:54.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.617+0000 7f663d09a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66380cba00 con 0x7f663815cc60 2023-11-20T07:01:54.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.617+0000 7f6636d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f663815cc60 0x7f66380cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.617+0000 7f663759e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f66380ceda0 0x7f66380cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36492/0 (socket says 172.21.15.88:36492) 2023-11-20T07:01:54.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.617+0000 7f663759e640 1 -- 172.21.15.88:0/18937263 learned_addr learned my addr 172.21.15.88:0/18937263 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:54.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.617+0000 7f6636d9d640 1 -- 172.21.15.88:0/18937263 >> v1:172.21.15.175:6789/0 conn(0x7f6638161260 legacy=0x7f66380ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:54.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.617+0000 7f6636d9d640 1 -- 172.21.15.88:0/18937263 >> v1:172.21.15.88:6789/0 conn(0x7f66380ceda0 legacy=0x7f66380cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.617+0000 7f6636d9d640 1 -- 172.21.15.88:0/18937263 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66380cbce0 con 0x7f663815cc60 2023-11-20T07:01:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.621+0000 7f6636d9d640 1 --2- 172.21.15.88:0/18937263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f663815cc60 0x7f66380cb040 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f66280097c0 tx=0x7f662801ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8876eca6cd7bf326 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.621+0000 7f663659c640 1 -- 172.21.15.88:0/18937263 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280a7070 con 0x7f663815cc60 2023-11-20T07:01:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.621+0000 7f663659c640 1 -- 172.21.15.88:0/18937263 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66280ab430 con 0x7f663815cc60 2023-11-20T07:01:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.621+0000 7f663659c640 1 -- 172.21.15.88:0/18937263 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280ab7c0 con 0x7f663815cc60 2023-11-20T07:01:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.621+0000 7f663d09a640 1 -- 172.21.15.88:0/18937263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f663815cc60 msgr2=0x7f66380cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.621+0000 7f663d09a640 1 --2- 172.21.15.88:0/18937263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f663815cc60 0x7f66380cb040 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f66280097c0 tx=0x7f662801ce70 comp rx=0 tx=0).stop 2023-11-20T07:01:54.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.621+0000 7f663d09a640 1 -- 172.21.15.88:0/18937263 shutdown_connections 2023-11-20T07:01:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.621+0000 7f663d09a640 1 --2- 172.21.15.88:0/18937263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f663815cc60 0x7f66380cb040 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.621+0000 7f663d09a640 1 -- 172.21.15.88:0/18937263 >> 172.21.15.88:0/18937263 conn(0x7f663806e570 msgr2=0x7f663806e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.621+0000 7f663d09a640 1 -- 172.21.15.88:0/18937263 shutdown_connections 2023-11-20T07:01:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.621+0000 7f663d09a640 1 -- 172.21.15.88:0/18937263 wait complete. 2023-11-20T07:01:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.621+0000 7f663d09a640 1 Processor -- start 2023-11-20T07:01:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f663d09a640 1 -- start start 2023-11-20T07:01:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f663d09a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66380ceda0 0x7f66380b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f663d09a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663815cc60 0x7f66380b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f663d09a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6638161260 0x7f66380afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f663d09a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663815aa70 con 0x7f66380ceda0 2023-11-20T07:01:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f663d09a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663815ad50 con 0x7f6638161260 2023-11-20T07:01:54.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f663d09a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663815b030 con 0x7f663815cc60 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f6636d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66380ceda0 0x7f66380b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f6636d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66380ceda0 0x7f66380b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38350/0 (socket says 172.21.15.88:38350) 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f6636d9d640 1 -- 172.21.15.88:0/3938305414 learned_addr learned my addr 172.21.15.88:0/3938305414 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f663759e640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6638161260 0x7f66380afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f662e59c640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663815cc60 0x7f66380b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f6636d9d640 1 -- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663815cc60 msgr2=0x7f66380b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f6636d9d640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663815cc60 0x7f66380b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f6636d9d640 1 -- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6638161260 msgr2=0x7f66380afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f6636d9d640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6638161260 0x7f66380afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f6636d9d640 1 -- 172.21.15.88:0/3938305414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6628009420 con 0x7f66380ceda0 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f6636d9d640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66380ceda0 0x7f66380b3af0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f662801a040 tx=0x7f662801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f662ffff640 1 -- 172.21.15.88:0/3938305414 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280b4800 con 0x7f66380ceda0 2023-11-20T07:01:54.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f662ffff640 1 -- 172.21.15.88:0/3938305414 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66280b4980 con 0x7f66380ceda0 2023-11-20T07:01:54.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f663d09a640 1 -- 172.21.15.88:0/3938305414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663815b310 con 0x7f66380ceda0 2023-11-20T07:01:54.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f662ffff640 1 -- 172.21.15.88:0/3938305414 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280b4d30 con 0x7f66380ceda0 2023-11-20T07:01:54.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f663d09a640 1 -- 172.21.15.88:0/3938305414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66380b4030 con 0x7f66380ceda0 2023-11-20T07:01:54.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.625+0000 7f663d09a640 1 -- 172.21.15.88:0/3938305414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663804e170 con 0x7f66380ceda0 2023-11-20T07:01:54.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.629+0000 7f662ffff640 1 -- 172.21.15.88:0/3938305414 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f66280b3380 con 0x7f66380ceda0 2023-11-20T07:01:54.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.629+0000 7f662ffff640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f66180664a0 0x7f6618068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.629+0000 7f662ffff640 1 -- 172.21.15.88:0/3938305414 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f662811e470 con 0x7f66380ceda0 2023-11-20T07:01:54.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.629+0000 7f662e59c640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f66180664a0 0x7f6618068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.629+0000 7f662e59c640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f66180664a0 0x7f6618068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6638149200 tx=0x7f6620008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:54.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.633+0000 7f662ffff640 1 -- 172.21.15.88:0/3938305414 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f66280eb520 con 0x7f66380ceda0 2023-11-20T07:01:54.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 -- 172.21.15.88:0/3938305414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66380b6830 con 0x7f66380ceda0 2023-11-20T07:01:54.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f662ffff640 1 -- 172.21.15.88:0/3938305414 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66280eeb40 con 0x7f66380ceda0 2023-11-20T07:01:54.786 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:54.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 -- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f66180664a0 msgr2=0x7f6618068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f66180664a0 0x7f6618068960 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6638149200 tx=0x7f6620008040 comp rx=0 tx=0).stop 2023-11-20T07:01:54.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 -- 172.21.15.88:0/3938305414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66380ceda0 msgr2=0x7f66380b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66380ceda0 0x7f66380b3af0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f662801a040 tx=0x7f662801ac50 comp rx=0 tx=0).stop 2023-11-20T07:01:54.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 -- 172.21.15.88:0/3938305414 shutdown_connections 2023-11-20T07:01:54.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f66180664a0 0x7f6618068960 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f663815cc60 0x7f66380b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6638161260 0x7f66380afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 --2- 172.21.15.88:0/3938305414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66380ceda0 0x7f66380b3af0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 -- 172.21.15.88:0/3938305414 >> 172.21.15.88:0/3938305414 conn(0x7f663806e570 msgr2=0x7f663815d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:54.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 -- 172.21.15.88:0/3938305414 shutdown_connections 2023-11-20T07:01:54.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.785+0000 7f663d09a640 1 -- 172.21.15.88:0/3938305414 wait complete. 2023-11-20T07:01:54.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:54.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.945+0000 7f34b359e640 1 Processor -- start 2023-11-20T07:01:54.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.945+0000 7f34b359e640 1 -- start start 2023-11-20T07:01:54.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b359e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b40b3cb0 0x7f34b40cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b359e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b40d0880 con 0x7f34b40cf210 2023-11-20T07:01:54.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b359e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b40b1c00 con 0x7f34b415cdc0 2023-11-20T07:01:54.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b359e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b40b1ee0 con 0x7f34b40b3cb0 2023-11-20T07:01:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b259c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f34b40cf210 0x7f34b40cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36498/0 (socket says 172.21.15.88:36498) 2023-11-20T07:01:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b259c640 1 -- 172.21.15.88:0/4276983651 learned_addr learned my addr 172.21.15.88:0/4276983651 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b2d9d640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b40b3cb0 0x7f34b40cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882983283 0 0) 0x7f34b40d0880 con 0x7f34b40cf210 2023-11-20T07:01:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f349c003530 con 0x7f34b40cf210 2023-11-20T07:01:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889084230 0 0) 0x7f34b40b1c00 con 0x7f34b415cdc0 2023-11-20T07:01:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34b40d0880 con 0x7f34b415cdc0 2023-11-20T07:01:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4067581813 0 0) 0x7f349c003530 con 0x7f34b40cf210 2023-11-20T07:01:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b40b3cb0 msgr2=0x7f34b40cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b40b3cb0 0x7f34b40cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 >> v1:172.21.15.175:6789/0 conn(0x7f34b415cdc0 legacy=0x7f34b40cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b40b21c0 con 0x7f34b40cf210 2023-11-20T07:01:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f34a4001800 con 0x7f34b40cf210 2023-11-20T07:01:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 >> v1:172.21.15.88:6789/0 conn(0x7f34b40cf210 legacy=0x7f34b40cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349c003b40 0x7f349c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f349c0047d0 0x7f349c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f349c005190 0x7f349c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b40b1ee0 con 0x7f349c003b40 2023-11-20T07:01:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c00bfb0 con 0x7f349c005190 2023-11-20T07:01:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c00c170 con 0x7f349c0047d0 2023-11-20T07:01:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b2d9d640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b40b3cb0 0x7f34b40cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b259c640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349c003b40 0x7f349c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b1d9b640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f349c0047d0 0x7f349c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b2d9d640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f349c005190 0x7f349c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b259c640 1 -- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f349c0047d0 msgr2=0x7f349c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:54.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b259c640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f349c0047d0 0x7f349c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b259c640 1 -- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f349c005190 msgr2=0x7f349c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:54.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b259c640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f349c005190 0x7f349c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b259c640 1 -- 172.21.15.88:0/4276983651 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c003530 con 0x7f349c003b40 2023-11-20T07:01:54.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.949+0000 7f34b2d9d640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f349c005190 0x7f349c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:54.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.953+0000 7f34b259c640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349c003b40 0x7f349c003f40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f34a4007f80 tx=0x7f34a401cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515b49993b107bd server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.953+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a4007270 con 0x7f349c003b40 2023-11-20T07:01:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.953+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a40073d0 con 0x7f349c003b40 2023-11-20T07:01:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.953+0000 7f34b159a640 1 -- 172.21.15.88:0/4276983651 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a40057b0 con 0x7f349c003b40 2023-11-20T07:01:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.953+0000 7f34b359e640 1 -- 172.21.15.88:0/4276983651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349c003b40 msgr2=0x7f349c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.953+0000 7f34b359e640 1 --2- 172.21.15.88:0/4276983651 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349c003b40 0x7f349c003f40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f34a4007f80 tx=0x7f34a401cad0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.953+0000 7f34b2d9d640 1 -- 172.21.15.88:0/4276983651 reap_dead start 2023-11-20T07:01:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.953+0000 7f34b359e640 1 -- 172.21.15.88:0/4276983651 shutdown_connections 2023-11-20T07:01:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.953+0000 7f34b359e640 1 -- 172.21.15.88:0/4276983651 >> 172.21.15.88:0/4276983651 conn(0x7f34b40d2800 msgr2=0x7f34b40d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.953+0000 7f34b359e640 1 -- 172.21.15.88:0/4276983651 shutdown_connections 2023-11-20T07:01:54.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.953+0000 7f34b359e640 1 -- 172.21.15.88:0/4276983651 wait complete. 2023-11-20T07:01:54.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b359e640 1 Processor -- start 2023-11-20T07:01:54.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b359e640 1 -- start start 2023-11-20T07:01:54.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349c003b40 0x7f34b40b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b359e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b40b58f0 0x7f34b415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b359e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b415a590 0x7f34b40ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b359e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b415aa20 con 0x7f349c003b40 2023-11-20T07:01:54.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b359e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b40b84e0 con 0x7f34b40b58f0 2023-11-20T07:01:54.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b359e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b40b7c40 con 0x7f34b415a590 2023-11-20T07:01:54.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349c003b40 0x7f34b40b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349c003b40 0x7f34b40b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38358/0 (socket says 172.21.15.88:38358) 2023-11-20T07:01:54.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b259c640 1 -- 172.21.15.88:0/1174801098 learned_addr learned my addr 172.21.15.88:0/1174801098 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:54.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b2d9d640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b415a590 0x7f34b40ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b1d9b640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b40b58f0 0x7f34b415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b259c640 1 -- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b415a590 msgr2=0x7f34b40ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b259c640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b415a590 0x7f34b40ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b259c640 1 -- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b40b58f0 msgr2=0x7f34b415a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b259c640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b40b58f0 0x7f34b415a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b259c640 1 -- 172.21.15.88:0/1174801098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b40b7f20 con 0x7f349c003b40 2023-11-20T07:01:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b2d9d640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b415a590 0x7f34b40ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b259c640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349c003b40 0x7f34b40b53b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f34a401c900 tx=0x7f349c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:54.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34a2ffd640 1 -- 172.21.15.88:0/1174801098 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a40b4070 con 0x7f349c003b40 2023-11-20T07:01:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34a2ffd640 1 -- 172.21.15.88:0/1174801098 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a4005e50 con 0x7f349c003b40 2023-11-20T07:01:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34a2ffd640 1 -- 172.21.15.88:0/1174801098 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a4000f80 con 0x7f349c003b40 2023-11-20T07:01:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b359e640 1 -- 172.21.15.88:0/1174801098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b40b8200 con 0x7f349c003b40 2023-11-20T07:01:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b359e640 1 -- 172.21.15.88:0/1174801098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b40cc740 con 0x7f349c003b40 2023-11-20T07:01:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.957+0000 7f34b359e640 1 -- 172.21.15.88:0/1174801098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b404e9c0 con 0x7f349c003b40 2023-11-20T07:01:54.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.961+0000 7f34a2ffd640 1 -- 172.21.15.88:0/1174801098 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34a4001600 con 0x7f349c003b40 2023-11-20T07:01:54.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.961+0000 7f34a2ffd640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34940664d0 0x7f3494068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:54.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.961+0000 7f34a2ffd640 1 -- 172.21.15.88:0/1174801098 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34a411db40 con 0x7f349c003b40 2023-11-20T07:01:54.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.961+0000 7f34b1d9b640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34940664d0 0x7f3494068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:54.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.961+0000 7f34b1d9b640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34940664d0 0x7f3494068990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f34b415b110 tx=0x7f34a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:54.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:54.965+0000 7f34a2ffd640 1 -- 172.21.15.88:0/1174801098 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34a40eabf0 con 0x7f349c003b40 2023-11-20T07:01:55.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 -- 172.21.15.88:0/1174801098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f34b40d0bc0 con 0x7f349c003b40 2023-11-20T07:01:55.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34a2ffd640 1 -- 172.21.15.88:0/1174801098 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f34a40ee210 con 0x7f349c003b40 2023-11-20T07:01:55.115 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 -- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34940664d0 msgr2=0x7f3494068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34940664d0 0x7f3494068990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f34b415b110 tx=0x7f34a8009040 comp rx=0 tx=0).stop 2023-11-20T07:01:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 -- 172.21.15.88:0/1174801098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349c003b40 msgr2=0x7f34b40b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349c003b40 0x7f34b40b53b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f34a401c900 tx=0x7f349c005800 comp rx=0 tx=0).stop 2023-11-20T07:01:55.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 -- 172.21.15.88:0/1174801098 shutdown_connections 2023-11-20T07:01:55.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34940664d0 0x7f3494068990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b415a590 0x7f34b40ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b40b58f0 0x7f34b415a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 --2- 172.21.15.88:0/1174801098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f349c003b40 0x7f34b40b53b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 -- 172.21.15.88:0/1174801098 >> 172.21.15.88:0/1174801098 conn(0x7f34b40d2800 msgr2=0x7f34b40af450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:55.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 -- 172.21.15.88:0/1174801098 shutdown_connections 2023-11-20T07:01:55.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.113+0000 7f34b359e640 1 -- 172.21.15.88:0/1174801098 wait complete. 2023-11-20T07:01:55.136 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T07:01:55.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4db5594640 1 Processor -- start 2023-11-20T07:01:55.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4db5594640 1 -- start start 2023-11-20T07:01:55.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4db5594640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4db00b3d30 0x7f4db00ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:55.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4db5594640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db00d0570 con 0x7f4db00cf8b0 2023-11-20T07:01:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4db5594640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db00cd450 con 0x7f4db00b2d50 2023-11-20T07:01:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4db5594640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db00b3130 con 0x7f4db00b3d30 2023-11-20T07:01:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4da67fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4db00cf8b0 0x7f4db00cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36500/0 (socket says 172.21.15.88:36500) 2023-11-20T07:01:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4da67fc640 1 -- 172.21.15.88:0/1767344678 learned_addr learned my addr 172.21.15.88:0/1767344678 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4daf7fe640 1 --2- 172.21.15.88:0/1767344678 >> v2:172.21.15.88:3300/0 conn(0x7f4db00b3d30 0x7f4db00ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4dae7fc640 1 -- 172.21.15.88:0/1767344678 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969573833 0 0) 0x7f4db00d0570 con 0x7f4db00cf8b0 2023-11-20T07:01:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4dae7fc640 1 -- 172.21.15.88:0/1767344678 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d9c003530 con 0x7f4db00cf8b0 2023-11-20T07:01:55.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4daf7fe640 1 -- 172.21.15.88:0/1767344678 >> v1:172.21.15.175:6789/0 conn(0x7f4db00b2d50 legacy=0x7f4db00cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:55.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4daf7fe640 1 -- 172.21.15.88:0/1767344678 >> v1:172.21.15.88:6789/0 conn(0x7f4db00cf8b0 legacy=0x7f4db00cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.273+0000 7f4daf7fe640 1 -- 172.21.15.88:0/1767344678 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db00d07c0 con 0x7f4db00b3d30 2023-11-20T07:01:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.277+0000 7f4daf7fe640 1 --2- 172.21.15.88:0/1767344678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db00b3d30 0x7f4db00ce060 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4da80097c0 tx=0x7f4da801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d26e5bb14f7248 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.277+0000 7f4dae7fc640 1 -- 172.21.15.88:0/1767344678 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80ab600 con 0x7f4db00b3d30 2023-11-20T07:01:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.277+0000 7f4dae7fc640 1 -- 172.21.15.88:0/1767344678 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da80a7050 con 0x7f4db00b3d30 2023-11-20T07:01:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.277+0000 7f4dae7fc640 1 -- 172.21.15.88:0/1767344678 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80ab980 con 0x7f4db00b3d30 2023-11-20T07:01:55.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.277+0000 7f4db5594640 1 -- 172.21.15.88:0/1767344678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db00b3d30 msgr2=0x7f4db00ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.277+0000 7f4db5594640 1 --2- 172.21.15.88:0/1767344678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db00b3d30 0x7f4db00ce060 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4da80097c0 tx=0x7f4da801c3b0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.277+0000 7f4db5594640 1 -- 172.21.15.88:0/1767344678 shutdown_connections 2023-11-20T07:01:55.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.277+0000 7f4db5594640 1 --2- 172.21.15.88:0/1767344678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db00b3d30 0x7f4db00ce060 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.277+0000 7f4db5594640 1 -- 172.21.15.88:0/1767344678 >> 172.21.15.88:0/1767344678 conn(0x7f4db00d2790 msgr2=0x7f4db00d2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:55.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.277+0000 7f4db5594640 1 -- 172.21.15.88:0/1767344678 shutdown_connections 2023-11-20T07:01:55.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.277+0000 7f4db5594640 1 -- 172.21.15.88:0/1767344678 wait complete. 2023-11-20T07:01:55.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4db5594640 1 Processor -- start 2023-11-20T07:01:55.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4db5594640 1 -- start start 2023-11-20T07:01:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4db5594640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4db00b2d50 0x7f4db015a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4db5594640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db00b3d30 0x7f4db00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4db5594640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4db00cf8b0 0x7f4db00c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4db5594640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00d1980 con 0x7f4db00b3d30 2023-11-20T07:01:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4db5594640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00afec0 con 0x7f4db00b2d50 2023-11-20T07:01:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4db5594640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db015e3c0 con 0x7f4db00cf8b0 2023-11-20T07:01:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4da67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db00b3d30 0x7f4db00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4da67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db00b3d30 0x7f4db00c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38384/0 (socket says 172.21.15.88:38384) 2023-11-20T07:01:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4da67fc640 1 -- 172.21.15.88:0/1203943756 learned_addr learned my addr 172.21.15.88:0/1203943756 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:55.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4da67fc640 1 -- 172.21.15.88:0/1203943756 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4db00cf8b0 msgr2=0x7f4db00c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4da67fc640 1 --2- 172.21.15.88:0/1203943756 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4db00cf8b0 0x7f4db00c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4da67fc640 1 -- 172.21.15.88:0/1203943756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4db00b2d50 msgr2=0x7f4db015a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4da67fc640 1 --2- 172.21.15.88:0/1203943756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4db00b2d50 0x7f4db015a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4da67fc640 1 -- 172.21.15.88:0/1203943756 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8009420 con 0x7f4db00b3d30 2023-11-20T07:01:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4da67fc640 1 --2- 172.21.15.88:0/1203943756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db00b3d30 0x7f4db00c7f60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800c4d0 tx=0x7f4d9800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4da7fff640 1 -- 172.21.15.88:0/1203943756 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98005cf0 con 0x7f4db00b3d30 2023-11-20T07:01:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4da7fff640 1 -- 172.21.15.88:0/1203943756 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d98005e50 con 0x7f4db00b3d30 2023-11-20T07:01:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4da7fff640 1 -- 172.21.15.88:0/1203943756 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98007270 con 0x7f4db00b3d30 2023-11-20T07:01:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4db5594640 1 -- 172.21.15.88:0/1203943756 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db015e6a0 con 0x7f4db00b3d30 2023-11-20T07:01:55.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.281+0000 7f4db5594640 1 -- 172.21.15.88:0/1203943756 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db015ec60 con 0x7f4db00b3d30 2023-11-20T07:01:55.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.285+0000 7f4db5594640 1 -- 172.21.15.88:0/1203943756 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db0073fa0 con 0x7f4db00b3d30 2023-11-20T07:01:55.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.285+0000 7f4da7fff640 1 -- 172.21.15.88:0/1203943756 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4d980073d0 con 0x7f4db00b3d30 2023-11-20T07:01:55.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.285+0000 7f4da7fff640 1 --2- 172.21.15.88:0/1203943756 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4d900664d0 0x7f4d90068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:55.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.285+0000 7f4da7fff640 1 -- 172.21.15.88:0/1203943756 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4d98083890 con 0x7f4db00b3d30 2023-11-20T07:01:55.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.285+0000 7f4daeffd640 1 --2- 172.21.15.88:0/1203943756 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4d900664d0 0x7f4d90068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:55.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.285+0000 7f4daeffd640 1 --2- 172.21.15.88:0/1203943756 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4d900664d0 0x7f4d90068990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4da000ab90 tx=0x7f4da0009230 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:55.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.289+0000 7f4da7fff640 1 -- 172.21.15.88:0/1203943756 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4d980508d0 con 0x7f4db00b3d30 2023-11-20T07:01:55.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.449+0000 7f4db5594640 1 -- 172.21.15.88:0/1203943756 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4db00d0b50 con 0x7f4db00b3d30 2023-11-20T07:01:55.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.449+0000 7f4da7fff640 1 -- 172.21.15.88:0/1203943756 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4d98017020 con 0x7f4db00b3d30 2023-11-20T07:01:55.452 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-20T07:01:55.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.453+0000 7f4db5594640 1 -- 172.21.15.88:0/1203943756 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4d900664d0 msgr2=0x7f4d90068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.453+0000 7f4db5594640 1 --2- 172.21.15.88:0/1203943756 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4d900664d0 0x7f4d90068990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4da000ab90 tx=0x7f4da0009230 comp rx=0 tx=0).stop 2023-11-20T07:01:55.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.453+0000 7f4db5594640 1 -- 172.21.15.88:0/1203943756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db00b3d30 msgr2=0x7f4db00c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.453+0000 7f4db5594640 1 --2- 172.21.15.88:0/1203943756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db00b3d30 0x7f4db00c7f60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800c4d0 tx=0x7f4d9800c990 comp rx=0 tx=0).stop 2023-11-20T07:01:55.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.453+0000 7f4db5594640 1 -- 172.21.15.88:0/1203943756 shutdown_connections 2023-11-20T07:01:55.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.453+0000 7f4db5594640 1 --2- 172.21.15.88:0/1203943756 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4d900664d0 0x7f4d90068990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.453+0000 7f4db5594640 1 --2- 172.21.15.88:0/1203943756 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4db00cf8b0 0x7f4db00c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.453+0000 7f4db5594640 1 --2- 172.21.15.88:0/1203943756 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4db00b3d30 0x7f4db00c7f60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.453+0000 7f4db5594640 1 --2- 172.21.15.88:0/1203943756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4db00b2d50 0x7f4db015a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.453+0000 7f4db5594640 1 -- 172.21.15.88:0/1203943756 >> 172.21.15.88:0/1203943756 conn(0x7f4db00d2790 msgr2=0x7f4db015fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:55.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.453+0000 7f4db5594640 1 -- 172.21.15.88:0/1203943756 shutdown_connections 2023-11-20T07:01:55.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.453+0000 7f4db5594640 1 -- 172.21.15.88:0/1203943756 wait complete. 2023-11-20T07:01:55.472 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2023-11-20T07:01:55.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:55.472 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-20T07:01:55.509 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:01:55.510 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:01:55.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:55.510 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-20T07:01:55.570 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:01:55.570 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:55.579 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:01:55.579 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:55.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:55.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f9994cea640 1 Processor -- start 2023-11-20T07:01:55.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f9994cea640 1 -- start start 2023-11-20T07:01:55.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f9994cea640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99900d15d0 0x7f99900cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:55.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f9994cea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99900d3010 0x7f99900c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:55.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f9994cea640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99900ce770 con 0x7f999015cb90 2023-11-20T07:01:55.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f9994cea640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99900d0600 con 0x7f99900d15d0 2023-11-20T07:01:55.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f9994cea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99900c6450 con 0x7f99900d3010 2023-11-20T07:01:55.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f998ed9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99900d3010 0x7f99900c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:55.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f998ed9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99900d3010 0x7f99900c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:59786/0 (socket says 172.21.15.88:59786) 2023-11-20T07:01:55.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f998ed9d640 1 -- 172.21.15.88:0/3017579437 learned_addr learned my addr 172.21.15.88:0/3017579437 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:55.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f9987fff640 1 --2- 172.21.15.88:0/3017579437 >> v2:172.21.15.175:3300/0 conn(0x7f99900d15d0 0x7f99900cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:55.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f998ed9d640 1 -- 172.21.15.88:0/3017579437 >> v2:172.21.15.175:3300/0 conn(0x7f99900d15d0 msgr2=0x7f99900cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:55.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f998ed9d640 1 --2- 172.21.15.88:0/3017579437 >> v2:172.21.15.175:3300/0 conn(0x7f99900d15d0 0x7f99900cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f998ed9d640 1 -- 172.21.15.88:0/3017579437 >> v1:172.21.15.175:6789/0 conn(0x7f999015cb90 legacy=0x7f99900d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f998dd9b640 1 -- 172.21.15.88:0/3017579437 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125912529 0 0) 0x7f99900ce770 con 0x7f999015cb90 2023-11-20T07:01:55.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f998ed9d640 1 -- 172.21.15.88:0/3017579437 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99900d08a0 con 0x7f99900d3010 2023-11-20T07:01:55.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.813+0000 7f9987fff640 1 --2- 172.21.15.88:0/3017579437 >> v2:172.21.15.175:3300/0 conn(0x7f99900d15d0 0x7f99900cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:01:55.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.817+0000 7f998ed9d640 1 --2- 172.21.15.88:0/3017579437 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99900d3010 0x7f99900c6c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9988009e50 tx=0x7f998801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dba9085ffe28fd8e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:55.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.817+0000 7f998dd9b640 1 -- 172.21.15.88:0/3017579437 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99880a5810 con 0x7f99900d3010 2023-11-20T07:01:55.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.817+0000 7f998dd9b640 1 -- 172.21.15.88:0/3017579437 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99880a5970 con 0x7f99900d3010 2023-11-20T07:01:55.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.817+0000 7f998dd9b640 1 -- 172.21.15.88:0/3017579437 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99880a5d00 con 0x7f99900d3010 2023-11-20T07:01:55.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.817+0000 7f9994cea640 1 -- 172.21.15.88:0/3017579437 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99900d3010 msgr2=0x7f99900c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.817+0000 7f9994cea640 1 --2- 172.21.15.88:0/3017579437 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99900d3010 0x7f99900c6c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9988009e50 tx=0x7f998801c950 comp rx=0 tx=0).stop 2023-11-20T07:01:55.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.817+0000 7f9994cea640 1 -- 172.21.15.88:0/3017579437 shutdown_connections 2023-11-20T07:01:55.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.817+0000 7f9994cea640 1 --2- 172.21.15.88:0/3017579437 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99900d3010 0x7f99900c6c10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.817+0000 7f9994cea640 1 --2- 172.21.15.88:0/3017579437 >> v2:172.21.15.175:3300/0 conn(0x7f99900d15d0 0x7f99900cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.817+0000 7f9994cea640 1 -- 172.21.15.88:0/3017579437 >> 172.21.15.88:0/3017579437 conn(0x7f999009bc50 msgr2=0x7f99900d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:55.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.817+0000 7f9994cea640 1 -- 172.21.15.88:0/3017579437 shutdown_connections 2023-11-20T07:01:55.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.817+0000 7f9994cea640 1 -- 172.21.15.88:0/3017579437 wait complete. 2023-11-20T07:01:55.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9994cea640 1 Processor -- start 2023-11-20T07:01:55.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9994cea640 1 -- start start 2023-11-20T07:01:55.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9994cea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99900d15d0 0x7f999015ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:55.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9994cea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99900d3010 0x7f9990155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:55.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9994cea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f999015cb90 0x7f9990156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:55.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9994cea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99900cbb30 con 0x7f99900d15d0 2023-11-20T07:01:55.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9994cea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99900cbe10 con 0x7f999015cb90 2023-11-20T07:01:55.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9994cea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99900cc0f0 con 0x7f99900d3010 2023-11-20T07:01:55.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f998e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99900d15d0 0x7f999015ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:55.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f998e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99900d15d0 0x7f999015ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38396/0 (socket says 172.21.15.88:38396) 2023-11-20T07:01:55.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f998e59c640 1 -- 172.21.15.88:0/4283342030 learned_addr learned my addr 172.21.15.88:0/4283342030 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:55.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f998ed9d640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f999015cb90 0x7f9990156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:55.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9987fff640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99900d3010 0x7f9990155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:55.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f998e59c640 1 -- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99900d3010 msgr2=0x7f9990155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f998e59c640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99900d3010 0x7f9990155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f998e59c640 1 -- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f999015cb90 msgr2=0x7f9990156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f998e59c640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f999015cb90 0x7f9990156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f998e59c640 1 -- 172.21.15.88:0/4283342030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978009420 con 0x7f99900d15d0 2023-11-20T07:01:55.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f998ed9d640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f999015cb90 0x7f9990156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:55.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f998e59c640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99900d15d0 0x7f999015ad50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f998000c410 tx=0x7f998000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:55.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9986ffd640 1 -- 172.21.15.88:0/4283342030 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99800054e0 con 0x7f99900d15d0 2023-11-20T07:01:55.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9986ffd640 1 -- 172.21.15.88:0/4283342030 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9980003650 con 0x7f99900d15d0 2023-11-20T07:01:55.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9994cea640 1 -- 172.21.15.88:0/4283342030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9988009b30 con 0x7f99900d15d0 2023-11-20T07:01:55.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9986ffd640 1 -- 172.21.15.88:0/4283342030 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980003a00 con 0x7f99900d15d0 2023-11-20T07:01:55.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.821+0000 7f9994cea640 1 -- 172.21.15.88:0/4283342030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99900cc6b0 con 0x7f99900d15d0 2023-11-20T07:01:55.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.825+0000 7f9994cea640 1 -- 172.21.15.88:0/4283342030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9990074010 con 0x7f99900d15d0 2023-11-20T07:01:55.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.825+0000 7f9986ffd640 1 -- 172.21.15.88:0/4283342030 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9980003b60 con 0x7f99900d15d0 2023-11-20T07:01:55.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.825+0000 7f9986ffd640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99700664a0 0x7f9970068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:55.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.825+0000 7f9986ffd640 1 -- 172.21.15.88:0/4283342030 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9980083850 con 0x7f99900d15d0 2023-11-20T07:01:55.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.825+0000 7f9987fff640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99700664a0 0x7f9970068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:55.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.825+0000 7f9987fff640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99700664a0 0x7f9970068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f999015c010 tx=0x7f9978008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:55.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.829+0000 7f9986ffd640 1 -- 172.21.15.88:0/4283342030 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9980050900 con 0x7f99900d15d0 2023-11-20T07:01:55.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.981+0000 7f9994cea640 1 -- 172.21.15.88:0/4283342030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99900cbc70 con 0x7f99900d15d0 2023-11-20T07:01:55.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.981+0000 7f9986ffd640 1 -- 172.21.15.88:0/4283342030 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f99900cbc70 con 0x7f99900d15d0 2023-11-20T07:01:55.983 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:55.983 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:55.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.981+0000 7f9994cea640 1 -- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99700664a0 msgr2=0x7f9970068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.981+0000 7f9994cea640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99700664a0 0x7f9970068960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f999015c010 tx=0x7f9978008040 comp rx=0 tx=0).stop 2023-11-20T07:01:55.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.981+0000 7f9994cea640 1 -- 172.21.15.88:0/4283342030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99900d15d0 msgr2=0x7f999015ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:55.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.981+0000 7f9994cea640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99900d15d0 0x7f999015ad50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f998000c410 tx=0x7f998000c8d0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.981+0000 7f9994cea640 1 -- 172.21.15.88:0/4283342030 shutdown_connections 2023-11-20T07:01:55.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.981+0000 7f9994cea640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99700664a0 0x7f9970068960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.981+0000 7f9994cea640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99900d3010 0x7f9990155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.981+0000 7f9994cea640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f999015cb90 0x7f9990156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.981+0000 7f9994cea640 1 --2- 172.21.15.88:0/4283342030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99900d15d0 0x7f999015ad50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:55.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.981+0000 7f9994cea640 1 -- 172.21.15.88:0/4283342030 >> 172.21.15.88:0/4283342030 conn(0x7f999009bc50 msgr2=0x7f99900b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:55.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.985+0000 7f9994cea640 1 -- 172.21.15.88:0/4283342030 shutdown_connections 2023-11-20T07:01:55.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:55.985+0000 7f9994cea640 1 -- 172.21.15.88:0/4283342030 wait complete. 2023-11-20T07:01:56.005 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:56.005 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0febaa640 1 Processor -- start 2023-11-20T07:01:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0febaa640 1 -- start start 2023-11-20T07:01:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0febaa640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0f80d0210 0x7ff0f80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0febaa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0f80b84e0 0x7ff0f80b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0febaa640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f80d1670 con 0x7ff0f815cba0 2023-11-20T07:01:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0febaa640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f80d1460 con 0x7ff0f80d0210 2023-11-20T07:01:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0febaa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80d1950 con 0x7ff0f80b84e0 2023-11-20T07:01:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0f7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0f80d0210 0x7ff0f80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0f7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0f80d0210 0x7ff0f80d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49202/0 (socket says 172.21.15.88:49202) 2023-11-20T07:01:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0f7fff640 1 -- 172.21.15.88:0/854562583 learned_addr learned my addr 172.21.15.88:0/854562583 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0fd147640 1 --2- 172.21.15.88:0/854562583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0f80b84e0 0x7ff0f80b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0f7fff640 1 -- 172.21.15.88:0/854562583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0f80b84e0 msgr2=0x7ff0f80b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0f7fff640 1 --2- 172.21.15.88:0/854562583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0f80b84e0 0x7ff0f80b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0f7fff640 1 -- 172.21.15.88:0/854562583 >> v1:172.21.15.175:6789/0 conn(0x7ff0f815cba0 legacy=0x7ff0f80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0f7fff640 1 -- 172.21.15.88:0/854562583 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f80d1c30 con 0x7ff0f80d0210 2023-11-20T07:01:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.145+0000 7ff0fd147640 1 --2- 172.21.15.88:0/854562583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0f80b84e0 0x7ff0f80b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:56.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.149+0000 7ff0f7fff640 1 --2- 172.21.15.88:0/854562583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f80d0210 0x7ff0f80d0f20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009870 tx=0x7ff0e401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200d2477fd7a2e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:56.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.149+0000 7ff0f77fe640 1 -- 172.21.15.88:0/854562583 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40a9400 con 0x7ff0f80d0210 2023-11-20T07:01:56.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.149+0000 7ff0f77fe640 1 -- 172.21.15.88:0/854562583 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e40a9560 con 0x7ff0f80d0210 2023-11-20T07:01:56.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.149+0000 7ff0f77fe640 1 -- 172.21.15.88:0/854562583 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40a98f0 con 0x7ff0f80d0210 2023-11-20T07:01:56.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.149+0000 7ff0febaa640 1 -- 172.21.15.88:0/854562583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f80d0210 msgr2=0x7ff0f80d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.149+0000 7ff0febaa640 1 --2- 172.21.15.88:0/854562583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f80d0210 0x7ff0f80d0f20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009870 tx=0x7ff0e401c540 comp rx=0 tx=0).stop 2023-11-20T07:01:56.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.149+0000 7ff0febaa640 1 -- 172.21.15.88:0/854562583 shutdown_connections 2023-11-20T07:01:56.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.149+0000 7ff0febaa640 1 --2- 172.21.15.88:0/854562583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0f80b84e0 0x7ff0f80b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.149+0000 7ff0febaa640 1 --2- 172.21.15.88:0/854562583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f80d0210 0x7ff0f80d0f20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.149+0000 7ff0febaa640 1 -- 172.21.15.88:0/854562583 >> 172.21.15.88:0/854562583 conn(0x7ff0f80719c0 msgr2=0x7ff0f8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:56.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.149+0000 7ff0febaa640 1 -- 172.21.15.88:0/854562583 shutdown_connections 2023-11-20T07:01:56.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.149+0000 7ff0febaa640 1 -- 172.21.15.88:0/854562583 wait complete. 2023-11-20T07:01:56.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0febaa640 1 Processor -- start 2023-11-20T07:01:56.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0febaa640 1 -- start start 2023-11-20T07:01:56.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0febaa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f80b84e0 0x7ff0f81503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0febaa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f80d0210 0x7ff0f80c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0febaa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0f815cba0 0x7ff0f8158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0febaa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80c78a0 con 0x7ff0f80d0210 2023-11-20T07:01:56.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0febaa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80c8200 con 0x7ff0f80b84e0 2023-11-20T07:01:56.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0febaa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80c6c20 con 0x7ff0f815cba0 2023-11-20T07:01:56.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0f7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f80d0210 0x7ff0f80c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0f7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f80d0210 0x7ff0f80c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49216/0 (socket says 172.21.15.88:49216) 2023-11-20T07:01:56.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0f7fff640 1 -- 172.21.15.88:0/17073203 learned_addr learned my addr 172.21.15.88:0/17073203 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:56.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0fd147640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0f815cba0 0x7ff0f8158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0fc946640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f80b84e0 0x7ff0f81503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0f7fff640 1 -- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0f815cba0 msgr2=0x7ff0f8158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0f7fff640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0f815cba0 0x7ff0f8158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0f7fff640 1 -- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f80b84e0 msgr2=0x7ff0f81503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0f7fff640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f80b84e0 0x7ff0f81503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0f7fff640 1 -- 172.21.15.88:0/17073203 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e40094d0 con 0x7ff0f80d0210 2023-11-20T07:01:56.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0fc946640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f80b84e0 0x7ff0f81503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:56.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0f7fff640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f80d0210 0x7ff0f80c7cc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff0e401a170 tx=0x7ff0e401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:56.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0f57fa640 1 -- 172.21.15.88:0/17073203 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40a9400 con 0x7ff0f80d0210 2023-11-20T07:01:56.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0f57fa640 1 -- 172.21.15.88:0/17073203 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e40b1800 con 0x7ff0f80d0210 2023-11-20T07:01:56.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0f57fa640 1 -- 172.21.15.88:0/17073203 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40b1bb0 con 0x7ff0f80d0210 2023-11-20T07:01:56.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0febaa640 1 -- 172.21.15.88:0/17073203 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f80c6f00 con 0x7ff0f80d0210 2023-11-20T07:01:56.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0febaa640 1 -- 172.21.15.88:0/17073203 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f80c74c0 con 0x7ff0f80d0210 2023-11-20T07:01:56.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.153+0000 7ff0febaa640 1 -- 172.21.15.88:0/17073203 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f80c79e0 con 0x7ff0f80d0210 2023-11-20T07:01:56.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.157+0000 7ff0f57fa640 1 -- 172.21.15.88:0/17073203 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff0e40b1d10 con 0x7ff0f80d0210 2023-11-20T07:01:56.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.157+0000 7ff0f57fa640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff0dc0664a0 0x7ff0dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.157+0000 7ff0f57fa640 1 -- 172.21.15.88:0/17073203 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff0e411e900 con 0x7ff0f80d0210 2023-11-20T07:01:56.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.157+0000 7ff0fc946640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff0dc0664a0 0x7ff0dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.157+0000 7ff0fc946640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff0dc0664a0 0x7ff0dc068960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec000f70 tx=0x7ff0ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.161+0000 7ff0f57fa640 1 -- 172.21.15.88:0/17073203 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff0f80c79e0 con 0x7ff0f80d0210 2023-11-20T07:01:56.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.309+0000 7ff0febaa640 1 -- 172.21.15.88:0/17073203 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0f80c79e0 con 0x7ff0f80d0210 2023-11-20T07:01:56.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0f57fa640 1 -- 172.21.15.88:0/17073203 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0f80c79e0 con 0x7ff0f80d0210 2023-11-20T07:01:56.313 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:56.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0febaa640 1 -- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff0dc0664a0 msgr2=0x7ff0dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0febaa640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff0dc0664a0 0x7ff0dc068960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec000f70 tx=0x7ff0ec009040 comp rx=0 tx=0).stop 2023-11-20T07:01:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0febaa640 1 -- 172.21.15.88:0/17073203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f80d0210 msgr2=0x7ff0f80c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0febaa640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f80d0210 0x7ff0f80c7cc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff0e401a170 tx=0x7ff0e401ad80 comp rx=0 tx=0).stop 2023-11-20T07:01:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0febaa640 1 -- 172.21.15.88:0/17073203 shutdown_connections 2023-11-20T07:01:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0febaa640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff0dc0664a0 0x7ff0dc068960 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0febaa640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0f815cba0 0x7ff0f8158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0febaa640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f80d0210 0x7ff0f80c7cc0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0febaa640 1 --2- 172.21.15.88:0/17073203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f80b84e0 0x7ff0f81503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0febaa640 1 -- 172.21.15.88:0/17073203 >> 172.21.15.88:0/17073203 conn(0x7ff0f80719c0 msgr2=0x7ff0f8154550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0febaa640 1 -- 172.21.15.88:0/17073203 shutdown_connections 2023-11-20T07:01:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.313+0000 7ff0febaa640 1 -- 172.21.15.88:0/17073203 wait complete. 2023-11-20T07:01:56.334 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:56.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.473+0000 7f3bbe691640 1 Processor -- start 2023-11-20T07:01:56.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.473+0000 7f3bbe691640 1 -- start start 2023-11-20T07:01:56.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.473+0000 7f3bbe691640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bb80ceda0 0x7f3bb8167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.473+0000 7f3bbe691640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb80cc330 con 0x7f3bb80cb040 2023-11-20T07:01:56.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.473+0000 7f3bbe691640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb80cb4d0 con 0x7f3bb815cc60 2023-11-20T07:01:56.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.473+0000 7f3bbe691640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80cb720 con 0x7f3bb80ceda0 2023-11-20T07:01:56.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.473+0000 7f3bb77fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3bb80cb040 0x7f3bb80ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51072/0 (socket says 172.21.15.88:51072) 2023-11-20T07:01:56.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.473+0000 7f3bb77fe640 1 -- 172.21.15.88:0/417900287 learned_addr learned my addr 172.21.15.88:0/417900287 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:56.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bbcc2e640 1 --2- 172.21.15.88:0/417900287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bb80ceda0 0x7f3bb8167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476087101 0 0) 0x7f3bb80cc330 con 0x7f3bb80cb040 2023-11-20T07:01:56.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba0003530 con 0x7f3bb80cb040 2023-11-20T07:01:56.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2341401950 0 0) 0x7f3ba0003530 con 0x7f3bb80cb040 2023-11-20T07:01:56.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bb80ceda0 msgr2=0x7f3bb8167be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:56.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 --2- 172.21.15.88:0/417900287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bb80ceda0 0x7f3bb8167be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 >> v1:172.21.15.175:6789/0 conn(0x7f3bb815cc60 legacy=0x7f3bb8161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80cba00 con 0x7f3bb80cb040 2023-11-20T07:01:56.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f3bac001680 con 0x7f3bb80cb040 2023-11-20T07:01:56.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 >> v1:172.21.15.88:6789/0 conn(0x7f3bb80cb040 legacy=0x7f3bb80ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 --2- 172.21.15.88:0/417900287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba00039b0 0x7f3ba0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 --2- 172.21.15.88:0/417900287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ba00047d0 0x7f3ba0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 --2- 172.21.15.88:0/417900287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bb80ceda0 0x7f3ba0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80cb720 con 0x7f3ba00039b0 2023-11-20T07:01:56.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba000ba70 con 0x7f3ba00047d0 2023-11-20T07:01:56.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba000bc30 con 0x7f3bb80ceda0 2023-11-20T07:01:56.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb7fff640 1 --2- 172.21.15.88:0/417900287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba00039b0 0x7f3ba0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bbcc2e640 1 --2- 172.21.15.88:0/417900287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bb80ceda0 0x7f3ba0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb77fe640 1 --2- 172.21.15.88:0/417900287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ba00047d0 0x7f3ba0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb7fff640 1 -- 172.21.15.88:0/417900287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bb80ceda0 msgr2=0x7f3ba0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:56.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb7fff640 1 --2- 172.21.15.88:0/417900287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3bb80ceda0 0x7f3ba0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb7fff640 1 -- 172.21.15.88:0/417900287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ba00047d0 msgr2=0x7f3ba0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:56.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb7fff640 1 --2- 172.21.15.88:0/417900287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ba00047d0 0x7f3ba0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.477+0000 7f3bb7fff640 1 -- 172.21.15.88:0/417900287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0003530 con 0x7f3ba00039b0 2023-11-20T07:01:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bb7fff640 1 --2- 172.21.15.88:0/417900287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba00039b0 0x7f3ba0003dd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8001750 tx=0x7f3ba801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9da0ecdaed3c3e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba80052d0 con 0x7f3ba00039b0 2023-11-20T07:01:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba80a7050 con 0x7f3ba00039b0 2023-11-20T07:01:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bb6ffd640 1 -- 172.21.15.88:0/417900287 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8003600 con 0x7f3ba00039b0 2023-11-20T07:01:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bbe691640 1 -- 172.21.15.88:0/417900287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba00039b0 msgr2=0x7f3ba0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bbe691640 1 --2- 172.21.15.88:0/417900287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ba00039b0 0x7f3ba0003dd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8001750 tx=0x7f3ba801c370 comp rx=0 tx=0).stop 2023-11-20T07:01:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bbcc2e640 1 -- 172.21.15.88:0/417900287 reap_dead start 2023-11-20T07:01:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bbe691640 1 -- 172.21.15.88:0/417900287 shutdown_connections 2023-11-20T07:01:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bbe691640 1 -- 172.21.15.88:0/417900287 >> 172.21.15.88:0/417900287 conn(0x7f3bb806e570 msgr2=0x7f3bb806e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:56.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bbe691640 1 -- 172.21.15.88:0/417900287 shutdown_connections 2023-11-20T07:01:56.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bbe691640 1 -- 172.21.15.88:0/417900287 wait complete. 2023-11-20T07:01:56.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bbe691640 1 Processor -- start 2023-11-20T07:01:56.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bbe691640 1 -- start start 2023-11-20T07:01:56.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bbe691640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ba00039b0 0x7f3bb80c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.481+0000 7f3bbe691640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb8158a80 0x7f3bb8158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bbe691640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bb80c5ac0 0x7f3bb80b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bbe691640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80c7060 con 0x7f3bb8158a80 2023-11-20T07:01:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bbe691640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb8159290 con 0x7f3bb80c5ac0 2023-11-20T07:01:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bbe691640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80c4a20 con 0x7f3ba00039b0 2023-11-20T07:01:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb8158a80 0x7f3bb8158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb8158a80 0x7f3bb8158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49240/0 (socket says 172.21.15.88:49240) 2023-11-20T07:01:56.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb77fe640 1 -- 172.21.15.88:0/2343055599 learned_addr learned my addr 172.21.15.88:0/2343055599 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:56.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bbcc2e640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bb80c5ac0 0x7f3bb80b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb7fff640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ba00039b0 0x7f3bb80c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb77fe640 1 -- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ba00039b0 msgr2=0x7f3bb80c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb77fe640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ba00039b0 0x7f3bb80c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb77fe640 1 -- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bb80c5ac0 msgr2=0x7f3bb80b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb77fe640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bb80c5ac0 0x7f3bb80b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb77fe640 1 -- 172.21.15.88:0/2343055599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80c4d00 con 0x7f3bb8158a80 2023-11-20T07:01:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb7fff640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ba00039b0 0x7f3bb80c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb77fe640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb8158a80 0x7f3bb8158270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00e7b0 tx=0x7f3bac00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:56.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb4ff9640 1 -- 172.21.15.88:0/2343055599 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00c6c0 con 0x7f3bb8158a80 2023-11-20T07:01:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb4ff9640 1 -- 172.21.15.88:0/2343055599 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00c860 con 0x7f3bb8158a80 2023-11-20T07:01:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb4ff9640 1 -- 172.21.15.88:0/2343055599 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00cc10 con 0x7f3bb8158a80 2023-11-20T07:01:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bbe691640 1 -- 172.21.15.88:0/2343055599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb80c4fe0 con 0x7f3bb8158a80 2023-11-20T07:01:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bbe691640 1 -- 172.21.15.88:0/2343055599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb80c55a0 con 0x7f3bb8158a80 2023-11-20T07:01:56.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bbe691640 1 -- 172.21.15.88:0/2343055599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb804e170 con 0x7f3bb8158a80 2023-11-20T07:01:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.485+0000 7f3bb4ff9640 1 -- 172.21.15.88:0/2343055599 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3bac01d460 con 0x7f3bb8158a80 2023-11-20T07:01:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.489+0000 7f3bb4ff9640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3ba40664d0 0x7f3ba4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.489+0000 7f3bb4ff9640 1 -- 172.21.15.88:0/2343055599 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3bac084140 con 0x7f3bb8158a80 2023-11-20T07:01:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.489+0000 7f3bb7fff640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3ba40664d0 0x7f3ba4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.489+0000 7f3bb7fff640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3ba40664d0 0x7f3ba4068990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00057b0 tx=0x7f3ba80011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:56.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.489+0000 7f3bb4ff9640 1 -- 172.21.15.88:0/2343055599 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3bac051160 con 0x7f3bb8158a80 2023-11-20T07:01:56.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 -- 172.21.15.88:0/2343055599 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bb80b6830 con 0x7f3bb8158a80 2023-11-20T07:01:56.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bb4ff9640 1 -- 172.21.15.88:0/2343055599 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3bac054780 con 0x7f3bb8158a80 2023-11-20T07:01:56.642 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:56.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 -- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3ba40664d0 msgr2=0x7f3ba4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3ba40664d0 0x7f3ba4068990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00057b0 tx=0x7f3ba80011a0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 -- 172.21.15.88:0/2343055599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb8158a80 msgr2=0x7f3bb8158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb8158a80 0x7f3bb8158270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00e7b0 tx=0x7f3bac00ec70 comp rx=0 tx=0).stop 2023-11-20T07:01:56.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 -- 172.21.15.88:0/2343055599 shutdown_connections 2023-11-20T07:01:56.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3ba40664d0 0x7f3ba4068990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bb80c5ac0 0x7f3bb80b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3bb8158a80 0x7f3bb8158270 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 --2- 172.21.15.88:0/2343055599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ba00039b0 0x7f3bb80c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 -- 172.21.15.88:0/2343055599 >> 172.21.15.88:0/2343055599 conn(0x7f3bb806e570 msgr2=0x7f3bb806c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:56.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 -- 172.21.15.88:0/2343055599 shutdown_connections 2023-11-20T07:01:56.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.641+0000 7f3bbe691640 1 -- 172.21.15.88:0/2343055599 wait complete. 2023-11-20T07:01:56.663 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:56.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.801+0000 7f511931d640 1 Processor -- start 2023-11-20T07:01:56.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.801+0000 7f511931d640 1 -- start start 2023-11-20T07:01:56.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f511931d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f511415cba0 0x7f51140d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f511931d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51140d0210 0x7f51140b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f511931d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51140d1670 con 0x7f51140b84e0 2023-11-20T07:01:56.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f511931d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51140d1460 con 0x7f51140d0210 2023-11-20T07:01:56.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f511931d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51140d1950 con 0x7f511415cba0 2023-11-20T07:01:56.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f51137fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51140d0210 0x7f51140b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f51137fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51140d0210 0x7f51140b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49250/0 (socket says 172.21.15.88:49250) 2023-11-20T07:01:56.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f51137fe640 1 -- 172.21.15.88:0/3547363042 learned_addr learned my addr 172.21.15.88:0/3547363042 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:56.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f510a7fc640 1 --1- 172.21.15.88:0/3547363042 >> v1:172.21.15.88:6789/0 conn(0x7f51140b84e0 0x7f51140cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51074/0 (socket says 172.21.15.88:51074) 2023-11-20T07:01:56.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f5112ffd640 1 --2- 172.21.15.88:0/3547363042 >> v2:172.21.15.175:3300/0 conn(0x7f511415cba0 0x7f51140d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f51137fe640 1 -- 172.21.15.88:0/3547363042 >> v2:172.21.15.175:3300/0 conn(0x7f511415cba0 msgr2=0x7f51140d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:56.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f51137fe640 1 --2- 172.21.15.88:0/3547363042 >> v2:172.21.15.175:3300/0 conn(0x7f511415cba0 0x7f51140d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f51137fe640 1 -- 172.21.15.88:0/3547363042 >> v1:172.21.15.88:6789/0 conn(0x7f51140b84e0 legacy=0x7f51140cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f51137fe640 1 -- 172.21.15.88:0/3547363042 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51140d1c30 con 0x7f51140d0210 2023-11-20T07:01:56.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.805+0000 7f51127fc640 1 -- 172.21.15.88:0/3547363042 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364532537 0 0) 0x7f51140d1670 con 0x7f51140b84e0 2023-11-20T07:01:56.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f51137fe640 1 --2- 172.21.15.88:0/3547363042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51140d0210 0x7f51140b5cf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f51140b4890 tx=0x7f510c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7426d5b572ceca7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:56.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f51127fc640 1 -- 172.21.15.88:0/3547363042 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0a5800 con 0x7f51140d0210 2023-11-20T07:01:56.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f51127fc640 1 -- 172.21.15.88:0/3547363042 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c0a5960 con 0x7f51140d0210 2023-11-20T07:01:56.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f51127fc640 1 -- 172.21.15.88:0/3547363042 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0a5cf0 con 0x7f51140d0210 2023-11-20T07:01:56.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f511931d640 1 -- 172.21.15.88:0/3547363042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51140d0210 msgr2=0x7f51140b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f511931d640 1 --2- 172.21.15.88:0/3547363042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51140d0210 0x7f51140b5cf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f51140b4890 tx=0x7f510c01c940 comp rx=0 tx=0).stop 2023-11-20T07:01:56.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f511931d640 1 -- 172.21.15.88:0/3547363042 shutdown_connections 2023-11-20T07:01:56.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f511931d640 1 --2- 172.21.15.88:0/3547363042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51140d0210 0x7f51140b5cf0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f511931d640 1 --2- 172.21.15.88:0/3547363042 >> v2:172.21.15.175:3300/0 conn(0x7f511415cba0 0x7f51140d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f511931d640 1 -- 172.21.15.88:0/3547363042 >> 172.21.15.88:0/3547363042 conn(0x7f51140719c0 msgr2=0x7f5114071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:56.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f511931d640 1 -- 172.21.15.88:0/3547363042 shutdown_connections 2023-11-20T07:01:56.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f511931d640 1 -- 172.21.15.88:0/3547363042 wait complete. 2023-11-20T07:01:56.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f511931d640 1 Processor -- start 2023-11-20T07:01:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.809+0000 7f511931d640 1 -- start start 2023-11-20T07:01:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f511931d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51140b84e0 0x7f511415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f511931d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51140d0210 0x7f511414b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f511931d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511415cba0 0x7f511414dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f511931d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5114156770 con 0x7f511415cba0 2023-11-20T07:01:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f511931d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5114156a50 con 0x7f51140d0210 2023-11-20T07:01:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f511931d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511414bbf0 con 0x7f51140b84e0 2023-11-20T07:01:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f51137fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511415cba0 0x7f511414dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f51137fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511415cba0 0x7f511414dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49260/0 (socket says 172.21.15.88:49260) 2023-11-20T07:01:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f5112ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51140b84e0 0x7f511415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f51137fe640 1 -- 172.21.15.88:0/2680748103 learned_addr learned my addr 172.21.15.88:0/2680748103 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:56.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f510a7fc640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51140d0210 0x7f511414b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f51137fe640 1 -- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51140b84e0 msgr2=0x7f511415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f51137fe640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51140b84e0 0x7f511415a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f51137fe640 1 -- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51140d0210 msgr2=0x7f511414b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f51137fe640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51140d0210 0x7f511414b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f51137fe640 1 -- 172.21.15.88:0/2680748103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c009b30 con 0x7f511415cba0 2023-11-20T07:01:56.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f51137fe640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511415cba0 0x7f511414dd00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f510c019550 tx=0x7f510c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:56.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f510bfff640 1 -- 172.21.15.88:0/2680748103 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0b8670 con 0x7f511415cba0 2023-11-20T07:01:56.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f510bfff640 1 -- 172.21.15.88:0/2680748103 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c0b87d0 con 0x7f511415cba0 2023-11-20T07:01:56.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f510bfff640 1 -- 172.21.15.88:0/2680748103 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0b8b80 con 0x7f511415cba0 2023-11-20T07:01:56.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f511931d640 1 -- 172.21.15.88:0/2680748103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511414bed0 con 0x7f511415cba0 2023-11-20T07:01:56.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f511931d640 1 -- 172.21.15.88:0/2680748103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511415ac10 con 0x7f511415cba0 2023-11-20T07:01:56.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.813+0000 7f511931d640 1 -- 172.21.15.88:0/2680748103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511404e170 con 0x7f511415cba0 2023-11-20T07:01:56.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.817+0000 7f510bfff640 1 -- 172.21.15.88:0/2680748103 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f510c0b8ce0 con 0x7f511415cba0 2023-11-20T07:01:56.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.817+0000 7f510bfff640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f50f40664a0 0x7f50f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:56.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.817+0000 7f510bfff640 1 -- 172.21.15.88:0/2680748103 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f510c11f670 con 0x7f511415cba0 2023-11-20T07:01:56.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.817+0000 7f5112ffd640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f50f40664a0 0x7f50f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:56.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.817+0000 7f5112ffd640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f50f40664a0 0x7f50f4068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f511406c190 tx=0x7f50fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:56.821 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.821+0000 7f510bfff640 1 -- 172.21.15.88:0/2680748103 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f510c0ec7d0 con 0x7f511415cba0 2023-11-20T07:01:56.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.969+0000 7f511931d640 1 -- 172.21.15.88:0/2680748103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51141549a0 con 0x7f511415cba0 2023-11-20T07:01:56.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.969+0000 7f510bfff640 1 -- 172.21.15.88:0/2680748103 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f510c0efdf0 con 0x7f511415cba0 2023-11-20T07:01:56.972 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:56.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.973+0000 7f511931d640 1 -- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f50f40664a0 msgr2=0x7f50f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.973+0000 7f511931d640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f50f40664a0 0x7f50f4068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f511406c190 tx=0x7f50fc008040 comp rx=0 tx=0).stop 2023-11-20T07:01:56.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.973+0000 7f511931d640 1 -- 172.21.15.88:0/2680748103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511415cba0 msgr2=0x7f511414dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:56.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.973+0000 7f511931d640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511415cba0 0x7f511414dd00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f510c019550 tx=0x7f510c0196e0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.973+0000 7f511931d640 1 -- 172.21.15.88:0/2680748103 shutdown_connections 2023-11-20T07:01:56.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.973+0000 7f511931d640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f50f40664a0 0x7f50f4068960 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.973+0000 7f511931d640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511415cba0 0x7f511414dd00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.973+0000 7f511931d640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51140d0210 0x7f511414b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.973+0000 7f511931d640 1 --2- 172.21.15.88:0/2680748103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51140b84e0 0x7f511415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:56.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.973+0000 7f511931d640 1 -- 172.21.15.88:0/2680748103 >> 172.21.15.88:0/2680748103 conn(0x7f51140719c0 msgr2=0x7f5114153d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:56.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.973+0000 7f511931d640 1 -- 172.21.15.88:0/2680748103 shutdown_connections 2023-11-20T07:01:56.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:56.973+0000 7f511931d640 1 -- 172.21.15.88:0/2680748103 wait complete. 2023-11-20T07:01:56.993 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:57.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd8115d3640 1 Processor -- start 2023-11-20T07:01:57.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd8115d3640 1 -- start start 2023-11-20T07:01:57.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd8115d3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd80c15cba0 0x7fd80c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd8115d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd80c0d0210 0x7fd80c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd8115d3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c0d1670 con 0x7fd80c0b84e0 2023-11-20T07:01:57.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd8115d3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c0d1460 con 0x7fd80c15cba0 2023-11-20T07:01:57.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd8115d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c0d1950 con 0x7fd80c0d0210 2023-11-20T07:01:57.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd80affd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd80c15cba0 0x7fd80c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd80b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd80c0d0210 0x7fd80c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd80affd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd80c15cba0 0x7fd80c0d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:39570/0 (socket says 172.21.15.88:39570) 2023-11-20T07:01:57.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd80b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd80c0d0210 0x7fd80c0b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:45942/0 (socket says 172.21.15.88:45942) 2023-11-20T07:01:57.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd80affd640 1 -- 172.21.15.88:0/832450994 learned_addr learned my addr 172.21.15.88:0/832450994 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:57.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd8027fc640 1 --1- 172.21.15.88:0/832450994 >> v1:172.21.15.175:6789/0 conn(0x7fd80c0b84e0 0x7fd80c0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:55358/0 (socket says 172.21.15.88:55358) 2023-11-20T07:01:57.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd80b7fe640 1 -- 172.21.15.88:0/832450994 >> v2:172.21.15.175:3300/0 conn(0x7fd80c15cba0 msgr2=0x7fd80c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:57.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd80b7fe640 1 --2- 172.21.15.88:0/832450994 >> v2:172.21.15.175:3300/0 conn(0x7fd80c15cba0 0x7fd80c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd80b7fe640 1 -- 172.21.15.88:0/832450994 >> v1:172.21.15.175:6789/0 conn(0x7fd80c0b84e0 legacy=0x7fd80c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.133+0000 7fd80b7fe640 1 -- 172.21.15.88:0/832450994 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c0d1c30 con 0x7fd80c0d0210 2023-11-20T07:01:57.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.137+0000 7fd80b7fe640 1 --2- 172.21.15.88:0/832450994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd80c0d0210 0x7fd80c0b5cf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8040097c0 tx=0x7fd80401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4fb7ca9c1807219 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:57.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.137+0000 7fd80a7fc640 1 -- 172.21.15.88:0/832450994 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040ab680 con 0x7fd80c0d0210 2023-11-20T07:01:57.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.137+0000 7fd80a7fc640 1 -- 172.21.15.88:0/832450994 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8040ab7e0 con 0x7fd80c0d0210 2023-11-20T07:01:57.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.137+0000 7fd80a7fc640 1 -- 172.21.15.88:0/832450994 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040abb70 con 0x7fd80c0d0210 2023-11-20T07:01:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.137+0000 7fd8115d3640 1 -- 172.21.15.88:0/832450994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd80c0d0210 msgr2=0x7fd80c0b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.137+0000 7fd8115d3640 1 --2- 172.21.15.88:0/832450994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd80c0d0210 0x7fd80c0b5cf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8040097c0 tx=0x7fd80401c480 comp rx=0 tx=0).stop 2023-11-20T07:01:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.137+0000 7fd8115d3640 1 -- 172.21.15.88:0/832450994 shutdown_connections 2023-11-20T07:01:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.137+0000 7fd8115d3640 1 --2- 172.21.15.88:0/832450994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd80c0d0210 0x7fd80c0b5cf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.137+0000 7fd8115d3640 1 --2- 172.21.15.88:0/832450994 >> v2:172.21.15.175:3300/0 conn(0x7fd80c15cba0 0x7fd80c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.137+0000 7fd8115d3640 1 -- 172.21.15.88:0/832450994 >> 172.21.15.88:0/832450994 conn(0x7fd80c0719c0 msgr2=0x7fd80c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.137+0000 7fd8115d3640 1 -- 172.21.15.88:0/832450994 shutdown_connections 2023-11-20T07:01:57.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.137+0000 7fd8115d3640 1 -- 172.21.15.88:0/832450994 wait complete. 2023-11-20T07:01:57.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd8115d3640 1 Processor -- start 2023-11-20T07:01:57.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd8115d3640 1 -- start start 2023-11-20T07:01:57.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd8115d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd80c0b84e0 0x7fd80c14be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd8115d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd80c0d0210 0x7fd80c14d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd8115d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd80c15cba0 0x7fd80c0cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd8115d3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c14cf90 con 0x7fd80c0b84e0 2023-11-20T07:01:57.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd8115d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c14c340 con 0x7fd80c0d0210 2023-11-20T07:01:57.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd8115d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c15a7b0 con 0x7fd80c15cba0 2023-11-20T07:01:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd80affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd80c0b84e0 0x7fd80c14be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd80affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd80c0b84e0 0x7fd80c14be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49262/0 (socket says 172.21.15.88:49262) 2023-11-20T07:01:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd80affd640 1 -- 172.21.15.88:0/1524877642 learned_addr learned my addr 172.21.15.88:0/1524877642 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd8027fc640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd80c0d0210 0x7fd80c14d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd80b7fe640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd80c15cba0 0x7fd80c0cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd80affd640 1 -- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd80c15cba0 msgr2=0x7fd80c0cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd80affd640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd80c15cba0 0x7fd80c0cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd80affd640 1 -- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd80c0d0210 msgr2=0x7fd80c14d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd80affd640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd80c0d0210 0x7fd80c14d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd80affd640 1 -- 172.21.15.88:0/1524877642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd804009420 con 0x7fd80c0b84e0 2023-11-20T07:01:57.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd80affd640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd80c0b84e0 0x7fd80c14be00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00e7f0 tx=0x7fd7fc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:57.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd803fff640 1 -- 172.21.15.88:0/1524877642 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc009580 con 0x7fd80c0b84e0 2023-11-20T07:01:57.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd803fff640 1 -- 172.21.15.88:0/1524877642 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc00c940 con 0x7fd80c0b84e0 2023-11-20T07:01:57.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd803fff640 1 -- 172.21.15.88:0/1524877642 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc00ccf0 con 0x7fd80c0b84e0 2023-11-20T07:01:57.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd8115d3640 1 -- 172.21.15.88:0/1524877642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80c15aa90 con 0x7fd80c0b84e0 2023-11-20T07:01:57.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.141+0000 7fd8115d3640 1 -- 172.21.15.88:0/1524877642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c14d230 con 0x7fd80c0b84e0 2023-11-20T07:01:57.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.145+0000 7fd8115d3640 1 -- 172.21.15.88:0/1524877642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80c0cd190 con 0x7fd80c0b84e0 2023-11-20T07:01:57.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.145+0000 7fd803fff640 1 -- 172.21.15.88:0/1524877642 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd7fc013470 con 0x7fd80c0b84e0 2023-11-20T07:01:57.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.145+0000 7fd803fff640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd7ec0664a0 0x7fd7ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.145+0000 7fd803fff640 1 -- 172.21.15.88:0/1524877642 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd7fc084350 con 0x7fd80c0b84e0 2023-11-20T07:01:57.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.145+0000 7fd8027fc640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd7ec0664a0 0x7fd7ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.145+0000 7fd8027fc640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd7ec0664a0 0x7fd7ec068960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40012f0 tx=0x7fd7f4001700 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:57.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.149+0000 7fd803fff640 1 -- 172.21.15.88:0/1524877642 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd7fc051420 con 0x7fd80c0b84e0 2023-11-20T07:01:57.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.297+0000 7fd8115d3640 1 -- 172.21.15.88:0/1524877642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd80c072fe0 con 0x7fd80c0b84e0 2023-11-20T07:01:57.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.297+0000 7fd803fff640 1 -- 172.21.15.88:0/1524877642 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd7fc054a40 con 0x7fd80c0b84e0 2023-11-20T07:01:57.300 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:57.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.301+0000 7fd8115d3640 1 -- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd7ec0664a0 msgr2=0x7fd7ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.301+0000 7fd8115d3640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd7ec0664a0 0x7fd7ec068960 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40012f0 tx=0x7fd7f4001700 comp rx=0 tx=0).stop 2023-11-20T07:01:57.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.301+0000 7fd8115d3640 1 -- 172.21.15.88:0/1524877642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd80c0b84e0 msgr2=0x7fd80c14be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.301+0000 7fd8115d3640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd80c0b84e0 0x7fd80c14be00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00e7f0 tx=0x7fd7fc00ecb0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.301+0000 7fd8115d3640 1 -- 172.21.15.88:0/1524877642 shutdown_connections 2023-11-20T07:01:57.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.301+0000 7fd8115d3640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd7ec0664a0 0x7fd7ec068960 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.301+0000 7fd8115d3640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd80c15cba0 0x7fd80c0cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.301+0000 7fd8115d3640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd80c0d0210 0x7fd80c14d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.301+0000 7fd8115d3640 1 --2- 172.21.15.88:0/1524877642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd80c0b84e0 0x7fd80c14be00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.301+0000 7fd8115d3640 1 -- 172.21.15.88:0/1524877642 >> 172.21.15.88:0/1524877642 conn(0x7fd80c0719c0 msgr2=0x7fd80c154700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.301+0000 7fd8115d3640 1 -- 172.21.15.88:0/1524877642 shutdown_connections 2023-11-20T07:01:57.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.301+0000 7fd8115d3640 1 -- 172.21.15.88:0/1524877642 wait complete. 2023-11-20T07:01:57.320 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T07:01:57.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdccbdf8640 1 Processor -- start 2023-11-20T07:01:57.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdccbdf8640 1 -- start start 2023-11-20T07:01:57.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdccbdf8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4159ba0 0x7fdcc40cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdccbdf8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc40723d0 con 0x7fdcc40c8cb0 2023-11-20T07:01:57.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdccbdf8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc40717c0 con 0x7fdcc41597c0 2023-11-20T07:01:57.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdccbdf8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4071aa0 con 0x7fdcc4159ba0 2023-11-20T07:01:57.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcca395640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdcc40c8cb0 0x7fdcc40cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51090/0 (socket says 172.21.15.88:51090) 2023-11-20T07:01:57.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcca395640 1 -- 172.21.15.88:0/1517787993 learned_addr learned my addr 172.21.15.88:0/1517787993 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:57.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794075921 0 0) 0x7fdcc40723d0 con 0x7fdcc40c8cb0 2023-11-20T07:01:57.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb0003530 con 0x7fdcc40c8cb0 2023-11-20T07:01:57.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc9393640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4159ba0 0x7fdcc40cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1727087825 0 0) 0x7fdcb0003530 con 0x7fdcc40c8cb0 2023-11-20T07:01:57.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4159ba0 msgr2=0x7fdcc40cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:57.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4159ba0 0x7fdcc40cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 >> v1:172.21.15.175:6789/0 conn(0x7fdcc41597c0 legacy=0x7fdcc40ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4071d80 con 0x7fdcc40c8cb0 2023-11-20T07:01:57.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fdcbc001a00 con 0x7fdcc40c8cb0 2023-11-20T07:01:57.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 >> v1:172.21.15.88:6789/0 conn(0x7fdcc40c8cb0 legacy=0x7fdcc40cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb00039b0 0x7fdcb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4159ba0 0x7fdcb00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb0004d10 0x7fdcb0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4071aa0 con 0x7fdcb00039b0 2023-11-20T07:01:57.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb000ba40 con 0x7fdcb0004d10 2023-11-20T07:01:57.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.457+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb000bc00 con 0x7fdcc4159ba0 2023-11-20T07:01:57.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcc9b94640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb00039b0 0x7fdcb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcc9393640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4159ba0 0x7fdcb00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcca395640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb0004d10 0x7fdcb0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcc9b94640 1 -- 172.21.15.88:0/1517787993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4159ba0 msgr2=0x7fdcb00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:57.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcc9b94640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4159ba0 0x7fdcb00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcc9b94640 1 -- 172.21.15.88:0/1517787993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb0004d10 msgr2=0x7fdcb0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:57.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcc9b94640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb0004d10 0x7fdcb0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcc9b94640 1 -- 172.21.15.88:0/1517787993 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0003530 con 0x7fdcb00039b0 2023-11-20T07:01:57.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcca395640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb0004d10 0x7fdcb0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:57.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcc9b94640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb00039b0 0x7fdcb0003dd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0001750 tx=0x7fdcc001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1fd5d2419ef43c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:57.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00052d0 con 0x7fdcb00039b0 2023-11-20T07:01:57.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc00a7050 con 0x7fdcb00039b0 2023-11-20T07:01:57.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.461+0000 7fdcc8b92640 1 -- 172.21.15.88:0/1517787993 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0003600 con 0x7fdcb00039b0 2023-11-20T07:01:57.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 -- 172.21.15.88:0/1517787993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb00039b0 msgr2=0x7fdcb0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 --2- 172.21.15.88:0/1517787993 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb00039b0 0x7fdcb0003dd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0001750 tx=0x7fdcc001c3c0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdcca395640 1 -- 172.21.15.88:0/1517787993 reap_dead start 2023-11-20T07:01:57.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 -- 172.21.15.88:0/1517787993 shutdown_connections 2023-11-20T07:01:57.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 -- 172.21.15.88:0/1517787993 >> 172.21.15.88:0/1517787993 conn(0x7fdcc406c190 msgr2=0x7fdcc406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:57.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 -- 172.21.15.88:0/1517787993 shutdown_connections 2023-11-20T07:01:57.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 -- 172.21.15.88:0/1517787993 wait complete. 2023-11-20T07:01:57.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 Processor -- start 2023-11-20T07:01:57.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 -- start start 2023-11-20T07:01:57.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00039b0 0x7fdcc40c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc415d220 0x7fdcc415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4151b90 0x7fdcc4155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc415d680 con 0x7fdcc415d220 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc415ae10 con 0x7fdcb00039b0 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdccbdf8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc415b090 con 0x7fdcc4151b90 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdcc9393640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc415d220 0x7fdcc415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdcc9393640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc415d220 0x7fdcc415a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49282/0 (socket says 172.21.15.88:49282) 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdcc9393640 1 -- 172.21.15.88:0/2020537097 learned_addr learned my addr 172.21.15.88:0/2020537097 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdcca395640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4151b90 0x7fdcc4155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.465+0000 7fdcc9b94640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00039b0 0x7fdcc40c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcc9393640 1 -- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4151b90 msgr2=0x7fdcc4155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcc9393640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4151b90 0x7fdcc4155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcc9393640 1 -- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00039b0 msgr2=0x7fdcc40c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.469 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcc9393640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00039b0 0x7fdcc40c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcc9393640 1 -- 172.21.15.88:0/2020537097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc415b370 con 0x7fdcc415d220 2023-11-20T07:01:57.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcc9b94640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00039b0 0x7fdcc40c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:57.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcc9393640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc415d220 0x7fdcc415a8d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40119d0 tx=0x7fdcb4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:57.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcba7fc640 1 -- 172.21.15.88:0/2020537097 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400fb50 con 0x7fdcc415d220 2023-11-20T07:01:57.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcba7fc640 1 -- 172.21.15.88:0/2020537097 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb400fcb0 con 0x7fdcc415d220 2023-11-20T07:01:57.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdccbdf8640 1 -- 172.21.15.88:0/2020537097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc415b650 con 0x7fdcc415d220 2023-11-20T07:01:57.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcba7fc640 1 -- 172.21.15.88:0/2020537097 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4014440 con 0x7fdcc415d220 2023-11-20T07:01:57.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdccbdf8640 1 -- 172.21.15.88:0/2020537097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc415bc10 con 0x7fdcc415d220 2023-11-20T07:01:57.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdccbdf8640 1 -- 172.21.15.88:0/2020537097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc415bdd0 con 0x7fdcc415d220 2023-11-20T07:01:57.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcba7fc640 1 -- 172.21.15.88:0/2020537097 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdcb40145a0 con 0x7fdcc415d220 2023-11-20T07:01:57.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcba7fc640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdca80664a0 0x7fdca8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.469+0000 7fdcba7fc640 1 -- 172.21.15.88:0/2020537097 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdcb4084a10 con 0x7fdcc415d220 2023-11-20T07:01:57.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.473+0000 7fdcc9b94640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdca80664a0 0x7fdca8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.473+0000 7fdcc9b94640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdca80664a0 0x7fdca8068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00057b0 tx=0x7fdcc00011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:57.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.473+0000 7fdcba7fc640 1 -- 172.21.15.88:0/2020537097 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdcb4051af0 con 0x7fdcc415d220 2023-11-20T07:01:57.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.633+0000 7fdccbdf8640 1 -- 172.21.15.88:0/2020537097 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdcc4074010 con 0x7fdcc415d220 2023-11-20T07:01:57.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdcba7fc640 1 -- 172.21.15.88:0/2020537097 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdcb4055110 con 0x7fdcc415d220 2023-11-20T07:01:57.637 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-20T07:01:57.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdccbdf8640 1 -- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdca80664a0 msgr2=0x7fdca8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdccbdf8640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdca80664a0 0x7fdca8068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00057b0 tx=0x7fdcc00011a0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdccbdf8640 1 -- 172.21.15.88:0/2020537097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc415d220 msgr2=0x7fdcc415a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdccbdf8640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc415d220 0x7fdcc415a8d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40119d0 tx=0x7fdcb4011e90 comp rx=0 tx=0).stop 2023-11-20T07:01:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdccbdf8640 1 -- 172.21.15.88:0/2020537097 shutdown_connections 2023-11-20T07:01:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdccbdf8640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fdca80664a0 0x7fdca8068960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdccbdf8640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4151b90 0x7fdcc4155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdccbdf8640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc415d220 0x7fdcc415a8d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdccbdf8640 1 --2- 172.21.15.88:0/2020537097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00039b0 0x7fdcc40c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdccbdf8640 1 -- 172.21.15.88:0/2020537097 >> 172.21.15.88:0/2020537097 conn(0x7fdcc406c190 msgr2=0x7fdcc4163da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdccbdf8640 1 -- 172.21.15.88:0/2020537097 shutdown_connections 2023-11-20T07:01:57.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.637+0000 7fdccbdf8640 1 -- 172.21.15.88:0/2020537097 wait complete. 2023-11-20T07:01:57.662 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:01:57.662 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:57.671 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:57.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9feaea640 1 Processor -- start 2023-11-20T07:01:57.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9feaea640 1 -- start start 2023-11-20T07:01:57.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9feaea640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff9f81597c0 0x7ff9f80ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9feaea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9f80adc10 0x7ff9f80cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9feaea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f80723d0 con 0x7ff9f8159ba0 2023-11-20T07:01:57.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9feaea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f80717c0 con 0x7ff9f80adc10 2023-11-20T07:01:57.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9feaea640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f8071aa0 con 0x7ff9f81597c0 2023-11-20T07:01:57.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9fd087640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9f80adc10 0x7ff9f80cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9effff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff9f8159ba0 0x7ff9f80cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51100/0 (socket says 172.21.15.88:51100) 2023-11-20T07:01:57.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9fd087640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9f80adc10 0x7ff9f80cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49288/0 (socket says 172.21.15.88:49288) 2023-11-20T07:01:57.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9effff640 1 -- 172.21.15.88:0/3340310382 learned_addr learned my addr 172.21.15.88:0/3340310382 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:57.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9fc886640 1 --2- 172.21.15.88:0/3340310382 >> v2:172.21.15.175:3300/0 conn(0x7ff9f81597c0 0x7ff9f80ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9fd087640 1 -- 172.21.15.88:0/3340310382 >> v2:172.21.15.175:3300/0 conn(0x7ff9f81597c0 msgr2=0x7ff9f80ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:57.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9fd087640 1 --2- 172.21.15.88:0/3340310382 >> v2:172.21.15.175:3300/0 conn(0x7ff9f81597c0 0x7ff9f80ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9ef7fe640 1 -- 172.21.15.88:0/3340310382 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190475262 0 0) 0x7ff9f80723d0 con 0x7ff9f8159ba0 2023-11-20T07:01:57.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9fd087640 1 -- 172.21.15.88:0/3340310382 >> v1:172.21.15.88:6789/0 conn(0x7ff9f8159ba0 legacy=0x7ff9f80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.853+0000 7ff9fd087640 1 -- 172.21.15.88:0/3340310382 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f8071d80 con 0x7ff9f80adc10 2023-11-20T07:01:57.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.857+0000 7ff9fd087640 1 --2- 172.21.15.88:0/3340310382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f80adc10 0x7ff9f80cb520 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80cdaf0 tx=0x7ff9f001eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7650e4259822e50 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:57.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.857+0000 7ff9ef7fe640 1 -- 172.21.15.88:0/3340310382 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000b2d0 con 0x7ff9f80adc10 2023-11-20T07:01:57.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.857+0000 7ff9ef7fe640 1 -- 172.21.15.88:0/3340310382 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f00a7980 con 0x7ff9f80adc10 2023-11-20T07:01:57.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.857+0000 7ff9ef7fe640 1 -- 172.21.15.88:0/3340310382 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00a7d10 con 0x7ff9f80adc10 2023-11-20T07:01:57.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.857+0000 7ff9feaea640 1 -- 172.21.15.88:0/3340310382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f80adc10 msgr2=0x7ff9f80cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.857+0000 7ff9feaea640 1 --2- 172.21.15.88:0/3340310382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f80adc10 0x7ff9f80cb520 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80cdaf0 tx=0x7ff9f001eb10 comp rx=0 tx=0).stop 2023-11-20T07:01:57.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.857+0000 7ff9feaea640 1 -- 172.21.15.88:0/3340310382 shutdown_connections 2023-11-20T07:01:57.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.857+0000 7ff9feaea640 1 --2- 172.21.15.88:0/3340310382 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f80adc10 0x7ff9f80cb520 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.857+0000 7ff9feaea640 1 --2- 172.21.15.88:0/3340310382 >> v2:172.21.15.175:3300/0 conn(0x7ff9f81597c0 0x7ff9f80ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.857+0000 7ff9feaea640 1 -- 172.21.15.88:0/3340310382 >> 172.21.15.88:0/3340310382 conn(0x7ff9f806c190 msgr2=0x7ff9f806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:57.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.857+0000 7ff9feaea640 1 -- 172.21.15.88:0/3340310382 shutdown_connections 2023-11-20T07:01:57.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.857+0000 7ff9feaea640 1 -- 172.21.15.88:0/3340310382 wait complete. 2023-11-20T07:01:57.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9feaea640 1 Processor -- start 2023-11-20T07:01:57.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9feaea640 1 -- start start 2023-11-20T07:01:57.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9feaea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f80adc10 0x7ff9f80c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9feaea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9f81597c0 0x7ff9f8151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9feaea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8159ba0 0x7ff9f80c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9feaea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8151ac0 con 0x7ff9f8159ba0 2023-11-20T07:01:57.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9feaea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f81f9590 con 0x7ff9f80adc10 2023-11-20T07:01:57.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9feaea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8151470 con 0x7ff9f81597c0 2023-11-20T07:01:57.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9fd087640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8159ba0 0x7ff9f80c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9fd087640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8159ba0 0x7ff9f80c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49296/0 (socket says 172.21.15.88:49296) 2023-11-20T07:01:57.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9fd087640 1 -- 172.21.15.88:0/4104515303 learned_addr learned my addr 172.21.15.88:0/4104515303 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:57.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9fc886640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f80adc10 0x7ff9f80c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9effff640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9f81597c0 0x7ff9f8151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9fd087640 1 -- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9f81597c0 msgr2=0x7ff9f8151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9fd087640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9f81597c0 0x7ff9f8151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9fd087640 1 -- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f80adc10 msgr2=0x7ff9f80c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:57.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9fd087640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f80adc10 0x7ff9f80c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:57.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9fd087640 1 -- 172.21.15.88:0/4104515303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f000bc80 con 0x7ff9f8159ba0 2023-11-20T07:01:57.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9fc886640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f80adc10 0x7ff9f80c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:57.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9effff640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9f81597c0 0x7ff9f8151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:57.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9fd087640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8159ba0 0x7ff9f80c75a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff9f001b720 tx=0x7ff9f001b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:57.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9ed7fa640 1 -- 172.21.15.88:0/4104515303 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0009740 con 0x7ff9f8159ba0 2023-11-20T07:01:57.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9ed7fa640 1 -- 172.21.15.88:0/4104515303 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f00098a0 con 0x7ff9f8159ba0 2023-11-20T07:01:57.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9feaea640 1 -- 172.21.15.88:0/4104515303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f8151750 con 0x7ff9f8159ba0 2023-11-20T07:01:57.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9ed7fa640 1 -- 172.21.15.88:0/4104515303 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0009c90 con 0x7ff9f8159ba0 2023-11-20T07:01:57.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.861+0000 7ff9feaea640 1 -- 172.21.15.88:0/4104515303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f8151120 con 0x7ff9f8159ba0 2023-11-20T07:01:57.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.865+0000 7ff9feaea640 1 -- 172.21.15.88:0/4104515303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f8151c30 con 0x7ff9f8159ba0 2023-11-20T07:01:57.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.865+0000 7ff9ed7fa640 1 -- 172.21.15.88:0/4104515303 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff9f00c3460 con 0x7ff9f8159ba0 2023-11-20T07:01:57.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.865+0000 7ff9ed7fa640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff9e40664a0 0x7ff9e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:57.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.865+0000 7ff9ed7fa640 1 -- 172.21.15.88:0/4104515303 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff9f011f6f0 con 0x7ff9f8159ba0 2023-11-20T07:01:57.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.865+0000 7ff9fc886640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff9e40664a0 0x7ff9e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:57.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.865+0000 7ff9fc886640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff9e40664a0 0x7ff9e4068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009ae0 tx=0x7ff9f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:57.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:57.869+0000 7ff9ed7fa640 1 -- 172.21.15.88:0/4104515303 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff9f00ec7a0 con 0x7ff9f8159ba0 2023-11-20T07:01:58.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.017+0000 7ff9feaea640 1 -- 172.21.15.88:0/4104515303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9f8074010 con 0x7ff9f8159ba0 2023-11-20T07:01:58.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9ed7fa640 1 -- 172.21.15.88:0/4104515303 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7ff9f00efdc0 con 0x7ff9f8159ba0 2023-11-20T07:01:58.022 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:01:58.022 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:01:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9feaea640 1 -- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff9e40664a0 msgr2=0x7ff9e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9feaea640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff9e40664a0 0x7ff9e4068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009ae0 tx=0x7ff9f4008040 comp rx=0 tx=0).stop 2023-11-20T07:01:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9feaea640 1 -- 172.21.15.88:0/4104515303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8159ba0 msgr2=0x7ff9f80c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9feaea640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8159ba0 0x7ff9f80c75a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff9f001b720 tx=0x7ff9f001b8b0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9feaea640 1 -- 172.21.15.88:0/4104515303 shutdown_connections 2023-11-20T07:01:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9feaea640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7ff9e40664a0 0x7ff9e4068960 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9feaea640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9f81597c0 0x7ff9f8151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9feaea640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9f8159ba0 0x7ff9f80c75a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9feaea640 1 --2- 172.21.15.88:0/4104515303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f80adc10 0x7ff9f80c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9feaea640 1 -- 172.21.15.88:0/4104515303 >> 172.21.15.88:0/4104515303 conn(0x7ff9f806c190 msgr2=0x7ff9f80ce6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:58.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9feaea640 1 -- 172.21.15.88:0/4104515303 shutdown_connections 2023-11-20T07:01:58.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.021+0000 7ff9feaea640 1 -- 172.21.15.88:0/4104515303 wait complete. 2023-11-20T07:01:58.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:01:58.044 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:01:58.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.181+0000 7f7014964640 1 Processor -- start 2023-11-20T07:01:58.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.181+0000 7f7014964640 1 -- start start 2023-11-20T07:01:58.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f7014964640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f701015cdc0 0x7f70100cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f7014964640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70100b3cb0 0x7f70100cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f7014964640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70100d0880 con 0x7f70100cf210 2023-11-20T07:01:58.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f7014964640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70100b1c00 con 0x7f70100b3cb0 2023-11-20T07:01:58.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f7014964640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70100b1ee0 con 0x7f701015cdc0 2023-11-20T07:01:58.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f700f59e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70100b3cb0 0x7f70100cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f700f59e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70100b3cb0 0x7f70100cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49312/0 (socket says 172.21.15.88:49312) 2023-11-20T07:01:58.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f700f59e640 1 -- 172.21.15.88:0/196845042 learned_addr learned my addr 172.21.15.88:0/196845042 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:58.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f700659c640 1 --2- 172.21.15.88:0/196845042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f701015cdc0 0x7f70100cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f700f59e640 1 -- 172.21.15.88:0/196845042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f701015cdc0 msgr2=0x7f70100cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:58.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f700f59e640 1 --2- 172.21.15.88:0/196845042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f701015cdc0 0x7f70100cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f700f59e640 1 -- 172.21.15.88:0/196845042 >> v1:172.21.15.175:6789/0 conn(0x7f70100cf210 legacy=0x7f70100cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:58.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f700f59e640 1 -- 172.21.15.88:0/196845042 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70100b21c0 con 0x7f70100b3cb0 2023-11-20T07:01:58.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.185+0000 7f700659c640 1 --2- 172.21.15.88:0/196845042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f701015cdc0 0x7f70100cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:58.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f700f59e640 1 --2- 172.21.15.88:0/196845042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70100b3cb0 0x7f70100cda00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7008009e50 tx=0x7f700801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68dd966db435538 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:58.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f700e59c640 1 -- 172.21.15.88:0/196845042 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080a5730 con 0x7f70100b3cb0 2023-11-20T07:01:58.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f700e59c640 1 -- 172.21.15.88:0/196845042 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70080a5890 con 0x7f70100b3cb0 2023-11-20T07:01:58.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f700e59c640 1 -- 172.21.15.88:0/196845042 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080a5c20 con 0x7f70100b3cb0 2023-11-20T07:01:58.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f7014964640 1 -- 172.21.15.88:0/196845042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70100b3cb0 msgr2=0x7f70100cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f7014964640 1 --2- 172.21.15.88:0/196845042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70100b3cb0 0x7f70100cda00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7008009e50 tx=0x7f700801c9a0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f7014964640 1 -- 172.21.15.88:0/196845042 shutdown_connections 2023-11-20T07:01:58.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f7014964640 1 --2- 172.21.15.88:0/196845042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70100b3cb0 0x7f70100cda00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f7014964640 1 --2- 172.21.15.88:0/196845042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f701015cdc0 0x7f70100cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f7014964640 1 -- 172.21.15.88:0/196845042 >> 172.21.15.88:0/196845042 conn(0x7f70100d2800 msgr2=0x7f70100d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:58.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f7014964640 1 -- 172.21.15.88:0/196845042 shutdown_connections 2023-11-20T07:01:58.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f7014964640 1 -- 172.21.15.88:0/196845042 wait complete. 2023-11-20T07:01:58.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f7014964640 1 Processor -- start 2023-11-20T07:01:58.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.189+0000 7f7014964640 1 -- start start 2023-11-20T07:01:58.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7014964640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70100b3cb0 0x7f7010150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7014964640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70100cf210 0x7f701006af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7014964640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f701015cdc0 0x7f701006b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7014964640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701015e0b0 con 0x7f70100b3cb0 2023-11-20T07:01:58.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7014964640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701015e390 con 0x7f701015cdc0 2023-11-20T07:01:58.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7014964640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701015e670 con 0x7f70100cf210 2023-11-20T07:01:58.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f700ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70100b3cb0 0x7f7010150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f700ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70100b3cb0 0x7f7010150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49316/0 (socket says 172.21.15.88:49316) 2023-11-20T07:01:58.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f700ed9d640 1 -- 172.21.15.88:0/1347115475 learned_addr learned my addr 172.21.15.88:0/1347115475 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:58.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f700f59e640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f701015cdc0 0x7f701006b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f700659c640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70100cf210 0x7f701006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f700ed9d640 1 -- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70100cf210 msgr2=0x7f701006af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f700ed9d640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70100cf210 0x7f701006af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f700ed9d640 1 -- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f701015cdc0 msgr2=0x7f701006b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f700ed9d640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f701015cdc0 0x7f701006b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f700ed9d640 1 -- 172.21.15.88:0/1347115475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7008009b30 con 0x7f70100b3cb0 2023-11-20T07:01:58.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f700f59e640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f701015cdc0 0x7f701006b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:58.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f700ed9d640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70100b3cb0 0x7f7010150b40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f700000c430 tx=0x7f700000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:58.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7007fff640 1 -- 172.21.15.88:0/1347115475 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000011790 con 0x7f70100b3cb0 2023-11-20T07:01:58.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7007fff640 1 -- 172.21.15.88:0/1347115475 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70000118f0 con 0x7f70100b3cb0 2023-11-20T07:01:58.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7007fff640 1 -- 172.21.15.88:0/1347115475 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000011ce0 con 0x7f70100b3cb0 2023-11-20T07:01:58.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7014964640 1 -- 172.21.15.88:0/1347115475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701015e950 con 0x7f70100b3cb0 2023-11-20T07:01:58.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7014964640 1 -- 172.21.15.88:0/1347115475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7010151080 con 0x7f70100b3cb0 2023-11-20T07:01:58.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7014964640 1 -- 172.21.15.88:0/1347115475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701015ee70 con 0x7f70100b3cb0 2023-11-20T07:01:58.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.193+0000 7f7007fff640 1 -- 172.21.15.88:0/1347115475 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7000012420 con 0x7f70100b3cb0 2023-11-20T07:01:58.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.197+0000 7f7007fff640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6ff00664d0 0x7f6ff0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.197+0000 7f7007fff640 1 -- 172.21.15.88:0/1347115475 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7000083dd0 con 0x7f70100b3cb0 2023-11-20T07:01:58.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.197+0000 7f700659c640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6ff00664d0 0x7f6ff0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.197+0000 7f700659c640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6ff00664d0 0x7f6ff0068990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8006fd0 tx=0x7f6ff8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:58.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.201+0000 7f7007fff640 1 -- 172.21.15.88:0/1347115475 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7000050e90 con 0x7f70100b3cb0 2023-11-20T07:01:58.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.353+0000 7f7014964640 1 -- 172.21.15.88:0/1347115475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f701015eae0 con 0x7f70100b3cb0 2023-11-20T07:01:58.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.353+0000 7f7007fff640 1 -- 172.21.15.88:0/1347115475 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70000850a0 con 0x7f70100b3cb0 2023-11-20T07:01:58.355 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:01:58.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.357+0000 7f7014964640 1 -- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6ff00664d0 msgr2=0x7f6ff0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.357+0000 7f7014964640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6ff00664d0 0x7f6ff0068990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8006fd0 tx=0x7f6ff8008040 comp rx=0 tx=0).stop 2023-11-20T07:01:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.357+0000 7f7014964640 1 -- 172.21.15.88:0/1347115475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70100b3cb0 msgr2=0x7f7010150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.357+0000 7f7014964640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70100b3cb0 0x7f7010150b40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f700000c430 tx=0x7f700000c8f0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.357+0000 7f7014964640 1 -- 172.21.15.88:0/1347115475 shutdown_connections 2023-11-20T07:01:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.357+0000 7f7014964640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6ff00664d0 0x7f6ff0068990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.357+0000 7f7014964640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70100cf210 0x7f701006af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.357+0000 7f7014964640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f701015cdc0 0x7f701006b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.357+0000 7f7014964640 1 --2- 172.21.15.88:0/1347115475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70100b3cb0 0x7f7010150b40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.357+0000 7f7014964640 1 -- 172.21.15.88:0/1347115475 >> 172.21.15.88:0/1347115475 conn(0x7f70100d2800 msgr2=0x7f701006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:58.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.357+0000 7f7014964640 1 -- 172.21.15.88:0/1347115475 shutdown_connections 2023-11-20T07:01:58.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.357+0000 7f7014964640 1 -- 172.21.15.88:0/1347115475 wait complete. 2023-11-20T07:01:58.378 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:01:58.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe965365640 1 Processor -- start 2023-11-20T07:01:58.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe965365640 1 -- start start 2023-11-20T07:01:58.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe965365640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9600cdcd0 0x7fe960159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe965365640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe960071cd0 0x7fe9600cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe965365640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96015a590 con 0x7fe9600cadd0 2023-11-20T07:01:58.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe965365640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9600cac70 con 0x7fe9600cdcd0 2023-11-20T07:01:58.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe965365640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96015a870 con 0x7fe960071cd0 2023-11-20T07:01:58.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe9567fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9600cdcd0 0x7fe960159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe9567fc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9600cdcd0 0x7fe960159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49320/0 (socket says 172.21.15.88:49320) 2023-11-20T07:01:58.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe9567fc640 1 -- 172.21.15.88:0/3053685525 learned_addr learned my addr 172.21.15.88:0/3053685525 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:58.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe95f7fe640 1 --2- 172.21.15.88:0/3053685525 >> v2:172.21.15.175:3300/0 conn(0x7fe960071cd0 0x7fe9600cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe9567fc640 1 -- 172.21.15.88:0/3053685525 >> v2:172.21.15.175:3300/0 conn(0x7fe960071cd0 msgr2=0x7fe9600cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe9567fc640 1 --2- 172.21.15.88:0/3053685525 >> v2:172.21.15.175:3300/0 conn(0x7fe960071cd0 0x7fe9600cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe9567fc640 1 -- 172.21.15.88:0/3053685525 >> v1:172.21.15.88:6789/0 conn(0x7fe9600cadd0 legacy=0x7fe9600cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.517+0000 7fe9567fc640 1 -- 172.21.15.88:0/3053685525 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9600714d0 con 0x7fe9600cdcd0 2023-11-20T07:01:58.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.521+0000 7fe9567fc640 1 --2- 172.21.15.88:0/3053685525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9600cdcd0 0x7fe960159c20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe9600c89a0 tx=0x7fe94801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103f05ae72204242 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.521+0000 7fe95e7fc640 1 -- 172.21.15.88:0/3053685525 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9480ac640 con 0x7fe9600cdcd0 2023-11-20T07:01:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.521+0000 7fe95e7fc640 1 -- 172.21.15.88:0/3053685525 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9480ac7a0 con 0x7fe9600cdcd0 2023-11-20T07:01:58.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.521+0000 7fe95e7fc640 1 -- 172.21.15.88:0/3053685525 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9480acb30 con 0x7fe9600cdcd0 2023-11-20T07:01:58.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.521+0000 7fe965365640 1 -- 172.21.15.88:0/3053685525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9600cdcd0 msgr2=0x7fe960159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.521+0000 7fe965365640 1 --2- 172.21.15.88:0/3053685525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9600cdcd0 0x7fe960159c20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe9600c89a0 tx=0x7fe94801c4d0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.521+0000 7fe965365640 1 -- 172.21.15.88:0/3053685525 shutdown_connections 2023-11-20T07:01:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.521+0000 7fe965365640 1 --2- 172.21.15.88:0/3053685525 >> v2:172.21.15.175:3300/0 conn(0x7fe960071cd0 0x7fe9600cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.521+0000 7fe965365640 1 --2- 172.21.15.88:0/3053685525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9600cdcd0 0x7fe960159c20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.521+0000 7fe965365640 1 -- 172.21.15.88:0/3053685525 >> 172.21.15.88:0/3053685525 conn(0x7fe96006a6e0 msgr2=0x7fe9600afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.521+0000 7fe965365640 1 -- 172.21.15.88:0/3053685525 shutdown_connections 2023-11-20T07:01:58.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.521+0000 7fe965365640 1 -- 172.21.15.88:0/3053685525 wait complete. 2023-11-20T07:01:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe965365640 1 Processor -- start 2023-11-20T07:01:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe965365640 1 -- start start 2023-11-20T07:01:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe965365640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe960071cd0 0x7fe960154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe965365640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9600cadd0 0x7fe960151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe965365640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9600cdcd0 0x7fe9600c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe965365640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe960151970 con 0x7fe960071cd0 2023-11-20T07:01:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe965365640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe960153330 con 0x7fe9600cadd0 2023-11-20T07:01:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe965365640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe960153610 con 0x7fe9600cdcd0 2023-11-20T07:01:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe95effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe960071cd0 0x7fe960154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe95effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe960071cd0 0x7fe960154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49334/0 (socket says 172.21.15.88:49334) 2023-11-20T07:01:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe95effd640 1 -- 172.21.15.88:0/3197009486 learned_addr learned my addr 172.21.15.88:0/3197009486 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe9567fc640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9600cadd0 0x7fe960151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe95f7fe640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9600cdcd0 0x7fe9600c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe95effd640 1 -- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9600cdcd0 msgr2=0x7fe9600c1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe95effd640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9600cdcd0 0x7fe9600c1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe95effd640 1 -- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9600cadd0 msgr2=0x7fe960151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe95effd640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9600cadd0 0x7fe960151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe95effd640 1 -- 172.21.15.88:0/3197009486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9480094d0 con 0x7fe960071cd0 2023-11-20T07:01:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe9567fc640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9600cadd0 0x7fe960151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe95effd640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe960071cd0 0x7fe960154de0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c500 tx=0x7fe95000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe957fff640 1 -- 172.21.15.88:0/3197009486 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe950005220 con 0x7fe960071cd0 2023-11-20T07:01:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe957fff640 1 -- 172.21.15.88:0/3197009486 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe950005380 con 0x7fe960071cd0 2023-11-20T07:01:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe957fff640 1 -- 172.21.15.88:0/3197009486 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe950007270 con 0x7fe960071cd0 2023-11-20T07:01:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe965365640 1 -- 172.21.15.88:0/3197009486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96015aed0 con 0x7fe960071cd0 2023-11-20T07:01:58.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe965365640 1 -- 172.21.15.88:0/3197009486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9600c2430 con 0x7fe960071cd0 2023-11-20T07:01:58.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.525+0000 7fe965365640 1 -- 172.21.15.88:0/3197009486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe960073fa0 con 0x7fe960071cd0 2023-11-20T07:01:58.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.529+0000 7fe957fff640 1 -- 172.21.15.88:0/3197009486 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe9500073d0 con 0x7fe960071cd0 2023-11-20T07:01:58.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.529+0000 7fe957fff640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe9400664a0 0x7fe940068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.529+0000 7fe957fff640 1 -- 172.21.15.88:0/3197009486 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe950083b20 con 0x7fe960071cd0 2023-11-20T07:01:58.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.529+0000 7fe9567fc640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe9400664a0 0x7fe940068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.529+0000 7fe9567fc640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe9400664a0 0x7fe940068960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe9480ae000 tx=0x7fe948008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:58.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.533+0000 7fe957fff640 1 -- 172.21.15.88:0/3197009486 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe950050bf0 con 0x7fe960071cd0 2023-11-20T07:01:58.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 -- 172.21.15.88:0/3197009486 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9600b03c0 con 0x7fe960071cd0 2023-11-20T07:01:58.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe957fff640 1 -- 172.21.15.88:0/3197009486 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe950054210 con 0x7fe960071cd0 2023-11-20T07:01:58.685 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:58.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 -- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe9400664a0 msgr2=0x7fe940068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe9400664a0 0x7fe940068960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe9480ae000 tx=0x7fe948008040 comp rx=0 tx=0).stop 2023-11-20T07:01:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 -- 172.21.15.88:0/3197009486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe960071cd0 msgr2=0x7fe960154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe960071cd0 0x7fe960154de0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c500 tx=0x7fe95000c9c0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 -- 172.21.15.88:0/3197009486 shutdown_connections 2023-11-20T07:01:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe9400664a0 0x7fe940068960 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9600cdcd0 0x7fe9600c1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9600cadd0 0x7fe960151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 --2- 172.21.15.88:0/3197009486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe960071cd0 0x7fe960154de0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 -- 172.21.15.88:0/3197009486 >> 172.21.15.88:0/3197009486 conn(0x7fe96006a6e0 msgr2=0x7fe9600729b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:58.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 -- 172.21.15.88:0/3197009486 shutdown_connections 2023-11-20T07:01:58.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.685+0000 7fe965365640 1 -- 172.21.15.88:0/3197009486 wait complete. 2023-11-20T07:01:58.707 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:01:58.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.845+0000 7f6bb3f3e640 1 Processor -- start 2023-11-20T07:01:58.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.845+0000 7f6bb3f3e640 1 -- start start 2023-11-20T07:01:58.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.845+0000 7f6bb3f3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bac159900 0x7f6bac06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.845+0000 7f6bb3f3e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bac0b4360 con 0x7f6bac0b3f00 2023-11-20T07:01:58.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.845+0000 7f6bb3f3e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bac0b4600 con 0x7f6bac06a5a0 2023-11-20T07:01:58.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.845+0000 7f6bb3f3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0cd740 con 0x7f6bac159900 2023-11-20T07:01:58.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.845+0000 7f6bb14d9640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6bac0b3f00 0x7f6bac069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51126/0 (socket says 172.21.15.88:51126) 2023-11-20T07:01:58.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.845+0000 7f6bb14d9640 1 -- 172.21.15.88:0/3577454663 learned_addr learned my addr 172.21.15.88:0/3577454663 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:58.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909955517 0 0) 0x7f6bac0b4360 con 0x7f6bac0b3f00 2023-11-20T07:01:58.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b98005740 con 0x7f6bac0b3f00 2023-11-20T07:01:58.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb1cda640 1 --2- 172.21.15.88:0/3577454663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bac159900 0x7f6bac06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1263386031 0 0) 0x7f6b98005740 con 0x7f6bac0b3f00 2023-11-20T07:01:58.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bac159900 msgr2=0x7f6bac06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:58.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 --2- 172.21.15.88:0/3577454663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bac159900 0x7f6bac06e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 >> v1:172.21.15.175:6789/0 conn(0x7f6bac06a5a0 legacy=0x7f6bac0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:58.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac0c8dd0 con 0x7f6bac0b3f00 2023-11-20T07:01:58.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f6b9c001680 con 0x7f6bac0b3f00 2023-11-20T07:01:58.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 >> v1:172.21.15.88:6789/0 conn(0x7f6bac0b3f00 legacy=0x7f6bac069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 --2- 172.21.15.88:0/3577454663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b98005bc0 0x7f6b98006000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 --2- 172.21.15.88:0/3577454663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bac159900 0x7f6b980069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 --2- 172.21.15.88:0/3577454663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b98006f20 0x7f6b980073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0cd740 con 0x7f6b98005bc0 2023-11-20T07:01:58.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9800dc50 con 0x7f6b98006f20 2023-11-20T07:01:58.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9800de10 con 0x7f6bac159900 2023-11-20T07:01:58.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb1cda640 1 --2- 172.21.15.88:0/3577454663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b98005bc0 0x7f6b98006000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb1cda640 1 -- 172.21.15.88:0/3577454663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bac159900 msgr2=0x7f6b980069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb1cda640 1 --2- 172.21.15.88:0/3577454663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bac159900 0x7f6b980069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb1cda640 1 -- 172.21.15.88:0/3577454663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b98006f20 msgr2=0x7f6b980073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb1cda640 1 --2- 172.21.15.88:0/3577454663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b98006f20 0x7f6b980073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.849+0000 7f6bb1cda640 1 -- 172.21.15.88:0/3577454663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98005740 con 0x7f6b98005bc0 2023-11-20T07:01:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb1cda640 1 --2- 172.21.15.88:0/3577454663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b98005bc0 0x7f6b98006000 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009ab0 tx=0x7f6ba801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41964b22de18b17 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:58.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80a5520 con 0x7f6b98005bc0 2023-11-20T07:01:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba80a5680 con 0x7f6b98005bc0 2023-11-20T07:01:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb0cd8640 1 -- 172.21.15.88:0/3577454663 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80a5a30 con 0x7f6b98005bc0 2023-11-20T07:01:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/3577454663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b98005bc0 msgr2=0x7f6b98006000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 --2- 172.21.15.88:0/3577454663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b98005bc0 0x7f6b98006000 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009ab0 tx=0x7f6ba801ca40 comp rx=0 tx=0).stop 2023-11-20T07:01:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb24db640 1 -- 172.21.15.88:0/3577454663 reap_dead start 2023-11-20T07:01:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/3577454663 shutdown_connections 2023-11-20T07:01:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/3577454663 >> 172.21.15.88:0/3577454663 conn(0x7f6bac0b0da0 msgr2=0x7f6bac0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/3577454663 shutdown_connections 2023-11-20T07:01:58.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/3577454663 wait complete. 2023-11-20T07:01:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 Processor -- start 2023-11-20T07:01:58.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 -- start start 2023-11-20T07:01:58.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b98005bc0 0x7f6bac154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bac0b3870 0x7f6bac15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bac158b10 0x7f6bac15c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0c5950 con 0x7f6bac0b3870 2023-11-20T07:01:58.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0c5110 con 0x7f6bac158b10 2023-11-20T07:01:58.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.853+0000 7f6bb3f3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0c23e0 con 0x7f6b98005bc0 2023-11-20T07:01:58.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb14d9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bac0b3870 0x7f6bac15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb14d9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bac0b3870 0x7f6bac15bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49356/0 (socket says 172.21.15.88:49356) 2023-11-20T07:01:58.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb14d9640 1 -- 172.21.15.88:0/4262758823 learned_addr learned my addr 172.21.15.88:0/4262758823 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:58.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb1cda640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b98005bc0 0x7f6bac154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb24db640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bac158b10 0x7f6bac15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb14d9640 1 -- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b98005bc0 msgr2=0x7f6bac154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb14d9640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b98005bc0 0x7f6bac154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb14d9640 1 -- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bac158b10 msgr2=0x7f6bac15c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:58.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb14d9640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bac158b10 0x7f6bac15c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:58.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb14d9640 1 -- 172.21.15.88:0/4262758823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac155350 con 0x7f6bac0b3870 2023-11-20T07:01:58.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb24db640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bac158b10 0x7f6bac15c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:58.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb14d9640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bac0b3870 0x7f6bac15bbd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00c770 tx=0x7f6b9c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:58.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6ba27fc640 1 -- 172.21.15.88:0/4262758823 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c0074e0 con 0x7f6bac0b3870 2023-11-20T07:01:58.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6ba27fc640 1 -- 172.21.15.88:0/4262758823 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c007640 con 0x7f6bac0b3870 2023-11-20T07:01:58.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/4262758823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac0c4e30 con 0x7f6bac0b3870 2023-11-20T07:01:58.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6ba27fc640 1 -- 172.21.15.88:0/4262758823 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c004a30 con 0x7f6bac0b3870 2023-11-20T07:01:58.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/4262758823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac15c8c0 con 0x7f6bac0b3870 2023-11-20T07:01:58.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/4262758823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bac0c5720 con 0x7f6bac0b3870 2023-11-20T07:01:58.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6ba27fc640 1 -- 172.21.15.88:0/4262758823 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6b9c004b90 con 0x7f6bac0b3870 2023-11-20T07:01:58.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6ba27fc640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6b900664a0 0x7f6b90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:58.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.857+0000 7f6ba27fc640 1 -- 172.21.15.88:0/4262758823 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6b9c0839e0 con 0x7f6bac0b3870 2023-11-20T07:01:58.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.861+0000 7f6bb1cda640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6b900664a0 0x7f6b90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:58.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.861+0000 7f6bb1cda640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6b900664a0 0x7f6b90068960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80af000 tx=0x7f6ba80046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:58.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:58.861+0000 7f6ba27fc640 1 -- 172.21.15.88:0/4262758823 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6bac0c5720 con 0x7f6bac0b3870 2023-11-20T07:01:59.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/4262758823 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6bac0c5720 con 0x7f6bac0b3870 2023-11-20T07:01:59.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6ba27fc640 1 -- 172.21.15.88:0/4262758823 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6bac0c5720 con 0x7f6bac0b3870 2023-11-20T07:01:59.013 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:01:59.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6b900664a0 msgr2=0x7f6b90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6b900664a0 0x7f6b90068960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6ba80af000 tx=0x7f6ba80046d0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/4262758823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bac0b3870 msgr2=0x7f6bac15bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bac0b3870 0x7f6bac15bbd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00c770 tx=0x7f6b9c00cc30 comp rx=0 tx=0).stop 2023-11-20T07:01:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/4262758823 shutdown_connections 2023-11-20T07:01:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6b900664a0 0x7f6b90068960 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bac158b10 0x7f6bac15c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bac0b3870 0x7f6bac15bbd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 --2- 172.21.15.88:0/4262758823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b98005bc0 0x7f6bac154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/4262758823 >> 172.21.15.88:0/4262758823 conn(0x7f6bac0b0da0 msgr2=0x7f6bac0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/4262758823 shutdown_connections 2023-11-20T07:01:59.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.013+0000 7f6bb3f3e640 1 -- 172.21.15.88:0/4262758823 wait complete. 2023-11-20T07:01:59.034 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:01:59.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f374989e640 1 Processor -- start 2023-11-20T07:01:59.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f374989e640 1 -- start start 2023-11-20T07:01:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f374989e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f374415cba0 0x7f37440d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f374989e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37440d0210 0x7f37440b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f374989e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37440d1670 con 0x7f37440b84e0 2023-11-20T07:01:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f374989e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37440d1460 con 0x7f37440d0210 2023-11-20T07:01:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f374989e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37440d1950 con 0x7f374415cba0 2023-11-20T07:01:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f37437fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37440d0210 0x7f37440b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f37437fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37440d0210 0x7f37440b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49366/0 (socket says 172.21.15.88:49366) 2023-11-20T07:01:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f37437fe640 1 -- 172.21.15.88:0/449777182 learned_addr learned my addr 172.21.15.88:0/449777182 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f3742ffd640 1 --2- 172.21.15.88:0/449777182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f374415cba0 0x7f37440d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f37437fe640 1 -- 172.21.15.88:0/449777182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f374415cba0 msgr2=0x7f37440d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f37437fe640 1 --2- 172.21.15.88:0/449777182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f374415cba0 0x7f37440d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.173+0000 7f37437fe640 1 -- 172.21.15.88:0/449777182 >> v1:172.21.15.175:6789/0 conn(0x7f37440b84e0 legacy=0x7f37440cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f37437fe640 1 -- 172.21.15.88:0/449777182 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37440d1c30 con 0x7f37440d0210 2023-11-20T07:01:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f37437fe640 1 --2- 172.21.15.88:0/449777182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37440d0210 0x7f37440b5cf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f373c009e50 tx=0x7f373c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05d743d2d818251 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f37427fc640 1 -- 172.21.15.88:0/449777182 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c0a58e0 con 0x7f37440d0210 2023-11-20T07:01:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f37427fc640 1 -- 172.21.15.88:0/449777182 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c0a5a40 con 0x7f37440d0210 2023-11-20T07:01:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f37427fc640 1 -- 172.21.15.88:0/449777182 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c0a5dd0 con 0x7f37440d0210 2023-11-20T07:01:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f374989e640 1 -- 172.21.15.88:0/449777182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37440d0210 msgr2=0x7f37440b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f374989e640 1 --2- 172.21.15.88:0/449777182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37440d0210 0x7f37440b5cf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f373c009e50 tx=0x7f373c01ca10 comp rx=0 tx=0).stop 2023-11-20T07:01:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f374989e640 1 -- 172.21.15.88:0/449777182 shutdown_connections 2023-11-20T07:01:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f374989e640 1 --2- 172.21.15.88:0/449777182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37440d0210 0x7f37440b5cf0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f374989e640 1 --2- 172.21.15.88:0/449777182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f374415cba0 0x7f37440d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f374989e640 1 -- 172.21.15.88:0/449777182 >> 172.21.15.88:0/449777182 conn(0x7f37440719c0 msgr2=0x7f3744071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f374989e640 1 -- 172.21.15.88:0/449777182 shutdown_connections 2023-11-20T07:01:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.177+0000 7f374989e640 1 -- 172.21.15.88:0/449777182 wait complete. 2023-11-20T07:01:59.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f374989e640 1 Processor -- start 2023-11-20T07:01:59.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f374989e640 1 -- start start 2023-11-20T07:01:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f374989e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37440b84e0 0x7f37441564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f374989e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37440d0210 0x7f3744157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f374989e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f374415cba0 0x7f37440b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f374989e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374414f9c0 con 0x7f37440d0210 2023-11-20T07:01:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f374989e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3744150050 con 0x7f374415cba0 2023-11-20T07:01:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f374989e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3744156ab0 con 0x7f37440b84e0 2023-11-20T07:01:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f373bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37440d0210 0x7f3744157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f373bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37440d0210 0x7f3744157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49368/0 (socket says 172.21.15.88:49368) 2023-11-20T07:01:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f373bfff640 1 -- 172.21.15.88:0/1499405117 learned_addr learned my addr 172.21.15.88:0/1499405117 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f3742ffd640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37440b84e0 0x7f37441564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f37437fe640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f374415cba0 0x7f37440b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f373bfff640 1 -- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37440b84e0 msgr2=0x7f37441564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f373bfff640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37440b84e0 0x7f37441564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f373bfff640 1 -- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f374415cba0 msgr2=0x7f37440b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f373bfff640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f374415cba0 0x7f37440b6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f373bfff640 1 -- 172.21.15.88:0/1499405117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c009b30 con 0x7f37440d0210 2023-11-20T07:01:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f373bfff640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37440d0210 0x7f3744157600 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c450 tx=0x7f372c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f3740ff9640 1 -- 172.21.15.88:0/1499405117 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c0052d0 con 0x7f37440d0210 2023-11-20T07:01:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f3740ff9640 1 -- 172.21.15.88:0/1499405117 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c005430 con 0x7f37440d0210 2023-11-20T07:01:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f374989e640 1 -- 172.21.15.88:0/1499405117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374414f370 con 0x7f37440d0210 2023-11-20T07:01:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.181+0000 7f3740ff9640 1 -- 172.21.15.88:0/1499405117 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c007260 con 0x7f37440d0210 2023-11-20T07:01:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.185+0000 7f374989e640 1 -- 172.21.15.88:0/1499405117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37440b71e0 con 0x7f37440d0210 2023-11-20T07:01:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.185+0000 7f374989e640 1 -- 172.21.15.88:0/1499405117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374414f1d0 con 0x7f37440d0210 2023-11-20T07:01:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.185+0000 7f3740ff9640 1 -- 172.21.15.88:0/1499405117 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f372c0073c0 con 0x7f37440d0210 2023-11-20T07:01:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.185+0000 7f3740ff9640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f37240664d0 0x7f3724068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.185+0000 7f3740ff9640 1 -- 172.21.15.88:0/1499405117 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f372c0839a0 con 0x7f37440d0210 2023-11-20T07:01:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.185+0000 7f3742ffd640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f37240664d0 0x7f3724068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.189+0000 7f3742ffd640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f37240664d0 0x7f3724068990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3744151980 tx=0x7f3734009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.189+0000 7f3740ff9640 1 -- 172.21.15.88:0/1499405117 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f374414f1d0 con 0x7f37440d0210 2023-11-20T07:01:59.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 -- 172.21.15.88:0/1499405117 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f374414f1d0 con 0x7f37440d0210 2023-11-20T07:01:59.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f3740ff9640 1 -- 172.21.15.88:0/1499405117 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f374414f1d0 con 0x7f37440d0210 2023-11-20T07:01:59.342 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:01:59.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 -- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f37240664d0 msgr2=0x7f3724068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f37240664d0 0x7f3724068990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3744151980 tx=0x7f3734009190 comp rx=0 tx=0).stop 2023-11-20T07:01:59.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 -- 172.21.15.88:0/1499405117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37440d0210 msgr2=0x7f3744157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37440d0210 0x7f3744157600 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c450 tx=0x7f372c00c910 comp rx=0 tx=0).stop 2023-11-20T07:01:59.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 -- 172.21.15.88:0/1499405117 shutdown_connections 2023-11-20T07:01:59.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f37240664d0 0x7f3724068990 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f374415cba0 0x7f37440b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37440d0210 0x7f3744157600 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 --2- 172.21.15.88:0/1499405117 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37440b84e0 0x7f37441564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 -- 172.21.15.88:0/1499405117 >> 172.21.15.88:0/1499405117 conn(0x7f37440719c0 msgr2=0x7f37440cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:59.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 -- 172.21.15.88:0/1499405117 shutdown_connections 2023-11-20T07:01:59.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.341+0000 7f374989e640 1 -- 172.21.15.88:0/1499405117 wait complete. 2023-11-20T07:01:59.364 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T07:01:59.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c879ee640 1 Processor -- start 2023-11-20T07:01:59.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c879ee640 1 -- start start 2023-11-20T07:01:59.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c879ee640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c800b07f0 0x7f5c800ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c879ee640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c800c96f0 con 0x7f5c80164520 2023-11-20T07:01:59.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c879ee640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c800cb950 con 0x7f5c800ad960 2023-11-20T07:01:59.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c879ee640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c80164900 con 0x7f5c800b07f0 2023-11-20T07:01:59.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c8578a640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5c80164520 0x7f5c800b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51132/0 (socket says 172.21.15.88:51132) 2023-11-20T07:01:59.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c8578a640 1 -- 172.21.15.88:0/3024258878 learned_addr learned my addr 172.21.15.88:0/3024258878 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:01:59.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763833626 0 0) 0x7f5c800c96f0 con 0x7f5c80164520 2023-11-20T07:01:59.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c6c003530 con 0x7f5c80164520 2023-11-20T07:01:59.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c85f8b640 1 --2- 172.21.15.88:0/3024258878 >> v2:172.21.15.175:3300/0 conn(0x7f5c800b07f0 0x7f5c800ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2099878352 0 0) 0x7f5c6c003530 con 0x7f5c80164520 2023-11-20T07:01:59.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 >> v2:172.21.15.175:3300/0 conn(0x7f5c800b07f0 msgr2=0x7f5c800ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:59.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 --2- 172.21.15.88:0/3024258878 >> v2:172.21.15.175:3300/0 conn(0x7f5c800b07f0 0x7f5c800ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 >> v1:172.21.15.175:6789/0 conn(0x7f5c800ad960 legacy=0x7f5c800cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800cbed0 con 0x7f5c80164520 2023-11-20T07:01:59.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f5c7c001680 con 0x7f5c80164520 2023-11-20T07:01:59.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 >> v1:172.21.15.88:6789/0 conn(0x7f5c80164520 legacy=0x7f5c800b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 --2- 172.21.15.88:0/3024258878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c6c003980 0x7f5c6c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 --2- 172.21.15.88:0/3024258878 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c6c0047d0 0x7f5c6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 --2- 172.21.15.88:0/3024258878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c005190 0x7f5c6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c00c0b0 con 0x7f5c6c003980 2023-11-20T07:01:59.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c00c220 con 0x7f5c6c005190 2023-11-20T07:01:59.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c00c3e0 con 0x7f5c6c0047d0 2023-11-20T07:01:59.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c8578a640 1 --2- 172.21.15.88:0/3024258878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c6c003980 0x7f5c6c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c85f8b640 1 --2- 172.21.15.88:0/3024258878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c005190 0x7f5c6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.501+0000 7f5c84f89640 1 --2- 172.21.15.88:0/3024258878 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c6c0047d0 0x7f5c6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c8578a640 1 -- 172.21.15.88:0/3024258878 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c6c0047d0 msgr2=0x7f5c6c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:59.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c8578a640 1 --2- 172.21.15.88:0/3024258878 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c6c0047d0 0x7f5c6c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c8578a640 1 -- 172.21.15.88:0/3024258878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c005190 msgr2=0x7f5c6c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:59.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c8578a640 1 --2- 172.21.15.88:0/3024258878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c005190 0x7f5c6c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c8578a640 1 -- 172.21.15.88:0/3024258878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c003530 con 0x7f5c6c003980 2023-11-20T07:01:59.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c85f8b640 1 -- 172.21.15.88:0/3024258878 reap_dead start 2023-11-20T07:01:59.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c84f89640 1 --2- 172.21.15.88:0/3024258878 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c6c0047d0 0x7f5c6c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:01:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c8578a640 1 --2- 172.21.15.88:0/3024258878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c6c003980 0x7f5c6c003da0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00c240 tx=0x7f5c7c01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c45304313b3e342 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c0a5b10 con 0x7f5c6c003980 2023-11-20T07:01:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c0a5c70 con 0x7f5c6c003980 2023-11-20T07:01:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c77fff640 1 -- 172.21.15.88:0/3024258878 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c005b20 con 0x7f5c6c003980 2023-11-20T07:01:59.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c879ee640 1 -- 172.21.15.88:0/3024258878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c6c003980 msgr2=0x7f5c6c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c879ee640 1 --2- 172.21.15.88:0/3024258878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c6c003980 0x7f5c6c003da0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00c240 tx=0x7f5c7c01cc10 comp rx=0 tx=0).stop 2023-11-20T07:01:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c879ee640 1 -- 172.21.15.88:0/3024258878 shutdown_connections 2023-11-20T07:01:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c879ee640 1 --2- 172.21.15.88:0/3024258878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c6c003980 0x7f5c6c003da0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.505+0000 7f5c879ee640 1 -- 172.21.15.88:0/3024258878 >> 172.21.15.88:0/3024258878 conn(0x7f5c8006c190 msgr2=0x7f5c8006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c879ee640 1 -- 172.21.15.88:0/3024258878 shutdown_connections 2023-11-20T07:01:59.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c879ee640 1 -- 172.21.15.88:0/3024258878 wait complete. 2023-11-20T07:01:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c879ee640 1 Processor -- start 2023-11-20T07:01:59.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c879ee640 1 -- start start 2023-11-20T07:01:59.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c879ee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c003980 0x7f5c800c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c879ee640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c800b0eb0 0x7f5c800b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c879ee640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c801fd0a0 0x7f5c80161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c879ee640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800b29d0 con 0x7f5c800b0eb0 2023-11-20T07:01:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c879ee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800b1390 con 0x7f5c6c003980 2023-11-20T07:01:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c879ee640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800b1670 con 0x7f5c801fd0a0 2023-11-20T07:01:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c84f89640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c800b0eb0 0x7f5c800b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c84f89640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c800b0eb0 0x7f5c800b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49384/0 (socket says 172.21.15.88:49384) 2023-11-20T07:01:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c84f89640 1 -- 172.21.15.88:0/3962356059 learned_addr learned my addr 172.21.15.88:0/3962356059 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c85f8b640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c801fd0a0 0x7f5c80161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c8578a640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c003980 0x7f5c800c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c84f89640 1 -- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c801fd0a0 msgr2=0x7f5c80161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c84f89640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c801fd0a0 0x7f5c80161ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c84f89640 1 -- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c003980 msgr2=0x7f5c800c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c84f89640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c003980 0x7f5c800c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c84f89640 1 -- 172.21.15.88:0/3962356059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800b1950 con 0x7f5c800b0eb0 2023-11-20T07:01:59.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.509+0000 7f5c84f89640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c800b0eb0 0x7f5c800b2d50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000e410 tx=0x7f5c7000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:59.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.513+0000 7f5c75ffb640 1 -- 172.21.15.88:0/3962356059 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c700052e0 con 0x7f5c800b0eb0 2023-11-20T07:01:59.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.513+0000 7f5c75ffb640 1 -- 172.21.15.88:0/3962356059 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70005440 con 0x7f5c800b0eb0 2023-11-20T07:01:59.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.513+0000 7f5c879ee640 1 -- 172.21.15.88:0/3962356059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c800b1c30 con 0x7f5c800b0eb0 2023-11-20T07:01:59.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.513+0000 7f5c75ffb640 1 -- 172.21.15.88:0/3962356059 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70003820 con 0x7f5c800b0eb0 2023-11-20T07:01:59.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.513+0000 7f5c879ee640 1 -- 172.21.15.88:0/3962356059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c801f9a60 con 0x7f5c800b0eb0 2023-11-20T07:01:59.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.513+0000 7f5c879ee640 1 -- 172.21.15.88:0/3962356059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c801f9c80 con 0x7f5c800b0eb0 2023-11-20T07:01:59.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.513+0000 7f5c75ffb640 1 -- 172.21.15.88:0/3962356059 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5c70003980 con 0x7f5c800b0eb0 2023-11-20T07:01:59.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.513+0000 7f5c75ffb640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5c640664f0 0x7f5c640689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.513+0000 7f5c75ffb640 1 -- 172.21.15.88:0/3962356059 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5c70083a30 con 0x7f5c800b0eb0 2023-11-20T07:01:59.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.513+0000 7f5c8578a640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5c640664f0 0x7f5c640689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.517+0000 7f5c8578a640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5c640664f0 0x7f5c640689b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0ab000 tx=0x7f5c7c0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:59.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.517+0000 7f5c75ffb640 1 -- 172.21.15.88:0/3962356059 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5c70050b60 con 0x7f5c800b0eb0 2023-11-20T07:01:59.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.677+0000 7f5c879ee640 1 -- 172.21.15.88:0/3962356059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5c80074010 con 0x7f5c800b0eb0 2023-11-20T07:01:59.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.677+0000 7f5c75ffb640 1 -- 172.21.15.88:0/3962356059 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5c70019080 con 0x7f5c800b0eb0 2023-11-20T07:01:59.680 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-20T07:01:59.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.681+0000 7f5c879ee640 1 -- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5c640664f0 msgr2=0x7f5c640689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.681+0000 7f5c879ee640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5c640664f0 0x7f5c640689b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0ab000 tx=0x7f5c7c0a7070 comp rx=0 tx=0).stop 2023-11-20T07:01:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.681+0000 7f5c879ee640 1 -- 172.21.15.88:0/3962356059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c800b0eb0 msgr2=0x7f5c800b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.681+0000 7f5c879ee640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c800b0eb0 0x7f5c800b2d50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000e410 tx=0x7f5c7000e8d0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.681+0000 7f5c879ee640 1 -- 172.21.15.88:0/3962356059 shutdown_connections 2023-11-20T07:01:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.681+0000 7f5c879ee640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5c640664f0 0x7f5c640689b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.681+0000 7f5c879ee640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c801fd0a0 0x7f5c80161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.681+0000 7f5c879ee640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c800b0eb0 0x7f5c800b2d50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.681+0000 7f5c879ee640 1 --2- 172.21.15.88:0/3962356059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c6c003980 0x7f5c800c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.681+0000 7f5c879ee640 1 -- 172.21.15.88:0/3962356059 >> 172.21.15.88:0/3962356059 conn(0x7f5c8006c190 msgr2=0x7f5c800c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.681+0000 7f5c879ee640 1 -- 172.21.15.88:0/3962356059 shutdown_connections 2023-11-20T07:01:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.681+0000 7f5c879ee640 1 -- 172.21.15.88:0/3962356059 wait complete. 2023-11-20T07:01:59.701 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2023-11-20T07:01:59.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:59.702 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-20T07:01:59.723 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:01:59.724 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T07:01:59.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:01:59.724 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-20T07:01:59.773 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:01:59.773 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:59.783 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:01:59.783 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:01:59.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:01:59.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d9e4640 1 Processor -- start 2023-11-20T07:01:59.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d9e4640 1 -- start start 2023-11-20T07:01:59.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d9e4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f40480d3170 0x7f40480d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d9e4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40480cefe0 0x7f40480cf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d9e4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40480ce730 con 0x7f404815c910 2023-11-20T07:01:59.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d9e4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40480cf9d0 con 0x7f40480cefe0 2023-11-20T07:01:59.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d9e4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40480ce540 con 0x7f40480d3170 2023-11-20T07:01:59.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d1e3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40480cefe0 0x7f40480cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d1e3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f40480cefe0 0x7f40480cf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49396/0 (socket says 172.21.15.88:49396) 2023-11-20T07:01:59.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d1e3640 1 -- 172.21.15.88:0/3746213763 learned_addr learned my addr 172.21.15.88:0/3746213763 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:59.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f4047fff640 1 --2- 172.21.15.88:0/3746213763 >> v2:172.21.15.175:3300/0 conn(0x7f40480d3170 0x7f40480d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d1e3640 1 -- 172.21.15.88:0/3746213763 >> v2:172.21.15.175:3300/0 conn(0x7f40480d3170 msgr2=0x7f40480d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d1e3640 1 --2- 172.21.15.88:0/3746213763 >> v2:172.21.15.175:3300/0 conn(0x7f40480d3170 0x7f40480d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d1e3640 1 -- 172.21.15.88:0/3746213763 >> v1:172.21.15.175:6789/0 conn(0x7f404815c910 legacy=0x7f40480cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:01:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f404d1e3640 1 -- 172.21.15.88:0/3746213763 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40480d0dd0 con 0x7f40480cefe0 2023-11-20T07:01:59.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.977+0000 7f4047fff640 1 --2- 172.21.15.88:0/3746213763 >> v2:172.21.15.175:3300/0 conn(0x7f40480d3170 0x7f40480d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:59.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f404d1e3640 1 --2- 172.21.15.88:0/3746213763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40480cefe0 0x7f40480cf490 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4048160400 tx=0x7f404001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78fb3cdf88f1c9d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:59.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f40477fe640 1 -- 172.21.15.88:0/3746213763 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400a56b0 con 0x7f40480cefe0 2023-11-20T07:01:59.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f40477fe640 1 -- 172.21.15.88:0/3746213763 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40400a5810 con 0x7f40480cefe0 2023-11-20T07:01:59.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f40477fe640 1 -- 172.21.15.88:0/3746213763 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400a5ba0 con 0x7f40480cefe0 2023-11-20T07:01:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f404d9e4640 1 -- 172.21.15.88:0/3746213763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40480cefe0 msgr2=0x7f40480cf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f404d9e4640 1 --2- 172.21.15.88:0/3746213763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40480cefe0 0x7f40480cf490 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4048160400 tx=0x7f404001c900 comp rx=0 tx=0).stop 2023-11-20T07:01:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f404d9e4640 1 -- 172.21.15.88:0/3746213763 shutdown_connections 2023-11-20T07:01:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f404d9e4640 1 --2- 172.21.15.88:0/3746213763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f40480cefe0 0x7f40480cf490 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f404d9e4640 1 --2- 172.21.15.88:0/3746213763 >> v2:172.21.15.175:3300/0 conn(0x7f40480d3170 0x7f40480d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f404d9e4640 1 -- 172.21.15.88:0/3746213763 >> 172.21.15.88:0/3746213763 conn(0x7f404809bb50 msgr2=0x7f40480d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:01:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f404d9e4640 1 -- 172.21.15.88:0/3746213763 shutdown_connections 2023-11-20T07:01:59.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f404d9e4640 1 -- 172.21.15.88:0/3746213763 wait complete. 2023-11-20T07:01:59.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.981+0000 7f404d9e4640 1 Processor -- start 2023-11-20T07:01:59.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d9e4640 1 -- start start 2023-11-20T07:01:59.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d9e4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40480cefe0 0x7f404813a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d9e4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40480d3170 0x7f404815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d9e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f404815c910 0x7f404814cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d9e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40480ca0c0 con 0x7f404815c910 2023-11-20T07:01:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d9e4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40481534c0 con 0x7f40480cefe0 2023-11-20T07:01:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d9e4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404815c230 con 0x7f40480d3170 2023-11-20T07:01:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d1e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f404815c910 0x7f404814cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d1e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f404815c910 0x7f404814cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49398/0 (socket says 172.21.15.88:49398) 2023-11-20T07:01:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d1e3640 1 -- 172.21.15.88:0/2964948123 learned_addr learned my addr 172.21.15.88:0/2964948123 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:01:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404c9e2640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40480cefe0 0x7f404813a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d1e3640 1 -- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40480d3170 msgr2=0x7f404815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f4047fff640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40480d3170 0x7f404815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d1e3640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40480d3170 0x7f404815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d1e3640 1 -- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40480cefe0 msgr2=0x7f404813a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:01:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d1e3640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40480cefe0 0x7f404813a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:01:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d1e3640 1 -- 172.21.15.88:0/2964948123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040009b30 con 0x7f404815c910 2023-11-20T07:01:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f4047fff640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40480d3170 0x7f404815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404c9e2640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40480cefe0 0x7f404813a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:01:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d1e3640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f404815c910 0x7f404814cf90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f404001a530 tx=0x7f40400196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f40457fa640 1 -- 172.21.15.88:0/2964948123 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400b8670 con 0x7f404815c910 2023-11-20T07:01:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f40457fa640 1 -- 172.21.15.88:0/2964948123 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40400b87f0 con 0x7f404815c910 2023-11-20T07:01:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d9e4640 1 -- 172.21.15.88:0/2964948123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40480c9de0 con 0x7f404815c910 2023-11-20T07:01:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f40457fa640 1 -- 172.21.15.88:0/2964948123 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400b8ba0 con 0x7f404815c910 2023-11-20T07:01:59.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d9e4640 1 -- 172.21.15.88:0/2964948123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40481530e0 con 0x7f404815c910 2023-11-20T07:01:59.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.985+0000 7f404d9e4640 1 -- 172.21.15.88:0/2964948123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4048152c60 con 0x7f404815c910 2023-11-20T07:01:59.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.989+0000 7f40457fa640 1 -- 172.21.15.88:0/2964948123 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f40400b8d00 con 0x7f404815c910 2023-11-20T07:01:59.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.989+0000 7f40457fa640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f402c0664d0 0x7f402c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:01:59.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.989+0000 7f40457fa640 1 -- 172.21.15.88:0/2964948123 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f404011f800 con 0x7f404815c910 2023-11-20T07:01:59.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.989+0000 7f404c9e2640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f402c0664d0 0x7f402c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:01:59.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.989+0000 7f404c9e2640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f402c0664d0 0x7f402c068990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f403c00a830 tx=0x7f403c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:01:59.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:01:59.993+0000 7f40457fa640 1 -- 172.21.15.88:0/2964948123 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4048152c60 con 0x7f404815c910 2023-11-20T07:02:00.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.145+0000 7f404d9e4640 1 -- 172.21.15.88:0/2964948123 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4048152c60 con 0x7f404815c910 2023-11-20T07:02:00.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.145+0000 7f40457fa640 1 -- 172.21.15.88:0/2964948123 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f4048152c60 con 0x7f404815c910 2023-11-20T07:02:00.147 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:00.148 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:00.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.149+0000 7f404d9e4640 1 -- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f402c0664d0 msgr2=0x7f402c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.149+0000 7f404d9e4640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f402c0664d0 0x7f402c068990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f403c00a830 tx=0x7f403c008040 comp rx=0 tx=0).stop 2023-11-20T07:02:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.149+0000 7f404d9e4640 1 -- 172.21.15.88:0/2964948123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f404815c910 msgr2=0x7f404814cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.149+0000 7f404d9e4640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f404815c910 0x7f404814cf90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f404001a530 tx=0x7f40400196a0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.149+0000 7f404d9e4640 1 -- 172.21.15.88:0/2964948123 shutdown_connections 2023-11-20T07:02:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.149+0000 7f404d9e4640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f402c0664d0 0x7f402c068990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.149+0000 7f404d9e4640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40480d3170 0x7f404815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.149+0000 7f404d9e4640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f404815c910 0x7f404814cf90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.149+0000 7f404d9e4640 1 --2- 172.21.15.88:0/2964948123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40480cefe0 0x7f404813a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.149+0000 7f404d9e4640 1 -- 172.21.15.88:0/2964948123 >> 172.21.15.88:0/2964948123 conn(0x7f404809bb50 msgr2=0x7f4048155a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.149+0000 7f404d9e4640 1 -- 172.21.15.88:0/2964948123 shutdown_connections 2023-11-20T07:02:00.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.149+0000 7f404d9e4640 1 -- 172.21.15.88:0/2964948123 wait complete. 2023-11-20T07:02:00.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:02:00.169 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:02:00.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0fd3e640 1 Processor -- start 2023-11-20T07:02:00.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0fd3e640 1 -- start start 2023-11-20T07:02:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0fd3e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efe080b84e0 0x7efe080d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0fd3e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe080d1670 con 0x7efe0815cba0 2023-11-20T07:02:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0fd3e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe080d1950 con 0x7efe080d0210 2023-11-20T07:02:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0fd3e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe080d1460 con 0x7efe080b84e0 2023-11-20T07:02:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0dada640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efe0815cba0 0x7efe080cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51140/0 (socket says 172.21.15.88:51140) 2023-11-20T07:02:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0dada640 1 -- 172.21.15.88:0/462391142 learned_addr learned my addr 172.21.15.88:0/462391142 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0e2db640 1 --2- 172.21.15.88:0/462391142 >> v2:172.21.15.175:3300/0 conn(0x7efe080b84e0 0x7efe080d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0cad8640 1 -- 172.21.15.88:0/462391142 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915140311 0 0) 0x7efe080d1670 con 0x7efe0815cba0 2023-11-20T07:02:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0cad8640 1 -- 172.21.15.88:0/462391142 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf4003530 con 0x7efe0815cba0 2023-11-20T07:02:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0cad8640 1 -- 172.21.15.88:0/462391142 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3755727549 0 0) 0x7efdf4003530 con 0x7efe0815cba0 2023-11-20T07:02:00.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0e2db640 1 -- 172.21.15.88:0/462391142 >> v1:172.21.15.175:6789/0 conn(0x7efe080d0210 legacy=0x7efe080b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0e2db640 1 -- 172.21.15.88:0/462391142 >> v1:172.21.15.88:6789/0 conn(0x7efe0815cba0 legacy=0x7efe080cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.309+0000 7efe0e2db640 1 -- 172.21.15.88:0/462391142 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe080d1c30 con 0x7efe080b84e0 2023-11-20T07:02:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.313+0000 7efe0e2db640 1 --2- 172.21.15.88:0/462391142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe080b84e0 0x7efe080d0f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe00009d90 tx=0x7efe0001c690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a4930f82d37be5c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.313+0000 7efe0cad8640 1 -- 172.21.15.88:0/462391142 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04001680 con 0x7efe080b84e0 2023-11-20T07:02:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.313+0000 7efe0cad8640 1 -- 172.21.15.88:0/462391142 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe000a5510 con 0x7efe080b84e0 2023-11-20T07:02:00.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.313+0000 7efe0cad8640 1 -- 172.21.15.88:0/462391142 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe000a58a0 con 0x7efe080b84e0 2023-11-20T07:02:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.313+0000 7efe0fd3e640 1 -- 172.21.15.88:0/462391142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe080b84e0 msgr2=0x7efe080d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.313+0000 7efe0fd3e640 1 --2- 172.21.15.88:0/462391142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe080b84e0 0x7efe080d0f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe00009d90 tx=0x7efe0001c690 comp rx=0 tx=0).stop 2023-11-20T07:02:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.313+0000 7efe0fd3e640 1 -- 172.21.15.88:0/462391142 shutdown_connections 2023-11-20T07:02:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.313+0000 7efe0fd3e640 1 --2- 172.21.15.88:0/462391142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe080b84e0 0x7efe080d0f20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.313+0000 7efe0fd3e640 1 -- 172.21.15.88:0/462391142 >> 172.21.15.88:0/462391142 conn(0x7efe080719c0 msgr2=0x7efe08071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.313+0000 7efe0fd3e640 1 -- 172.21.15.88:0/462391142 shutdown_connections 2023-11-20T07:02:00.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.313+0000 7efe0fd3e640 1 -- 172.21.15.88:0/462391142 wait complete. 2023-11-20T07:02:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0fd3e640 1 Processor -- start 2023-11-20T07:02:00.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0fd3e640 1 -- start start 2023-11-20T07:02:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0fd3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe080b84e0 0x7efe080cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0fd3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe080d0210 0x7efe0814ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0fd3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe0815cba0 0x7efe080b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0fd3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080cb5b0 con 0x7efe080b84e0 2023-11-20T07:02:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0fd3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080ca9a0 con 0x7efe0815cba0 2023-11-20T07:02:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0fd3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe080cac80 con 0x7efe080d0210 2023-11-20T07:02:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0dada640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe080b84e0 0x7efe080cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0dada640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe080b84e0 0x7efe080cba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49408/0 (socket says 172.21.15.88:49408) 2023-11-20T07:02:00.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0dada640 1 -- 172.21.15.88:0/4293948708 learned_addr learned my addr 172.21.15.88:0/4293948708 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0d2d9640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe080d0210 0x7efe0814ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0e2db640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe0815cba0 0x7efe080b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0dada640 1 -- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe080d0210 msgr2=0x7efe0814ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0dada640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe080d0210 0x7efe0814ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0dada640 1 -- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe0815cba0 msgr2=0x7efe080b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0dada640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe0815cba0 0x7efe080b7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0dada640 1 -- 172.21.15.88:0/4293948708 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe00009a70 con 0x7efe080b84e0 2023-11-20T07:02:00.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0dada640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe080b84e0 0x7efe080cba40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efe04007fd0 tx=0x7efe0400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:00.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efdfe7fc640 1 -- 172.21.15.88:0/4293948708 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040072d0 con 0x7efe080b84e0 2023-11-20T07:02:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efdfe7fc640 1 -- 172.21.15.88:0/4293948708 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04007430 con 0x7efe080b84e0 2023-11-20T07:02:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efdfe7fc640 1 -- 172.21.15.88:0/4293948708 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040047f0 con 0x7efe080b84e0 2023-11-20T07:02:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0fd3e640 1 -- 172.21.15.88:0/4293948708 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe080caf60 con 0x7efe080b84e0 2023-11-20T07:02:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.317+0000 7efe0fd3e640 1 -- 172.21.15.88:0/4293948708 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe080ca630 con 0x7efe080b84e0 2023-11-20T07:02:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.321+0000 7efe0fd3e640 1 -- 172.21.15.88:0/4293948708 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0804e170 con 0x7efe080b84e0 2023-11-20T07:02:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.321+0000 7efdfe7fc640 1 -- 172.21.15.88:0/4293948708 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efe04004950 con 0x7efe080b84e0 2023-11-20T07:02:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.321+0000 7efdfe7fc640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efdec0664d0 0x7efdec068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.321+0000 7efdfe7fc640 1 -- 172.21.15.88:0/4293948708 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efe04083630 con 0x7efe080b84e0 2023-11-20T07:02:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.321+0000 7efe0d2d9640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efdec0664d0 0x7efdec068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.321+0000 7efe0d2d9640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efdec0664d0 0x7efdec068990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efe080b7f50 tx=0x7efdf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:00.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.325+0000 7efdfe7fc640 1 -- 172.21.15.88:0/4293948708 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efe04050710 con 0x7efe080b84e0 2023-11-20T07:02:00.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.473+0000 7efe0fd3e640 1 -- 172.21.15.88:0/4293948708 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe080b8200 con 0x7efe080b84e0 2023-11-20T07:02:00.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.473+0000 7efdfe7fc640 1 -- 172.21.15.88:0/4293948708 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe040180a0 con 0x7efe080b84e0 2023-11-20T07:02:00.475 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:02:00.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.477+0000 7efe0fd3e640 1 -- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efdec0664d0 msgr2=0x7efdec068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.477+0000 7efe0fd3e640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efdec0664d0 0x7efdec068990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efe080b7f50 tx=0x7efdf8009040 comp rx=0 tx=0).stop 2023-11-20T07:02:00.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.477+0000 7efe0fd3e640 1 -- 172.21.15.88:0/4293948708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe080b84e0 msgr2=0x7efe080cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.477+0000 7efe0fd3e640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe080b84e0 0x7efe080cba40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efe04007fd0 tx=0x7efe0400cbe0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.477+0000 7efe0fd3e640 1 -- 172.21.15.88:0/4293948708 shutdown_connections 2023-11-20T07:02:00.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.477+0000 7efe0fd3e640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efdec0664d0 0x7efdec068990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.477+0000 7efe0fd3e640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe080d0210 0x7efe0814ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.477+0000 7efe0fd3e640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe0815cba0 0x7efe080b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.477+0000 7efe0fd3e640 1 --2- 172.21.15.88:0/4293948708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe080b84e0 0x7efe080cba40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.477+0000 7efe0fd3e640 1 -- 172.21.15.88:0/4293948708 >> 172.21.15.88:0/4293948708 conn(0x7efe080719c0 msgr2=0x7efe080cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:00.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.477+0000 7efe0fd3e640 1 -- 172.21.15.88:0/4293948708 shutdown_connections 2023-11-20T07:02:00.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.477+0000 7efe0fd3e640 1 -- 172.21.15.88:0/4293948708 wait complete. 2023-11-20T07:02:00.496 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:02:00.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19d1e09640 1 Processor -- start 2023-11-20T07:02:00.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19d1e09640 1 -- start start 2023-11-20T07:02:00.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19d1e09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19cc15cb60 0x7f19cc0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19d1e09640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f19cc06f560 0x7f19cc071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19d1e09640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19cc06ac10 con 0x7f19cc15cf40 2023-11-20T07:02:00.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19d1e09640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19cc0723f0 con 0x7f19cc06f560 2023-11-20T07:02:00.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19d1e09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc072110 con 0x7f19cc15cb60 2023-11-20T07:02:00.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19cb7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19cc15cb60 0x7f19cc0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19cbfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f19cc06f560 0x7f19cc071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19cb7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19cc15cb60 0x7f19cc0c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46102/0 (socket says 172.21.15.88:46102) 2023-11-20T07:02:00.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19cb7fe640 1 -- 172.21.15.88:0/2698778985 learned_addr learned my addr 172.21.15.88:0/2698778985 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:00.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19cb7fe640 1 -- 172.21.15.88:0/2698778985 >> v2:172.21.15.175:3300/0 conn(0x7f19cc06f560 msgr2=0x7f19cc071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:00.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19cb7fe640 1 --2- 172.21.15.88:0/2698778985 >> v2:172.21.15.175:3300/0 conn(0x7f19cc06f560 0x7f19cc071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19caffd640 1 -- 172.21.15.88:0/2698778985 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508918471 0 0) 0x7f19cc06ac10 con 0x7f19cc15cf40 2023-11-20T07:02:00.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19cb7fe640 1 -- 172.21.15.88:0/2698778985 >> v1:172.21.15.175:6789/0 conn(0x7f19cc15cf40 legacy=0x7f19cc06ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19cb7fe640 1 -- 172.21.15.88:0/2698778985 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc06a5c0 con 0x7f19cc15cb60 2023-11-20T07:02:00.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.637+0000 7f19cbfff640 1 --2- 172.21.15.88:0/2698778985 >> v2:172.21.15.175:3300/0 conn(0x7f19cc06f560 0x7f19cc071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:00.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.641+0000 7f19cb7fe640 1 --2- 172.21.15.88:0/2698778985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19cc15cb60 0x7f19cc0c9fd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009870 tx=0x7f19bc01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e8ba5662a035f3e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:00.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.641+0000 7f19caffd640 1 -- 172.21.15.88:0/2698778985 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0ab620 con 0x7f19cc15cb60 2023-11-20T07:02:00.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.641+0000 7f19caffd640 1 -- 172.21.15.88:0/2698778985 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc0ab780 con 0x7f19cc15cb60 2023-11-20T07:02:00.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.641+0000 7f19caffd640 1 -- 172.21.15.88:0/2698778985 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0abb10 con 0x7f19cc15cb60 2023-11-20T07:02:00.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.641+0000 7f19d1e09640 1 -- 172.21.15.88:0/2698778985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19cc15cb60 msgr2=0x7f19cc0c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.641+0000 7f19d1e09640 1 --2- 172.21.15.88:0/2698778985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19cc15cb60 0x7f19cc0c9fd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009870 tx=0x7f19bc01c510 comp rx=0 tx=0).stop 2023-11-20T07:02:00.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.641+0000 7f19d1e09640 1 -- 172.21.15.88:0/2698778985 shutdown_connections 2023-11-20T07:02:00.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.641+0000 7f19d1e09640 1 --2- 172.21.15.88:0/2698778985 >> v2:172.21.15.175:3300/0 conn(0x7f19cc06f560 0x7f19cc071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.641+0000 7f19d1e09640 1 --2- 172.21.15.88:0/2698778985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19cc15cb60 0x7f19cc0c9fd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.641+0000 7f19d1e09640 1 -- 172.21.15.88:0/2698778985 >> 172.21.15.88:0/2698778985 conn(0x7f19cc0cf7a0 msgr2=0x7f19cc0cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.641+0000 7f19d1e09640 1 -- 172.21.15.88:0/2698778985 shutdown_connections 2023-11-20T07:02:00.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.641+0000 7f19d1e09640 1 -- 172.21.15.88:0/2698778985 wait complete. 2023-11-20T07:02:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19d1e09640 1 Processor -- start 2023-11-20T07:02:00.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19d1e09640 1 -- start start 2023-11-20T07:02:00.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19d1e09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19cc06f560 0x7f19cc15f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19d1e09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19cc15cb60 0x7f19cc0c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19d1e09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19cc15cf40 0x7f19cc0c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19d1e09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0b2f70 con 0x7f19cc15cb60 2023-11-20T07:02:00.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19d1e09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0c7ef0 con 0x7f19cc06f560 2023-11-20T07:02:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19d1e09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc154d20 con 0x7f19cc15cf40 2023-11-20T07:02:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19c3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19cc15cb60 0x7f19cc0c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19c3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19cc15cb60 0x7f19cc0c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49418/0 (socket says 172.21.15.88:49418) 2023-11-20T07:02:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19c3fff640 1 -- 172.21.15.88:0/2635593334 learned_addr learned my addr 172.21.15.88:0/2635593334 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19cb7fe640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19cc06f560 0x7f19cc15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19cbfff640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19cc15cf40 0x7f19cc0c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19c3fff640 1 -- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19cc15cf40 msgr2=0x7f19cc0c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19c3fff640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19cc15cf40 0x7f19cc0c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19c3fff640 1 -- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19cc06f560 msgr2=0x7f19cc15f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19c3fff640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19cc06f560 0x7f19cc15f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19c3fff640 1 -- 172.21.15.88:0/2635593334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c4009a70 con 0x7f19cc15cb60 2023-11-20T07:02:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19cb7fe640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19cc06f560 0x7f19cc15f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19c3fff640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19cc15cb60 0x7f19cc0c6c80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f19b4001ec0 tx=0x7f19b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19c8ff9640 1 -- 172.21.15.88:0/2635593334 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b40054e0 con 0x7f19cc15cb60 2023-11-20T07:02:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19c8ff9640 1 -- 172.21.15.88:0/2635593334 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4003600 con 0x7f19cc15cb60 2023-11-20T07:02:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19d1e09640 1 -- 172.21.15.88:0/2635593334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc0094d0 con 0x7f19cc15cb60 2023-11-20T07:02:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.645+0000 7f19c8ff9640 1 -- 172.21.15.88:0/2635593334 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b40039b0 con 0x7f19cc15cb60 2023-11-20T07:02:00.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.649+0000 7f19d1e09640 1 -- 172.21.15.88:0/2635593334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19cc0c78d0 con 0x7f19cc15cb60 2023-11-20T07:02:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.649+0000 7f19d1e09640 1 -- 172.21.15.88:0/2635593334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19cc0b30b0 con 0x7f19cc15cb60 2023-11-20T07:02:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.649+0000 7f19c8ff9640 1 -- 172.21.15.88:0/2635593334 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f19b4003b10 con 0x7f19cc15cb60 2023-11-20T07:02:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.649+0000 7f19c8ff9640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f19ac0664a0 0x7f19ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.649+0000 7f19c8ff9640 1 -- 172.21.15.88:0/2635593334 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f19b40837a0 con 0x7f19cc15cb60 2023-11-20T07:02:00.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.649+0000 7f19cb7fe640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f19ac0664a0 0x7f19ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.653+0000 7f19cb7fe640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f19ac0664a0 0x7f19ac068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0af000 tx=0x7f19bc0b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:00.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.653+0000 7f19c8ff9640 1 -- 172.21.15.88:0/2635593334 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f19cc0b30b0 con 0x7f19cc15cb60 2023-11-20T07:02:00.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 -- 172.21.15.88:0/2635593334 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19cc0b30b0 con 0x7f19cc15cb60 2023-11-20T07:02:00.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19c8ff9640 1 -- 172.21.15.88:0/2635593334 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f19b4017020 con 0x7f19cc15cb60 2023-11-20T07:02:00.810 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:02:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 -- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f19ac0664a0 msgr2=0x7f19ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f19ac0664a0 0x7f19ac068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0af000 tx=0x7f19bc0b6040 comp rx=0 tx=0).stop 2023-11-20T07:02:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 -- 172.21.15.88:0/2635593334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19cc15cb60 msgr2=0x7f19cc0c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19cc15cb60 0x7f19cc0c6c80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f19b4001ec0 tx=0x7f19b400c8e0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 -- 172.21.15.88:0/2635593334 shutdown_connections 2023-11-20T07:02:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f19ac0664a0 0x7f19ac068960 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19cc15cf40 0x7f19cc0c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19cc15cb60 0x7f19cc0c6c80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 --2- 172.21.15.88:0/2635593334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19cc06f560 0x7f19cc15f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 -- 172.21.15.88:0/2635593334 >> 172.21.15.88:0/2635593334 conn(0x7f19cc0cf7a0 msgr2=0x7f19cc0cabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:00.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 -- 172.21.15.88:0/2635593334 shutdown_connections 2023-11-20T07:02:00.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.809+0000 7f19d1e09640 1 -- 172.21.15.88:0/2635593334 wait complete. 2023-11-20T07:02:00.830 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:02:00.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa3d72640 1 Processor -- start 2023-11-20T07:02:00.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa3d72640 1 -- start start 2023-11-20T07:02:00.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa3d72640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8f9c15cba0 0x7f8f9c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa3d72640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c0d0210 0x7f8f9c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa3d72640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9c0d1670 con 0x7f8f9c0b84e0 2023-11-20T07:02:00.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa3d72640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9c0d1460 con 0x7f8f9c15cba0 2023-11-20T07:02:00.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa3d72640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0d1950 con 0x7f8f9c0d0210 2023-11-20T07:02:00.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa130d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8f9c0b84e0 0x7f8f9c0cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51154/0 (socket says 172.21.15.88:51154) 2023-11-20T07:02:00.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa130d640 1 -- 172.21.15.88:0/799497606 learned_addr learned my addr 172.21.15.88:0/799497606 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:00.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa1b0e640 1 --2- 172.21.15.88:0/799497606 >> v2:172.21.15.175:3300/0 conn(0x7f8f9c15cba0 0x7f8f9c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa230f640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c0d0210 0x7f8f9c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261202500 0 0) 0x7f8f9c0d1670 con 0x7f8f9c0b84e0 2023-11-20T07:02:00.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f88003530 con 0x7f8f9c0b84e0 2023-11-20T07:02:00.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2358999063 0 0) 0x7f8f88003530 con 0x7f8f9c0b84e0 2023-11-20T07:02:00.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c0d0210 msgr2=0x7f8f9c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:00.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa0b0c640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c0d0210 0x7f8f9c0b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 >> v2:172.21.15.175:3300/0 conn(0x7f8f9c15cba0 msgr2=0x7f8f9c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:00.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa0b0c640 1 --2- 172.21.15.88:0/799497606 >> v2:172.21.15.175:3300/0 conn(0x7f8f9c15cba0 0x7f8f9c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c0d1c30 con 0x7f8f9c0b84e0 2023-11-20T07:02:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f8f8c001680 con 0x7f8f9c0b84e0 2023-11-20T07:02:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa1b0e640 1 --2- 172.21.15.88:0/799497606 >> v2:172.21.15.175:3300/0 conn(0x7f8f9c15cba0 0x7f8f9c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.969+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 >> v1:172.21.15.88:6789/0 conn(0x7f8f9c0b84e0 legacy=0x7f8f9c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa0b0c640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c0d0210 0x7f8f88003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa0b0c640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f88003f00 0x7f8f880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa0b0c640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f88004d10 0x7f8f88005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0d1460 con 0x7f8f88003f00 2023-11-20T07:02:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0d1950 con 0x7f8f88004d10 2023-11-20T07:02:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8800b990 con 0x7f8f9c0d0210 2023-11-20T07:02:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa1b0e640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c0d0210 0x7f8f88003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa130d640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f88003f00 0x7f8f880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa230f640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f88004d10 0x7f8f88005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa1b0e640 1 -- 172.21.15.88:0/799497606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f88004d10 msgr2=0x7f8f88005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa1b0e640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f88004d10 0x7f8f88005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa1b0e640 1 -- 172.21.15.88:0/799497606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f88003f00 msgr2=0x7f8f880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa1b0e640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f88003f00 0x7f8f880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa1b0e640 1 -- 172.21.15.88:0/799497606 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88003530 con 0x7f8f9c0d0210 2023-11-20T07:02:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa130d640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f88003f00 0x7f8f880047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa1b0e640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c0d0210 0x7f8f88003980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009cb0 tx=0x7f8f9801cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2521645ad20449f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f980a5820 con 0x7f8f9c0d0210 2023-11-20T07:02:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f980a5980 con 0x7f8f9c0d0210 2023-11-20T07:02:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.973+0000 7f8fa0b0c640 1 -- 172.21.15.88:0/799497606 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f980a5d70 con 0x7f8f9c0d0210 2023-11-20T07:02:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 -- 172.21.15.88:0/799497606 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c0d0210 msgr2=0x7f8f88003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 --2- 172.21.15.88:0/799497606 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c0d0210 0x7f8f88003980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009cb0 tx=0x7f8f9801cc70 comp rx=0 tx=0).stop 2023-11-20T07:02:00.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa230f640 1 -- 172.21.15.88:0/799497606 reap_dead start 2023-11-20T07:02:00.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 -- 172.21.15.88:0/799497606 shutdown_connections 2023-11-20T07:02:00.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 -- 172.21.15.88:0/799497606 >> 172.21.15.88:0/799497606 conn(0x7f8f9c0719c0 msgr2=0x7f8f9c071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:00.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 -- 172.21.15.88:0/799497606 shutdown_connections 2023-11-20T07:02:00.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 -- 172.21.15.88:0/799497606 wait complete. 2023-11-20T07:02:00.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 Processor -- start 2023-11-20T07:02:00.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 -- start start 2023-11-20T07:02:00.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f9c0d0210 0x7f8f9c155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f9c1602a0 0x7f8f9c1f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c1577d0 0x7f8f9c157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c15e590 con 0x7f8f9c1602a0 2023-11-20T07:02:00.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c1581a0 con 0x7f8f9c0d0210 2023-11-20T07:02:00.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa3d72640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c15d910 con 0x7f8f9c1577d0 2023-11-20T07:02:00.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa130d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f9c1602a0 0x7f8f9c1f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa130d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f9c1602a0 0x7f8f9c1f2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49432/0 (socket says 172.21.15.88:49432) 2023-11-20T07:02:00.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa130d640 1 -- 172.21.15.88:0/806036150 learned_addr learned my addr 172.21.15.88:0/806036150 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:00.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa1b0e640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f9c0d0210 0x7f8f9c155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.977+0000 7f8fa230f640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c1577d0 0x7f8f9c157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8fa130d640 1 -- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c1577d0 msgr2=0x7f8f9c157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8fa130d640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c1577d0 0x7f8f9c157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8fa130d640 1 -- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f9c0d0210 msgr2=0x7f8f9c155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:00.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8fa130d640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f9c0d0210 0x7f8f9c155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:00.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8fa130d640 1 -- 172.21.15.88:0/806036150 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c15dbf0 con 0x7f8f9c1602a0 2023-11-20T07:02:00.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8fa1b0e640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f9c0d0210 0x7f8f9c155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:00.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8fa130d640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f9c1602a0 0x7f8f9c1f2aa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c012540 tx=0x7f8f8c012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:00.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8f927fc640 1 -- 172.21.15.88:0/806036150 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c014810 con 0x7f8f9c1602a0 2023-11-20T07:02:00.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8f927fc640 1 -- 172.21.15.88:0/806036150 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c014970 con 0x7f8f9c1602a0 2023-11-20T07:02:00.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8f927fc640 1 -- 172.21.15.88:0/806036150 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c014ce0 con 0x7f8f9c1602a0 2023-11-20T07:02:00.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8fa3d72640 1 -- 172.21.15.88:0/806036150 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c15ded0 con 0x7f8f9c1602a0 2023-11-20T07:02:00.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8fa3d72640 1 -- 172.21.15.88:0/806036150 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9c15e9b0 con 0x7f8f9c1602a0 2023-11-20T07:02:00.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8fa3d72640 1 -- 172.21.15.88:0/806036150 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9c15e6d0 con 0x7f8f9c1602a0 2023-11-20T07:02:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.981+0000 7f8f927fc640 1 -- 172.21.15.88:0/806036150 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8f8c0153e0 con 0x7f8f9c1602a0 2023-11-20T07:02:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.985+0000 7f8f927fc640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8f800664a0 0x7f8f80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:00.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.985+0000 7f8f927fc640 1 -- 172.21.15.88:0/806036150 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8f8c086c80 con 0x7f8f9c1602a0 2023-11-20T07:02:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.985+0000 7f8fa1b0e640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8f800664a0 0x7f8f80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:00.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.985+0000 7f8fa1b0e640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8f800664a0 0x7f8f80068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8f980af000 tx=0x7f8f980046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:00.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:00.989+0000 7f8f927fc640 1 -- 172.21.15.88:0/806036150 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8f9c15e6d0 con 0x7f8f9c1602a0 2023-11-20T07:02:01.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 -- 172.21.15.88:0/806036150 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f9c15e6d0 con 0x7f8f9c1602a0 2023-11-20T07:02:01.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8f927fc640 1 -- 172.21.15.88:0/806036150 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f9c15e6d0 con 0x7f8f9c1602a0 2023-11-20T07:02:01.138 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:02:01.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 -- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8f800664a0 msgr2=0x7f8f80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8f800664a0 0x7f8f80068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8f980af000 tx=0x7f8f980046d0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 -- 172.21.15.88:0/806036150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f9c1602a0 msgr2=0x7f8f9c1f2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f9c1602a0 0x7f8f9c1f2aa0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c012540 tx=0x7f8f8c012a00 comp rx=0 tx=0).stop 2023-11-20T07:02:01.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 -- 172.21.15.88:0/806036150 shutdown_connections 2023-11-20T07:02:01.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8f800664a0 0x7f8f80068960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f9c1577d0 0x7f8f9c157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f9c1602a0 0x7f8f9c1f2aa0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 --2- 172.21.15.88:0/806036150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f9c0d0210 0x7f8f9c155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 -- 172.21.15.88:0/806036150 >> 172.21.15.88:0/806036150 conn(0x7f8f9c0719c0 msgr2=0x7f8f9c15a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:01.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 -- 172.21.15.88:0/806036150 shutdown_connections 2023-11-20T07:02:01.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.137+0000 7f8fa3d72640 1 -- 172.21.15.88:0/806036150 wait complete. 2023-11-20T07:02:01.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:02:01.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.297+0000 7f453e8c9640 1 Processor -- start 2023-11-20T07:02:01.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.297+0000 7f453e8c9640 1 -- start start 2023-11-20T07:02:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.297+0000 7f453e8c9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f453815ce10 0x7f4538161390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.297+0000 7f453e8c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45380cdc30 con 0x7f45380cd3e0 2023-11-20T07:02:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.297+0000 7f453e8c9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45380caec0 con 0x7f453806e2f0 2023-11-20T07:02:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.297+0000 7f453e8c9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45380c9750 con 0x7f453815ce10 2023-11-20T07:02:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.297+0000 7f4537fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f453815ce10 0x7f4538161390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.297+0000 7f45377fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f45380cd3e0 0x7f45380ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51158/0 (socket says 172.21.15.88:51158) 2023-11-20T07:02:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.297+0000 7f45377fe640 1 -- 172.21.15.88:0/4227774588 learned_addr learned my addr 172.21.15.88:0/4227774588 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.297+0000 7f4537fff640 1 --2- 172.21.15.88:0/4227774588 >> v2:172.21.15.88:3300/0 conn(0x7f453815ce10 0x7f4538161390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49438/0 (socket says 172.21.15.88:49438) 2023-11-20T07:02:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.301+0000 7f4537fff640 1 -- 172.21.15.88:0/4227774588 >> v1:172.21.15.175:6789/0 conn(0x7f453806e2f0 legacy=0x7f4538069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.301+0000 7f4537fff640 1 -- 172.21.15.88:0/4227774588 >> v1:172.21.15.88:6789/0 conn(0x7f45380cd3e0 legacy=0x7f45380ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.301+0000 7f4537fff640 1 -- 172.21.15.88:0/4227774588 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45380c99f0 con 0x7f453815ce10 2023-11-20T07:02:01.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.301+0000 7f4536ffd640 1 -- 172.21.15.88:0/4227774588 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772412124 0 0) 0x7f45380cdc30 con 0x7f45380cd3e0 2023-11-20T07:02:01.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.301+0000 7f4537fff640 1 --2- 172.21.15.88:0/4227774588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f453815ce10 0x7f4538161390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f45280097c0 tx=0x7f452801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e4ef3202971a09 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:01.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.301+0000 7f4536ffd640 1 -- 172.21.15.88:0/4227774588 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45280ab680 con 0x7f453815ce10 2023-11-20T07:02:01.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.301+0000 7f4536ffd640 1 -- 172.21.15.88:0/4227774588 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45280ab7e0 con 0x7f453815ce10 2023-11-20T07:02:01.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.301+0000 7f4536ffd640 1 -- 172.21.15.88:0/4227774588 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45280abb70 con 0x7f453815ce10 2023-11-20T07:02:01.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.301+0000 7f453e8c9640 1 -- 172.21.15.88:0/4227774588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f453815ce10 msgr2=0x7f4538161390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.301+0000 7f453e8c9640 1 --2- 172.21.15.88:0/4227774588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f453815ce10 0x7f4538161390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f45280097c0 tx=0x7f452801c480 comp rx=0 tx=0).stop 2023-11-20T07:02:01.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 -- 172.21.15.88:0/4227774588 shutdown_connections 2023-11-20T07:02:01.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 --2- 172.21.15.88:0/4227774588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f453815ce10 0x7f4538161390 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 -- 172.21.15.88:0/4227774588 >> 172.21.15.88:0/4227774588 conn(0x7f45380cef20 msgr2=0x7f45380cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:01.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 -- 172.21.15.88:0/4227774588 shutdown_connections 2023-11-20T07:02:01.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 -- 172.21.15.88:0/4227774588 wait complete. 2023-11-20T07:02:01.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 Processor -- start 2023-11-20T07:02:01.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 -- start start 2023-11-20T07:02:01.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f453806e2f0 0x7f45380c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45380cd3e0 0x7f45380c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45380c40f0 0x7f45381534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45380c2930 con 0x7f45380c40f0 2023-11-20T07:02:01.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45380c2b10 con 0x7f453806e2f0 2023-11-20T07:02:01.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453e8c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45380c2df0 con 0x7f45380cd3e0 2023-11-20T07:02:01.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453ce66640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45380c40f0 0x7f45381534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453ce66640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45380c40f0 0x7f45381534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49442/0 (socket says 172.21.15.88:49442) 2023-11-20T07:02:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453ce66640 1 -- 172.21.15.88:0/3262162879 learned_addr learned my addr 172.21.15.88:0/3262162879 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f4537fff640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f453806e2f0 0x7f45380c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f45377fe640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45380cd3e0 0x7f45380c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453ce66640 1 -- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45380cd3e0 msgr2=0x7f45380c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453ce66640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45380cd3e0 0x7f45380c3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453ce66640 1 -- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f453806e2f0 msgr2=0x7f45380c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453ce66640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f453806e2f0 0x7f45380c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453ce66640 1 -- 172.21.15.88:0/3262162879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4528009420 con 0x7f45380c40f0 2023-11-20T07:02:01.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.305+0000 7f453ce66640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45380c40f0 0x7f45381534f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f453000c770 tx=0x7f453000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:01.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.309+0000 7f4534ff9640 1 -- 172.21.15.88:0/3262162879 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530003b80 con 0x7f45380c40f0 2023-11-20T07:02:01.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.309+0000 7f4534ff9640 1 -- 172.21.15.88:0/3262162879 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4530003ce0 con 0x7f45380c40f0 2023-11-20T07:02:01.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.309+0000 7f453e8c9640 1 -- 172.21.15.88:0/3262162879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453806ec90 con 0x7f45380c40f0 2023-11-20T07:02:01.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.309+0000 7f4534ff9640 1 -- 172.21.15.88:0/3262162879 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453000aa90 con 0x7f45380c40f0 2023-11-20T07:02:01.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.309+0000 7f453e8c9640 1 -- 172.21.15.88:0/3262162879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45380c3180 con 0x7f45380c40f0 2023-11-20T07:02:01.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.309+0000 7f453e8c9640 1 -- 172.21.15.88:0/3262162879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453804e170 con 0x7f45380c40f0 2023-11-20T07:02:01.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.309+0000 7f4534ff9640 1 -- 172.21.15.88:0/3262162879 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f453000abf0 con 0x7f45380c40f0 2023-11-20T07:02:01.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.309+0000 7f4534ff9640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f45240664a0 0x7f4524068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.309+0000 7f4534ff9640 1 -- 172.21.15.88:0/3262162879 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4530083ff0 con 0x7f45380c40f0 2023-11-20T07:02:01.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.309+0000 7f4537fff640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f45240664a0 0x7f4524068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.309+0000 7f4537fff640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f45240664a0 0x7f4524068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f45280af000 tx=0x7f45280a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:01.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.313+0000 7f4534ff9640 1 -- 172.21.15.88:0/3262162879 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f45300510c0 con 0x7f45380c40f0 2023-11-20T07:02:01.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 -- 172.21.15.88:0/3262162879 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f453806ef60 con 0x7f45380c40f0 2023-11-20T07:02:01.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f4534ff9640 1 -- 172.21.15.88:0/3262162879 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f45300546e0 con 0x7f45380c40f0 2023-11-20T07:02:01.465 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:02:01.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 -- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f45240664a0 msgr2=0x7f4524068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f45240664a0 0x7f4524068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f45280af000 tx=0x7f45280a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:01.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 -- 172.21.15.88:0/3262162879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45380c40f0 msgr2=0x7f45381534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45380c40f0 0x7f45381534f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f453000c770 tx=0x7f453000cc30 comp rx=0 tx=0).stop 2023-11-20T07:02:01.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 -- 172.21.15.88:0/3262162879 shutdown_connections 2023-11-20T07:02:01.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f45240664a0 0x7f4524068960 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45380cd3e0 0x7f45380c3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f45380c40f0 0x7f45381534f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 --2- 172.21.15.88:0/3262162879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f453806e2f0 0x7f45380c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 -- 172.21.15.88:0/3262162879 >> 172.21.15.88:0/3262162879 conn(0x7f45380cef20 msgr2=0x7f4538157600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:01.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 -- 172.21.15.88:0/3262162879 shutdown_connections 2023-11-20T07:02:01.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.465+0000 7f453e8c9640 1 -- 172.21.15.88:0/3262162879 wait complete. 2023-11-20T07:02:01.486 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T07:02:01.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bd16ad640 1 Processor -- start 2023-11-20T07:02:01.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bd16ad640 1 -- start start 2023-11-20T07:02:01.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bd16ad640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6bcc0d3170 0x7f6bcc0d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bd16ad640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc0ce730 con 0x7f6bcc15c910 2023-11-20T07:02:01.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bd16ad640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc0d0dd0 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bd16ad640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc0ce540 con 0x7f6bcc0d3170 2023-11-20T07:02:01.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bcbfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6bcc15c910 0x7f6bcc0cde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51172/0 (socket says 172.21.15.88:51172) 2023-11-20T07:02:01.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bcbfff640 1 -- 172.21.15.88:0/1960849537 learned_addr learned my addr 172.21.15.88:0/1960849537 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:01.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bcb7fe640 1 --2- 172.21.15.88:0/1960849537 >> v2:172.21.15.175:3300/0 conn(0x7f6bcc0d3170 0x7f6bcc0d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bcaffd640 1 -- 172.21.15.88:0/1960849537 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708258877 0 0) 0x7f6bcc0ce730 con 0x7f6bcc15c910 2023-11-20T07:02:01.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bcaffd640 1 -- 172.21.15.88:0/1960849537 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb4003530 con 0x7f6bcc15c910 2023-11-20T07:02:01.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bcb7fe640 1 -- 172.21.15.88:0/1960849537 >> v1:172.21.15.175:6789/0 conn(0x7f6bcc0cefe0 legacy=0x7f6bcc06b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bcb7fe640 1 -- 172.21.15.88:0/1960849537 >> v1:172.21.15.88:6789/0 conn(0x7f6bcc15c910 legacy=0x7f6bcc0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.625+0000 7f6bcb7fe640 1 -- 172.21.15.88:0/1960849537 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc0d04a0 con 0x7f6bcc0d3170 2023-11-20T07:02:01.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.629+0000 7f6bcb7fe640 1 --2- 172.21.15.88:0/1960849537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bcc0d3170 0x7f6bcc0d1260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00097c0 tx=0x7f6bc001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edb7c957c32bbfc4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:01.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.629+0000 7f6bcaffd640 1 -- 172.21.15.88:0/1960849537 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00ab600 con 0x7f6bcc0d3170 2023-11-20T07:02:01.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.629+0000 7f6bcaffd640 1 -- 172.21.15.88:0/1960849537 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00a7050 con 0x7f6bcc0d3170 2023-11-20T07:02:01.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.629+0000 7f6bcaffd640 1 -- 172.21.15.88:0/1960849537 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00ab960 con 0x7f6bcc0d3170 2023-11-20T07:02:01.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.629+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1960849537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bcc0d3170 msgr2=0x7f6bcc0d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.629+0000 7f6bd16ad640 1 --2- 172.21.15.88:0/1960849537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bcc0d3170 0x7f6bcc0d1260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00097c0 tx=0x7f6bc001c3f0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.629+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1960849537 shutdown_connections 2023-11-20T07:02:01.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.629+0000 7f6bd16ad640 1 --2- 172.21.15.88:0/1960849537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bcc0d3170 0x7f6bcc0d1260 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.629+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1960849537 >> 172.21.15.88:0/1960849537 conn(0x7f6bcc09bb50 msgr2=0x7f6bcc0d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:01.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.629+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1960849537 shutdown_connections 2023-11-20T07:02:01.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.629+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1960849537 wait complete. 2023-11-20T07:02:01.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bd16ad640 1 Processor -- start 2023-11-20T07:02:01.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bd16ad640 1 -- start start 2023-11-20T07:02:01.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bd16ad640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bcc0cefe0 0x7f6bcc15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bd16ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bcc0d3170 0x7f6bcc0cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bd16ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bcc15c910 0x7f6bcc0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bd16ad640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0c9e30 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bd16ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0c86e0 con 0x7f6bcc15c910 2023-11-20T07:02:01.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bd16ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc15c290 con 0x7f6bcc0d3170 2023-11-20T07:02:01.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bcbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bcc0cefe0 0x7f6bcc15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bcbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bcc0cefe0 0x7f6bcc15bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49458/0 (socket says 172.21.15.88:49458) 2023-11-20T07:02:01.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bcbfff640 1 -- 172.21.15.88:0/1438075490 learned_addr learned my addr 172.21.15.88:0/1438075490 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:01.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bd0eac640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bcc15c910 0x7f6bcc0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bcb7fe640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bcc0d3170 0x7f6bcc0cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bcbfff640 1 -- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bcc0d3170 msgr2=0x7f6bcc0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bcbfff640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bcc0d3170 0x7f6bcc0cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bcbfff640 1 -- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bcc15c910 msgr2=0x7f6bcc0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bcbfff640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bcc15c910 0x7f6bcc0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bcbfff640 1 -- 172.21.15.88:0/1438075490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc0009420 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bcb7fe640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bcc0d3170 0x7f6bcc0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:01.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bcbfff640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bcc0cefe0 0x7f6bcc15bd50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00c680 tx=0x7f6bbc00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:01.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bc8ff9640 1 -- 172.21.15.88:0/1438075490 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc007270 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bc8ff9640 1 -- 172.21.15.88:0/1438075490 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc0073d0 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bc8ff9640 1 -- 172.21.15.88:0/1438075490 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00ce80 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1438075490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc156380 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.633+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1438075490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc156940 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.637+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1438075490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc04e9c0 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.637+0000 7f6bc8ff9640 1 -- 172.21.15.88:0/1438075490 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6bbc0057b0 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.637+0000 7f6bc8ff9640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6bb80664a0 0x7f6bb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.637+0000 7f6bc8ff9640 1 -- 172.21.15.88:0/1438075490 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6bbc0839a0 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.637+0000 7f6bcb7fe640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6bb80664a0 0x7f6bb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.637+0000 7f6bcb7fe640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6bb80664a0 0x7f6bb8068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00ad000 tx=0x7f6bc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:01.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.641+0000 7f6bc8ff9640 1 -- 172.21.15.88:0/1438075490 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6bbc0543c0 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1438075490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6bcc0cfe20 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bc8ff9640 1 -- 172.21.15.88:0/1438075490 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6bbc017070 con 0x7f6bcc0cefe0 2023-11-20T07:02:01.805 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-20T07:02:01.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6bb80664a0 msgr2=0x7f6bb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6bb80664a0 0x7f6bb8068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00ad000 tx=0x7f6bc0008040 comp rx=0 tx=0).stop 2023-11-20T07:02:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1438075490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bcc0cefe0 msgr2=0x7f6bcc15bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bcc0cefe0 0x7f6bcc15bd50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00c680 tx=0x7f6bbc00cb40 comp rx=0 tx=0).stop 2023-11-20T07:02:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1438075490 shutdown_connections 2023-11-20T07:02:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6bb80664a0 0x7f6bb8068960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bcc0d3170 0x7f6bcc0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bcc15c910 0x7f6bcc0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 --2- 172.21.15.88:0/1438075490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6bcc0cefe0 0x7f6bcc15bd50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1438075490 >> 172.21.15.88:0/1438075490 conn(0x7f6bcc09bb50 msgr2=0x7f6bcc0afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1438075490 shutdown_connections 2023-11-20T07:02:01.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.805+0000 7f6bd16ad640 1 -- 172.21.15.88:0/1438075490 wait complete. 2023-11-20T07:02:01.826 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:02:01.826 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:02:01.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:01.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.969+0000 7f071379d640 1 Processor -- start 2023-11-20T07:02:01.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f071379d640 1 -- start start 2023-11-20T07:02:01.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f071379d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f070c1597c0 0x7f070c0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f071379d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f070c159ba0 0x7f070c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f071379d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070c0723d0 con 0x7f070c0adc10 2023-11-20T07:02:01.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f071379d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070c0717c0 con 0x7f070c159ba0 2023-11-20T07:02:01.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f071379d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070c071aa0 con 0x7f070c1597c0 2023-11-20T07:02:01.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f0711d3a640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f070c0adc10 0x7f070c0cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51174/0 (socket says 172.21.15.88:51174) 2023-11-20T07:02:01.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f0711d3a640 1 -- 172.21.15.88:0/3217747908 learned_addr learned my addr 172.21.15.88:0/3217747908 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:01.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f0711539640 1 --2- 172.21.15.88:0/3217747908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f070c1597c0 0x7f070c0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f0710d38640 1 --2- 172.21.15.88:0/3217747908 >> v2:172.21.15.175:3300/0 conn(0x7f070c159ba0 0x7f070c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f0703fff640 1 -- 172.21.15.88:0/3217747908 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1001969529 0 0) 0x7f070c0723d0 con 0x7f070c0adc10 2023-11-20T07:02:01.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f0703fff640 1 -- 172.21.15.88:0/3217747908 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06f8003530 con 0x7f070c0adc10 2023-11-20T07:02:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f0711539640 1 -- 172.21.15.88:0/3217747908 >> v2:172.21.15.175:3300/0 conn(0x7f070c159ba0 msgr2=0x7f070c0cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f0711539640 1 --2- 172.21.15.88:0/3217747908 >> v2:172.21.15.175:3300/0 conn(0x7f070c159ba0 0x7f070c0cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f0711539640 1 -- 172.21.15.88:0/3217747908 >> v1:172.21.15.88:6789/0 conn(0x7f070c0adc10 legacy=0x7f070c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f0711539640 1 -- 172.21.15.88:0/3217747908 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c071d80 con 0x7f070c1597c0 2023-11-20T07:02:01.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.973+0000 7f0710d38640 1 --2- 172.21.15.88:0/3217747908 >> v2:172.21.15.175:3300/0 conn(0x7f070c159ba0 0x7f070c0cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:01.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.977+0000 7f0711539640 1 --2- 172.21.15.88:0/3217747908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f070c1597c0 0x7f070c0ad6d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07080097c0 tx=0x7f070801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f65c506bf3da520f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:01.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.977+0000 7f0703fff640 1 -- 172.21.15.88:0/3217747908 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07080ab620 con 0x7f070c1597c0 2023-11-20T07:02:01.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.977+0000 7f0703fff640 1 -- 172.21.15.88:0/3217747908 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07080ab780 con 0x7f070c1597c0 2023-11-20T07:02:01.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.977+0000 7f0703fff640 1 -- 172.21.15.88:0/3217747908 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07080abb10 con 0x7f070c1597c0 2023-11-20T07:02:01.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.977+0000 7f071379d640 1 -- 172.21.15.88:0/3217747908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f070c1597c0 msgr2=0x7f070c0ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.977+0000 7f071379d640 1 --2- 172.21.15.88:0/3217747908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f070c1597c0 0x7f070c0ad6d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07080097c0 tx=0x7f070801c480 comp rx=0 tx=0).stop 2023-11-20T07:02:01.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.977+0000 7f071379d640 1 -- 172.21.15.88:0/3217747908 shutdown_connections 2023-11-20T07:02:01.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.977+0000 7f071379d640 1 --2- 172.21.15.88:0/3217747908 >> v2:172.21.15.175:3300/0 conn(0x7f070c159ba0 0x7f070c0cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.977+0000 7f071379d640 1 --2- 172.21.15.88:0/3217747908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f070c1597c0 0x7f070c0ad6d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.977+0000 7f071379d640 1 -- 172.21.15.88:0/3217747908 >> 172.21.15.88:0/3217747908 conn(0x7f070c06c190 msgr2=0x7f070c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:01.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.977+0000 7f071379d640 1 -- 172.21.15.88:0/3217747908 shutdown_connections 2023-11-20T07:02:01.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.977+0000 7f071379d640 1 -- 172.21.15.88:0/3217747908 wait complete. 2023-11-20T07:02:01.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f071379d640 1 Processor -- start 2023-11-20T07:02:01.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f071379d640 1 -- start start 2023-11-20T07:02:01.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f071379d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f070c0adc10 0x7f070c0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f071379d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f070c1597c0 0x7f070c168000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f071379d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f070c159ba0 0x7f070c14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f071379d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070c0c6b60 con 0x7f070c1597c0 2023-11-20T07:02:01.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f071379d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070c0c6e40 con 0x7f070c159ba0 2023-11-20T07:02:01.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f071379d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070c0c7120 con 0x7f070c0adc10 2023-11-20T07:02:01.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0710d38640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f070c1597c0 0x7f070c168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0710d38640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f070c1597c0 0x7f070c168000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49464/0 (socket says 172.21.15.88:49464) 2023-11-20T07:02:01.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0710d38640 1 -- 172.21.15.88:0/2599917468 learned_addr learned my addr 172.21.15.88:0/2599917468 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:01.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0711539640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f070c0adc10 0x7f070c0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0711d3a640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f070c159ba0 0x7f070c14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0710d38640 1 -- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f070c0adc10 msgr2=0x7f070c0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0710d38640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f070c0adc10 0x7f070c0c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0710d38640 1 -- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f070c159ba0 msgr2=0x7f070c14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:01.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0710d38640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f070c159ba0 0x7f070c14bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:01.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0710d38640 1 -- 172.21.15.88:0/2599917468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc009420 con 0x7f070c1597c0 2023-11-20T07:02:01.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0710d38640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f070c1597c0 0x7f070c168000 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00e980 tx=0x7f06fc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:01.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0701ffb640 1 -- 172.21.15.88:0/2599917468 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc00ca00 con 0x7f070c1597c0 2023-11-20T07:02:01.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0701ffb640 1 -- 172.21.15.88:0/2599917468 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc00cb60 con 0x7f070c1597c0 2023-11-20T07:02:01.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f0701ffb640 1 -- 172.21.15.88:0/2599917468 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc013470 con 0x7f070c1597c0 2023-11-20T07:02:01.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f071379d640 1 -- 172.21.15.88:0/2599917468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0708009420 con 0x7f070c1597c0 2023-11-20T07:02:01.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f071379d640 1 -- 172.21.15.88:0/2599917468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070c0c76e0 con 0x7f070c1597c0 2023-11-20T07:02:01.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.981+0000 7f071379d640 1 -- 172.21.15.88:0/2599917468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070c074010 con 0x7f070c1597c0 2023-11-20T07:02:01.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.985+0000 7f0701ffb640 1 -- 172.21.15.88:0/2599917468 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f06fc0135d0 con 0x7f070c1597c0 2023-11-20T07:02:01.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.985+0000 7f0701ffb640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f06f00664a0 0x7f06f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:01.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.985+0000 7f0701ffb640 1 -- 172.21.15.88:0/2599917468 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f06fc0844e0 con 0x7f070c1597c0 2023-11-20T07:02:01.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.985+0000 7f0711539640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f06f00664a0 0x7f06f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:01.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.985+0000 7f0711539640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f06f00664a0 0x7f06f0068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f07080af000 tx=0x7f07080a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:01.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:01.989+0000 7f0701ffb640 1 -- 172.21.15.88:0/2599917468 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f06fc051500 con 0x7f070c1597c0 2023-11-20T07:02:02.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.137+0000 7f071379d640 1 -- 172.21.15.88:0/2599917468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f070c0cd3f0 con 0x7f070c1597c0 2023-11-20T07:02:02.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.137+0000 7f0701ffb640 1 -- 172.21.15.88:0/2599917468 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f06fc054b20 con 0x7f070c1597c0 2023-11-20T07:02:02.140 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:02.141 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:02.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.141+0000 7f071379d640 1 -- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f06f00664a0 msgr2=0x7f06f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.141+0000 7f071379d640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f06f00664a0 0x7f06f0068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f07080af000 tx=0x7f07080a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.141+0000 7f071379d640 1 -- 172.21.15.88:0/2599917468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f070c1597c0 msgr2=0x7f070c168000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.141+0000 7f071379d640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f070c1597c0 0x7f070c168000 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00e980 tx=0x7f06fc00ee40 comp rx=0 tx=0).stop 2023-11-20T07:02:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.141+0000 7f071379d640 1 -- 172.21.15.88:0/2599917468 shutdown_connections 2023-11-20T07:02:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.141+0000 7f071379d640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f06f00664a0 0x7f06f0068960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.141+0000 7f071379d640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f070c159ba0 0x7f070c14bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.141+0000 7f071379d640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f070c1597c0 0x7f070c168000 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.141+0000 7f071379d640 1 --2- 172.21.15.88:0/2599917468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f070c0adc10 0x7f070c0c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.141+0000 7f071379d640 1 -- 172.21.15.88:0/2599917468 >> 172.21.15.88:0/2599917468 conn(0x7f070c06c190 msgr2=0x7f070c0af070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:02.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.141+0000 7f071379d640 1 -- 172.21.15.88:0/2599917468 shutdown_connections 2023-11-20T07:02:02.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.141+0000 7f071379d640 1 -- 172.21.15.88:0/2599917468 wait complete. 2023-11-20T07:02:02.161 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:02:02.162 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:02:02.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81bf9c5640 1 Processor -- start 2023-11-20T07:02:02.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81bf9c5640 1 -- start start 2023-11-20T07:02:02.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81bf9c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81b815cba0 0x7f81b80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81bf9c5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b80d1670 con 0x7f81b80d0210 2023-11-20T07:02:02.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81bf9c5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b80d1950 con 0x7f81b80b84e0 2023-11-20T07:02:02.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81bf9c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80d1460 con 0x7f81b815cba0 2023-11-20T07:02:02.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81bdf62640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f81b80d0210 0x7f81b80b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51188/0 (socket says 172.21.15.88:51188) 2023-11-20T07:02:02.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81bdf62640 1 -- 172.21.15.88:0/1953623477 learned_addr learned my addr 172.21.15.88:0/1953623477 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:02.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81bd761640 1 --2- 172.21.15.88:0/1953623477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81b815cba0 0x7f81b80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81affff640 1 -- 172.21.15.88:0/1953623477 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814226505 0 0) 0x7f81b80d1670 con 0x7f81b80d0210 2023-11-20T07:02:02.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81affff640 1 -- 172.21.15.88:0/1953623477 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81a4003530 con 0x7f81b80d0210 2023-11-20T07:02:02.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81affff640 1 -- 172.21.15.88:0/1953623477 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091212509 0 0) 0x7f81b80d1950 con 0x7f81b80b84e0 2023-11-20T07:02:02.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81affff640 1 -- 172.21.15.88:0/1953623477 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b80d1670 con 0x7f81b80b84e0 2023-11-20T07:02:02.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81bd761640 1 -- 172.21.15.88:0/1953623477 >> v1:172.21.15.175:6789/0 conn(0x7f81b80b84e0 legacy=0x7f81b80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81bd761640 1 -- 172.21.15.88:0/1953623477 >> v1:172.21.15.88:6789/0 conn(0x7f81b80d0210 legacy=0x7f81b80b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.301+0000 7f81bd761640 1 -- 172.21.15.88:0/1953623477 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b80d1c30 con 0x7f81b815cba0 2023-11-20T07:02:02.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.305+0000 7f81bd761640 1 --2- 172.21.15.88:0/1953623477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81b815cba0 0x7f81b80d0f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097f0 tx=0x7f81b401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6bf50e459b56a42 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:02.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.305+0000 7f81affff640 1 -- 172.21.15.88:0/1953623477 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b40aa620 con 0x7f81b815cba0 2023-11-20T07:02:02.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.305+0000 7f81affff640 1 -- 172.21.15.88:0/1953623477 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b40aa780 con 0x7f81b815cba0 2023-11-20T07:02:02.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.305+0000 7f81affff640 1 -- 172.21.15.88:0/1953623477 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b40aab10 con 0x7f81b815cba0 2023-11-20T07:02:02.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.305+0000 7f81bf9c5640 1 -- 172.21.15.88:0/1953623477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81b815cba0 msgr2=0x7f81b80d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.305+0000 7f81bf9c5640 1 --2- 172.21.15.88:0/1953623477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81b815cba0 0x7f81b80d0f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097f0 tx=0x7f81b401c4c0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.305+0000 7f81bf9c5640 1 -- 172.21.15.88:0/1953623477 shutdown_connections 2023-11-20T07:02:02.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.305+0000 7f81bf9c5640 1 --2- 172.21.15.88:0/1953623477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81b815cba0 0x7f81b80d0f20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.305+0000 7f81bf9c5640 1 -- 172.21.15.88:0/1953623477 >> 172.21.15.88:0/1953623477 conn(0x7f81b80719c0 msgr2=0x7f81b8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:02.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bf9c5640 1 -- 172.21.15.88:0/1953623477 shutdown_connections 2023-11-20T07:02:02.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bf9c5640 1 -- 172.21.15.88:0/1953623477 wait complete. 2023-11-20T07:02:02.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bf9c5640 1 Processor -- start 2023-11-20T07:02:02.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bf9c5640 1 -- start start 2023-11-20T07:02:02.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bf9c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81b80b84e0 0x7f81b80c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bf9c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81b80d0210 0x7f81b81542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bf9c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b815cba0 0x7f81b814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bf9c5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b8145c10 con 0x7f81b815cba0 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bf9c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b8154980 con 0x7f81b80d0210 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bf9c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b8154c60 con 0x7f81b80b84e0 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bdf62640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b815cba0 0x7f81b814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bdf62640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b815cba0 0x7f81b814d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49468/0 (socket says 172.21.15.88:49468) 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bdf62640 1 -- 172.21.15.88:0/2690226116 learned_addr learned my addr 172.21.15.88:0/2690226116 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bcf60640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81b80d0210 0x7f81b81542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bd761640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81b80b84e0 0x7f81b80c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bdf62640 1 -- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81b80b84e0 msgr2=0x7f81b80c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bdf62640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81b80b84e0 0x7f81b80c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bdf62640 1 -- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81b80d0210 msgr2=0x7f81b81542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bdf62640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81b80d0210 0x7f81b81542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bdf62640 1 -- 172.21.15.88:0/2690226116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b4009420 con 0x7f81b815cba0 2023-11-20T07:02:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bd761640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81b80b84e0 0x7f81b80c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bcf60640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81b80d0210 0x7f81b81542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bdf62640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b815cba0 0x7f81b814d2b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f81b000cba0 tx=0x7f81b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81adffb640 1 -- 172.21.15.88:0/2690226116 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000ace0 con 0x7f81b815cba0 2023-11-20T07:02:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81bf9c5640 1 -- 172.21.15.88:0/2690226116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b8154f40 con 0x7f81b815cba0 2023-11-20T07:02:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81adffb640 1 -- 172.21.15.88:0/2690226116 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b000ae40 con 0x7f81b815cba0 2023-11-20T07:02:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.309+0000 7f81adffb640 1 -- 172.21.15.88:0/2690226116 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0012620 con 0x7f81b815cba0 2023-11-20T07:02:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.313+0000 7f81bf9c5640 1 -- 172.21.15.88:0/2690226116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b80c40d0 con 0x7f81b815cba0 2023-11-20T07:02:02.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.313+0000 7f81bf9c5640 1 -- 172.21.15.88:0/2690226116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b80c42f0 con 0x7f81b815cba0 2023-11-20T07:02:02.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.313+0000 7f81adffb640 1 -- 172.21.15.88:0/2690226116 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f81b0007070 con 0x7f81b815cba0 2023-11-20T07:02:02.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.313+0000 7f81adffb640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f819c0664d0 0x7f819c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.313+0000 7f81adffb640 1 -- 172.21.15.88:0/2690226116 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f81b0084430 con 0x7f81b815cba0 2023-11-20T07:02:02.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.313+0000 7f81bd761640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f819c0664d0 0x7f819c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.317+0000 7f81bd761640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f819c0664d0 0x7f819c068990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f81b40ae000 tx=0x7f81b40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:02.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.317+0000 7f81adffb640 1 -- 172.21.15.88:0/2690226116 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f81b0054dd0 con 0x7f81b815cba0 2023-11-20T07:02:02.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.473+0000 7f81bf9c5640 1 -- 172.21.15.88:0/2690226116 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81b804e170 con 0x7f81b815cba0 2023-11-20T07:02:02.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.473+0000 7f81adffb640 1 -- 172.21.15.88:0/2690226116 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81b0054960 con 0x7f81b815cba0 2023-11-20T07:02:02.474 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:02:02.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.473+0000 7f81bf9c5640 1 -- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f819c0664d0 msgr2=0x7f819c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.473+0000 7f81bf9c5640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f819c0664d0 0x7f819c068990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f81b40ae000 tx=0x7f81b40a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.473+0000 7f81bf9c5640 1 -- 172.21.15.88:0/2690226116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b815cba0 msgr2=0x7f81b814d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.473+0000 7f81bf9c5640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b815cba0 0x7f81b814d2b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f81b000cba0 tx=0x7f81b000a430 comp rx=0 tx=0).stop 2023-11-20T07:02:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.473+0000 7f81bf9c5640 1 -- 172.21.15.88:0/2690226116 shutdown_connections 2023-11-20T07:02:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.473+0000 7f81bf9c5640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f819c0664d0 0x7f819c068990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.473+0000 7f81bf9c5640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81b815cba0 0x7f81b814d2b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.473+0000 7f81bf9c5640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81b80d0210 0x7f81b81542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.473+0000 7f81bf9c5640 1 --2- 172.21.15.88:0/2690226116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81b80b84e0 0x7f81b80c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.473+0000 7f81bf9c5640 1 -- 172.21.15.88:0/2690226116 >> 172.21.15.88:0/2690226116 conn(0x7f81b80719c0 msgr2=0x7f81b815acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.477+0000 7f81bf9c5640 1 -- 172.21.15.88:0/2690226116 shutdown_connections 2023-11-20T07:02:02.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.477+0000 7f81bf9c5640 1 -- 172.21.15.88:0/2690226116 wait complete. 2023-11-20T07:02:02.495 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:02:02.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.637+0000 7f0e5dfe4640 1 Processor -- start 2023-11-20T07:02:02.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.637+0000 7f0e5dfe4640 1 -- start start 2023-11-20T07:02:02.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.637+0000 7f0e5dfe4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0e580d32e0 0x7f0e580d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.637+0000 7f0e5dfe4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e580cf080 0x7f0e580cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.637+0000 7f0e5dfe4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5815ce90 con 0x7f0e5815cab0 2023-11-20T07:02:02.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.637+0000 7f0e5dfe4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580cdc90 con 0x7f0e580cf080 2023-11-20T07:02:02.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.637+0000 7f0e5dfe4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580ce7c0 con 0x7f0e580d32e0 2023-11-20T07:02:02.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.641+0000 7f0e5d7e3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e580cf080 0x7f0e580cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.641+0000 7f0e5d7e3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0e580cf080 0x7f0e580cf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49470/0 (socket says 172.21.15.88:49470) 2023-11-20T07:02:02.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.641+0000 7f0e5d7e3640 1 -- 172.21.15.88:0/3300620374 learned_addr learned my addr 172.21.15.88:0/3300620374 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:02.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.641+0000 7f0e57fff640 1 --2- 172.21.15.88:0/3300620374 >> v2:172.21.15.175:3300/0 conn(0x7f0e580d32e0 0x7f0e580d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.641+0000 7f0e5d7e3640 1 -- 172.21.15.88:0/3300620374 >> v2:172.21.15.175:3300/0 conn(0x7f0e580d32e0 msgr2=0x7f0e580d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:02.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.641+0000 7f0e5d7e3640 1 --2- 172.21.15.88:0/3300620374 >> v2:172.21.15.175:3300/0 conn(0x7f0e580d32e0 0x7f0e580d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.641+0000 7f0e5d7e3640 1 -- 172.21.15.88:0/3300620374 >> v1:172.21.15.175:6789/0 conn(0x7f0e5815cab0 legacy=0x7f0e580ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.641+0000 7f0e5d7e3640 1 -- 172.21.15.88:0/3300620374 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580d12d0 con 0x7f0e580cf080 2023-11-20T07:02:02.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.641+0000 7f0e5d7e3640 1 --2- 172.21.15.88:0/3300620374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e580cf080 0x7f0e580cf510 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0e580b5360 tx=0x7f0e5001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8213ac4caadd4495 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:02.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.641+0000 7f0e577fe640 1 -- 172.21.15.88:0/3300620374 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500a57a0 con 0x7f0e580cf080 2023-11-20T07:02:02.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.641+0000 7f0e577fe640 1 -- 172.21.15.88:0/3300620374 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e500a5900 con 0x7f0e580cf080 2023-11-20T07:02:02.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.641+0000 7f0e577fe640 1 -- 172.21.15.88:0/3300620374 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500a5c90 con 0x7f0e580cf080 2023-11-20T07:02:02.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3300620374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e580cf080 msgr2=0x7f0e580cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 --2- 172.21.15.88:0/3300620374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e580cf080 0x7f0e580cf510 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0e580b5360 tx=0x7f0e5001c9d0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3300620374 shutdown_connections 2023-11-20T07:02:02.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 --2- 172.21.15.88:0/3300620374 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e580cf080 0x7f0e580cf510 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 --2- 172.21.15.88:0/3300620374 >> v2:172.21.15.175:3300/0 conn(0x7f0e580d32e0 0x7f0e580d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3300620374 >> 172.21.15.88:0/3300620374 conn(0x7f0e58089f80 msgr2=0x7f0e580d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:02.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3300620374 shutdown_connections 2023-11-20T07:02:02.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3300620374 wait complete. 2023-11-20T07:02:02.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 Processor -- start 2023-11-20T07:02:02.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 -- start start 2023-11-20T07:02:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e580cf080 0x7f0e58157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e580d32e0 0x7f0e580ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e5815cab0 0x7f0e580b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580cc0a0 con 0x7f0e580d32e0 2023-11-20T07:02:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581583f0 con 0x7f0e580cf080 2023-11-20T07:02:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5dfe4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580cb420 con 0x7f0e5815cab0 2023-11-20T07:02:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e57fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e580d32e0 0x7f0e580ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e57fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e580d32e0 0x7f0e580ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49482/0 (socket says 172.21.15.88:49482) 2023-11-20T07:02:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e57fff640 1 -- 172.21.15.88:0/3449136073 learned_addr learned my addr 172.21.15.88:0/3449136073 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5cfe2640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e580cf080 0x7f0e58157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e5d7e3640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e5815cab0 0x7f0e580b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.645+0000 7f0e57fff640 1 -- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e5815cab0 msgr2=0x7f0e580b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e57fff640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e5815cab0 0x7f0e580b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e57fff640 1 -- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e580cf080 msgr2=0x7f0e58157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e57fff640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e580cf080 0x7f0e58157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e57fff640 1 -- 172.21.15.88:0/3449136073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e50009b30 con 0x7f0e580d32e0 2023-11-20T07:02:02.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e5cfe2640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e580cf080 0x7f0e58157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:02.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e5d7e3640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e5815cab0 0x7f0e580b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:02.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e57fff640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e580d32e0 0x7f0e580ca440 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400e960 tx=0x7f0e4400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e557fa640 1 -- 172.21.15.88:0/3449136073 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e44009690 con 0x7f0e580d32e0 2023-11-20T07:02:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e557fa640 1 -- 172.21.15.88:0/3449136073 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4400ca00 con 0x7f0e580d32e0 2023-11-20T07:02:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3449136073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e580cb700 con 0x7f0e580d32e0 2023-11-20T07:02:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e557fa640 1 -- 172.21.15.88:0/3449136073 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4400cd70 con 0x7f0e580d32e0 2023-11-20T07:02:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3449136073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e580cbcc0 con 0x7f0e580d32e0 2023-11-20T07:02:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3449136073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e580cc1e0 con 0x7f0e580d32e0 2023-11-20T07:02:02.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e557fa640 1 -- 172.21.15.88:0/3449136073 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0e44013470 con 0x7f0e580d32e0 2023-11-20T07:02:02.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e557fa640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0e3c0664d0 0x7f0e3c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e557fa640 1 -- 172.21.15.88:0/3449136073 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e440844b0 con 0x7f0e580d32e0 2023-11-20T07:02:02.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.649+0000 7f0e5cfe2640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0e3c0664d0 0x7f0e3c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.653+0000 7f0e5cfe2640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0e3c0664d0 0x7f0e3c068990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c000f70 tx=0x7f0e4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:02.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.653+0000 7f0e557fa640 1 -- 172.21.15.88:0/3449136073 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e580cc1e0 con 0x7f0e580d32e0 2023-11-20T07:02:02.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.805+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3449136073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e580cc1e0 con 0x7f0e580d32e0 2023-11-20T07:02:02.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.805+0000 7f0e557fa640 1 -- 172.21.15.88:0/3449136073 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e580cc1e0 con 0x7f0e580d32e0 2023-11-20T07:02:02.807 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:02:02.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.809+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0e3c0664d0 msgr2=0x7f0e3c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.809+0000 7f0e5dfe4640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0e3c0664d0 0x7f0e3c068990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c000f70 tx=0x7f0e4c009040 comp rx=0 tx=0).stop 2023-11-20T07:02:02.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.809+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3449136073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e580d32e0 msgr2=0x7f0e580ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.809+0000 7f0e5dfe4640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e580d32e0 0x7f0e580ca440 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0e4400e960 tx=0x7f0e4400ee20 comp rx=0 tx=0).stop 2023-11-20T07:02:02.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.809+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3449136073 shutdown_connections 2023-11-20T07:02:02.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.809+0000 7f0e5dfe4640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0e3c0664d0 0x7f0e3c068990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.809+0000 7f0e5dfe4640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e5815cab0 0x7f0e580b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.809+0000 7f0e5dfe4640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e580d32e0 0x7f0e580ca440 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.809+0000 7f0e5dfe4640 1 --2- 172.21.15.88:0/3449136073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e580cf080 0x7f0e58157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.809+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3449136073 >> 172.21.15.88:0/3449136073 conn(0x7f0e58089f80 msgr2=0x7f0e58159870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:02.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.809+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3449136073 shutdown_connections 2023-11-20T07:02:02.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.809+0000 7f0e5dfe4640 1 -- 172.21.15.88:0/3449136073 wait complete. 2023-11-20T07:02:02.828 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:02:02.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f9dd3640 1 Processor -- start 2023-11-20T07:02:02.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f9dd3640 1 -- start start 2023-11-20T07:02:02.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f9dd3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7f40cb640 0x7fb7f40cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f9dd3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f415c940 con 0x7fb7f415c560 2023-11-20T07:02:02.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f9dd3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f40b1870 con 0x7fb7f40b30d0 2023-11-20T07:02:02.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f9dd3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f40b1540 con 0x7fb7f40cb640 2023-11-20T07:02:02.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f37fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb7f415c560 0x7fb7f40b1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51194/0 (socket says 172.21.15.88:51194) 2023-11-20T07:02:02.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f37fe640 1 -- 172.21.15.88:0/187957784 learned_addr learned my addr 172.21.15.88:0/187957784 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:02.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f3fff640 1 --2- 172.21.15.88:0/187957784 >> v2:172.21.15.88:3300/0 conn(0x7fb7f40cb640 0x7fb7f40cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f27fc640 1 -- 172.21.15.88:0/187957784 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031929268 0 0) 0x7fb7f415c940 con 0x7fb7f415c560 2023-11-20T07:02:02.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f27fc640 1 -- 172.21.15.88:0/187957784 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7dc003450 con 0x7fb7f415c560 2023-11-20T07:02:02.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f3fff640 1 -- 172.21.15.88:0/187957784 >> v1:172.21.15.175:6789/0 conn(0x7fb7f40b30d0 legacy=0x7fb7f40caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:02.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f3fff640 1 -- 172.21.15.88:0/187957784 >> v1:172.21.15.88:6789/0 conn(0x7fb7f415c560 legacy=0x7fb7f40b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.969+0000 7fb7f3fff640 1 -- 172.21.15.88:0/187957784 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40cc880 con 0x7fb7f40cb640 2023-11-20T07:02:02.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.973+0000 7fb7f3fff640 1 --2- 172.21.15.88:0/187957784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f40cb640 0x7fb7f40cdd20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009d90 tx=0x7fb7ec01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250c191d6659c2ae server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:02.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.973+0000 7fb7f27fc640 1 -- 172.21.15.88:0/187957784 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0a57b0 con 0x7fb7f40cb640 2023-11-20T07:02:02.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.973+0000 7fb7f27fc640 1 -- 172.21.15.88:0/187957784 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec0a5910 con 0x7fb7f40cb640 2023-11-20T07:02:02.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.973+0000 7fb7f27fc640 1 -- 172.21.15.88:0/187957784 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0a5ca0 con 0x7fb7f40cb640 2023-11-20T07:02:02.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.973+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/187957784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f40cb640 msgr2=0x7fb7f40cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.973+0000 7fb7f9dd3640 1 --2- 172.21.15.88:0/187957784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f40cb640 0x7fb7f40cdd20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009d90 tx=0x7fb7ec01c880 comp rx=0 tx=0).stop 2023-11-20T07:02:02.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.973+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/187957784 shutdown_connections 2023-11-20T07:02:02.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.973+0000 7fb7f9dd3640 1 --2- 172.21.15.88:0/187957784 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f40cb640 0x7fb7f40cdd20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.973+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/187957784 >> 172.21.15.88:0/187957784 conn(0x7fb7f406a490 msgr2=0x7fb7f40ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:02.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.973+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/187957784 shutdown_connections 2023-11-20T07:02:02.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.973+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/187957784 wait complete. 2023-11-20T07:02:02.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.973+0000 7fb7f9dd3640 1 Processor -- start 2023-11-20T07:02:02.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f9dd3640 1 -- start start 2023-11-20T07:02:02.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f9dd3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7f40b30d0 0x7fb7f41554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f9dd3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f40cb640 0x7fb7f41591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f9dd3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7f415c560 0x7fb7f4159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f9dd3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40adfb0 con 0x7fb7f40cb640 2023-11-20T07:02:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f9dd3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40aeda0 con 0x7fb7f415c560 2023-11-20T07:02:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f9dd3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40ae190 con 0x7fb7f40b30d0 2023-11-20T07:02:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f40cb640 0x7fb7f41591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f40cb640 0x7fb7f41591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49494/0 (socket says 172.21.15.88:49494) 2023-11-20T07:02:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f2ffd640 1 -- 172.21.15.88:0/3016683090 learned_addr learned my addr 172.21.15.88:0/3016683090 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f3fff640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7f415c560 0x7fb7f4159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f37fe640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7f40b30d0 0x7fb7f41554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f2ffd640 1 -- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7f40b30d0 msgr2=0x7fb7f41554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f2ffd640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7f40b30d0 0x7fb7f41554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f2ffd640 1 -- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7f415c560 msgr2=0x7fb7f4159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:02.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f2ffd640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7f415c560 0x7fb7f4159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:02.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f2ffd640 1 -- 172.21.15.88:0/3016683090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec009a70 con 0x7fb7f40cb640 2023-11-20T07:02:02.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f2ffd640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f40cb640 0x7fb7f41591f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c450 tx=0x7fb7e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:02.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7dbfff640 1 -- 172.21.15.88:0/3016683090 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8012830 con 0x7fb7f40cb640 2023-11-20T07:02:02.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7dbfff640 1 -- 172.21.15.88:0/3016683090 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e80129b0 con 0x7fb7f40cb640 2023-11-20T07:02:02.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7dbfff640 1 -- 172.21.15.88:0/3016683090 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8012d60 con 0x7fb7f40cb640 2023-11-20T07:02:02.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/3016683090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f40ae470 con 0x7fb7f40cb640 2023-11-20T07:02:02.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/3016683090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f40aea30 con 0x7fb7f40cb640 2023-11-20T07:02:02.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.977+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/3016683090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f40aef10 con 0x7fb7f40cb640 2023-11-20T07:02:02.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.981+0000 7fb7dbfff640 1 -- 172.21.15.88:0/3016683090 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb7e801c460 con 0x7fb7f40cb640 2023-11-20T07:02:02.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.981+0000 7fb7dbfff640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7e00664d0 0x7fb7e0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:02.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.981+0000 7fb7dbfff640 1 -- 172.21.15.88:0/3016683090 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb7e8083ff0 con 0x7fb7f40cb640 2023-11-20T07:02:02.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.981+0000 7fb7f37fe640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7e00664d0 0x7fb7e0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:02.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.981+0000 7fb7f37fe640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7e00664d0 0x7fb7e0068990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40010f0 tx=0x7fb7e4007bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:02.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:02.985+0000 7fb7dbfff640 1 -- 172.21.15.88:0/3016683090 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb7e80510c0 con 0x7fb7f40cb640 2023-11-20T07:02:03.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/3016683090 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7f4073fa0 con 0x7fb7f40cb640 2023-11-20T07:02:03.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7dbfff640 1 -- 172.21.15.88:0/3016683090 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7e80546e0 con 0x7fb7f40cb640 2023-11-20T07:02:03.134 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:02:03.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7e00664d0 msgr2=0x7fb7e0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7e00664d0 0x7fb7e0068990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40010f0 tx=0x7fb7e4007bf0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/3016683090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f40cb640 msgr2=0x7fb7f41591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f40cb640 0x7fb7f41591f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c450 tx=0x7fb7e800c910 comp rx=0 tx=0).stop 2023-11-20T07:02:03.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/3016683090 shutdown_connections 2023-11-20T07:02:03.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7e00664d0 0x7fb7e0068990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7f415c560 0x7fb7f4159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7f40cb640 0x7fb7f41591f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 --2- 172.21.15.88:0/3016683090 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7f40b30d0 0x7fb7f41554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/3016683090 >> 172.21.15.88:0/3016683090 conn(0x7fb7f406a490 msgr2=0x7fb7f4071230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:03.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/3016683090 shutdown_connections 2023-11-20T07:02:03.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.133+0000 7fb7f9dd3640 1 -- 172.21.15.88:0/3016683090 wait complete. 2023-11-20T07:02:03.156 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:02:03.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.293+0000 7f2d57f3e640 1 Processor -- start 2023-11-20T07:02:03.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d57f3e640 1 -- start start 2023-11-20T07:02:03.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d57f3e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2d50069e90 0x7f2d5006d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:03.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d57f3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006a270 0x7f2d500c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:03.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d57f3e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5015ae30 con 0x7f2d500702f0 2023-11-20T07:02:03.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d57f3e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d500cb090 con 0x7f2d50069e90 2023-11-20T07:02:03.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d57f3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500ca510 con 0x7f2d5006a270 2023-11-20T07:02:03.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d55cda640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2d50069e90 0x7f2d5006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:03.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d564db640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2d500702f0 0x7f2d50070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51200/0 (socket says 172.21.15.88:51200) 2023-11-20T07:02:03.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d564db640 1 -- 172.21.15.88:0/503150749 learned_addr learned my addr 172.21.15.88:0/503150749 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:03.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d554d9640 1 --2- 172.21.15.88:0/503150749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006a270 0x7f2d500c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:03.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d55cda640 1 -- 172.21.15.88:0/503150749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006a270 msgr2=0x7f2d500c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:03.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d55cda640 1 --2- 172.21.15.88:0/503150749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006a270 0x7f2d500c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d55cda640 1 -- 172.21.15.88:0/503150749 >> v1:172.21.15.88:6789/0 conn(0x7f2d500702f0 legacy=0x7f2d50070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.297+0000 7f2d55cda640 1 -- 172.21.15.88:0/503150749 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500ca7f0 con 0x7f2d50069e90 2023-11-20T07:02:03.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.301+0000 7f2d55cda640 1 --2- 172.21.15.88:0/503150749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d50069e90 0x7f2d5006d010 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0097c0 tx=0x7f2d4c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e20436257cf9496 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:03.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.301+0000 7f2d54cd8640 1 -- 172.21.15.88:0/503150749 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0ab650 con 0x7f2d50069e90 2023-11-20T07:02:03.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.301+0000 7f2d54cd8640 1 -- 172.21.15.88:0/503150749 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0ab7b0 con 0x7f2d50069e90 2023-11-20T07:02:03.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.301+0000 7f2d54cd8640 1 -- 172.21.15.88:0/503150749 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0abb40 con 0x7f2d50069e90 2023-11-20T07:02:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.301+0000 7f2d57f3e640 1 -- 172.21.15.88:0/503150749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d50069e90 msgr2=0x7f2d5006d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.301+0000 7f2d57f3e640 1 --2- 172.21.15.88:0/503150749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d50069e90 0x7f2d5006d010 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0097c0 tx=0x7f2d4c01c450 comp rx=0 tx=0).stop 2023-11-20T07:02:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.301+0000 7f2d57f3e640 1 -- 172.21.15.88:0/503150749 shutdown_connections 2023-11-20T07:02:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.301+0000 7f2d57f3e640 1 --2- 172.21.15.88:0/503150749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006a270 0x7f2d500c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.301+0000 7f2d57f3e640 1 --2- 172.21.15.88:0/503150749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d50069e90 0x7f2d5006d010 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.301+0000 7f2d57f3e640 1 -- 172.21.15.88:0/503150749 >> 172.21.15.88:0/503150749 conn(0x7f2d500b0da0 msgr2=0x7f2d500ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.301+0000 7f2d57f3e640 1 -- 172.21.15.88:0/503150749 shutdown_connections 2023-11-20T07:02:03.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.301+0000 7f2d57f3e640 1 -- 172.21.15.88:0/503150749 wait complete. 2023-11-20T07:02:03.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d57f3e640 1 Processor -- start 2023-11-20T07:02:03.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d57f3e640 1 -- start start 2023-11-20T07:02:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d57f3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d50069e90 0x7f2d50152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d57f3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d5006a270 0x7f2d501588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d57f3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d500702f0 0x7f2d50153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d57f3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5015c810 con 0x7f2d50069e90 2023-11-20T07:02:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d57f3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d50157c80 con 0x7f2d5006a270 2023-11-20T07:02:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d57f3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5015c1c0 con 0x7f2d500702f0 2023-11-20T07:02:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d55cda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d50069e90 0x7f2d50152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d55cda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d50069e90 0x7f2d50152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49508/0 (socket says 172.21.15.88:49508) 2023-11-20T07:02:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d55cda640 1 -- 172.21.15.88:0/3219418903 learned_addr learned my addr 172.21.15.88:0/3219418903 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:03.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d564db640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d500702f0 0x7f2d50153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:03.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d554d9640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d5006a270 0x7f2d501588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d55cda640 1 -- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d500702f0 msgr2=0x7f2d50153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d55cda640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d500702f0 0x7f2d50153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d55cda640 1 -- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d5006a270 msgr2=0x7f2d501588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d55cda640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d5006a270 0x7f2d501588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d55cda640 1 -- 172.21.15.88:0/3219418903 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c009420 con 0x7f2d50069e90 2023-11-20T07:02:03.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d564db640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d500702f0 0x7f2d50153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d554d9640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d5006a270 0x7f2d501588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d55cda640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d50069e90 0x7f2d50152bc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c01a080 tx=0x7f2d4c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d467fc640 1 -- 172.21.15.88:0/3219418903 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0b5810 con 0x7f2d50069e90 2023-11-20T07:02:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d467fc640 1 -- 172.21.15.88:0/3219418903 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4c0b5990 con 0x7f2d50069e90 2023-11-20T07:02:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d467fc640 1 -- 172.21.15.88:0/3219418903 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0b5d40 con 0x7f2d50069e90 2023-11-20T07:02:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d57f3e640 1 -- 172.21.15.88:0/3219418903 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5015c4a0 con 0x7f2d50069e90 2023-11-20T07:02:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d57f3e640 1 -- 172.21.15.88:0/3219418903 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d50157470 con 0x7f2d50069e90 2023-11-20T07:02:03.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.305+0000 7f2d57f3e640 1 -- 172.21.15.88:0/3219418903 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5015c300 con 0x7f2d50069e90 2023-11-20T07:02:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.309+0000 7f2d467fc640 1 -- 172.21.15.88:0/3219418903 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2d4c0b4390 con 0x7f2d50069e90 2023-11-20T07:02:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.309+0000 7f2d467fc640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2d340664a0 0x7f2d34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.309+0000 7f2d467fc640 1 -- 172.21.15.88:0/3219418903 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2d4c11edf0 con 0x7f2d50069e90 2023-11-20T07:02:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.309+0000 7f2d554d9640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2d340664a0 0x7f2d34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:03.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.309+0000 7f2d554d9640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2d340664a0 0x7f2d34068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2d500c4a20 tx=0x7f2d40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:03.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.313+0000 7f2d467fc640 1 -- 172.21.15.88:0/3219418903 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d5015c300 con 0x7f2d50069e90 2023-11-20T07:02:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 -- 172.21.15.88:0/3219418903 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2d5015c300 con 0x7f2d50069e90 2023-11-20T07:02:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d467fc640 1 -- 172.21.15.88:0/3219418903 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2d5015c300 con 0x7f2d50069e90 2023-11-20T07:02:03.462 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:02:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 -- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2d340664a0 msgr2=0x7f2d34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2d340664a0 0x7f2d34068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2d500c4a20 tx=0x7f2d40008040 comp rx=0 tx=0).stop 2023-11-20T07:02:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 -- 172.21.15.88:0/3219418903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d50069e90 msgr2=0x7f2d50152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d50069e90 0x7f2d50152bc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c01a080 tx=0x7f2d4c01ac90 comp rx=0 tx=0).stop 2023-11-20T07:02:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 -- 172.21.15.88:0/3219418903 shutdown_connections 2023-11-20T07:02:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2d340664a0 0x7f2d34068960 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d500702f0 0x7f2d50153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d5006a270 0x7f2d501588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 --2- 172.21.15.88:0/3219418903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2d50069e90 0x7f2d50152bc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 -- 172.21.15.88:0/3219418903 >> 172.21.15.88:0/3219418903 conn(0x7f2d500b0da0 msgr2=0x7f2d500ac6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 -- 172.21.15.88:0/3219418903 shutdown_connections 2023-11-20T07:02:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.461+0000 7f2d57f3e640 1 -- 172.21.15.88:0/3219418903 wait complete. 2023-11-20T07:02:03.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T07:02:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.621+0000 7fa8ea6d6640 1 Processor -- start 2023-11-20T07:02:03.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.621+0000 7fa8ea6d6640 1 -- start start 2023-11-20T07:02:03.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.621+0000 7fa8ea6d6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8e415cb90 0x7fa8e40cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:03.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.621+0000 7fa8ea6d6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa8e40d3010 0x7fa8e40d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:03.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.621+0000 7fa8ea6d6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e40d1850 con 0x7fa8e40d1400 2023-11-20T07:02:03.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.621+0000 7fa8ea6d6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e40ce770 con 0x7fa8e415cb90 2023-11-20T07:02:03.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.621+0000 7fa8ea6d6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e40d0600 con 0x7fa8e40d3010 2023-11-20T07:02:03.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.621+0000 7fa8e3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8e415cb90 0x7fa8e40cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:03.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.621+0000 7fa8e3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8e415cb90 0x7fa8e40cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49520/0 (socket says 172.21.15.88:49520) 2023-11-20T07:02:03.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.621+0000 7fa8e3fff640 1 -- 172.21.15.88:0/2157132195 learned_addr learned my addr 172.21.15.88:0/2157132195 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:03.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8e37fe640 1 --2- 172.21.15.88:0/2157132195 >> v2:172.21.15.175:3300/0 conn(0x7fa8e40d3010 0x7fa8e40d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:03.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8e3fff640 1 -- 172.21.15.88:0/2157132195 >> v2:172.21.15.175:3300/0 conn(0x7fa8e40d3010 msgr2=0x7fa8e40d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:03.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8e3fff640 1 --2- 172.21.15.88:0/2157132195 >> v2:172.21.15.175:3300/0 conn(0x7fa8e40d3010 0x7fa8e40d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8e3fff640 1 -- 172.21.15.88:0/2157132195 >> v1:172.21.15.175:6789/0 conn(0x7fa8e40d1400 legacy=0x7fa8e40cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:03.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8e3fff640 1 -- 172.21.15.88:0/2157132195 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e40c6450 con 0x7fa8e415cb90 2023-11-20T07:02:03.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8e37fe640 1 --2- 172.21.15.88:0/2157132195 >> v2:172.21.15.175:3300/0 conn(0x7fa8e40d3010 0x7fa8e40d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:03.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8e3fff640 1 --2- 172.21.15.88:0/2157132195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e415cb90 0x7fa8e40cfb10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa8e408a880 tx=0x7fa8d401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde204338b7fa997 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:03.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8e2ffd640 1 -- 172.21.15.88:0/2157132195 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40ab600 con 0x7fa8e415cb90 2023-11-20T07:02:03.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8e2ffd640 1 -- 172.21.15.88:0/2157132195 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d40ab760 con 0x7fa8e415cb90 2023-11-20T07:02:03.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8e2ffd640 1 -- 172.21.15.88:0/2157132195 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40abaf0 con 0x7fa8e415cb90 2023-11-20T07:02:03.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/2157132195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e415cb90 msgr2=0x7fa8e40cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8ea6d6640 1 --2- 172.21.15.88:0/2157132195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e415cb90 0x7fa8e40cfb10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa8e408a880 tx=0x7fa8d401c400 comp rx=0 tx=0).stop 2023-11-20T07:02:03.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/2157132195 shutdown_connections 2023-11-20T07:02:03.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8ea6d6640 1 --2- 172.21.15.88:0/2157132195 >> v2:172.21.15.175:3300/0 conn(0x7fa8e40d3010 0x7fa8e40d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8ea6d6640 1 --2- 172.21.15.88:0/2157132195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e415cb90 0x7fa8e40cfb10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.625+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/2157132195 >> 172.21.15.88:0/2157132195 conn(0x7fa8e409bc50 msgr2=0x7fa8e40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:03.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/2157132195 shutdown_connections 2023-11-20T07:02:03.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/2157132195 wait complete. 2023-11-20T07:02:03.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8ea6d6640 1 Processor -- start 2023-11-20T07:02:03.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8ea6d6640 1 -- start start 2023-11-20T07:02:03.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8ea6d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8e40d1400 0x7fa8e41537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:03.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8ea6d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e40d3010 0x7fa8e4153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:03.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8ea6d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8e415cb90 0x7fa8e415a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:03.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8ea6d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e41668c0 con 0x7fa8e40d3010 2023-11-20T07:02:03.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8ea6d6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e4166ba0 con 0x7fa8e40d1400 2023-11-20T07:02:03.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8ea6d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e4166e80 con 0x7fa8e415cb90 2023-11-20T07:02:03.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e40d3010 0x7fa8e4153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:03.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e40d3010 0x7fa8e4153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49534/0 (socket says 172.21.15.88:49534) 2023-11-20T07:02:03.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e37fe640 1 -- 172.21.15.88:0/3573844485 learned_addr learned my addr 172.21.15.88:0/3573844485 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:03.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e3fff640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8e40d1400 0x7fa8e41537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:03.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e8c73640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8e415cb90 0x7fa8e415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:03.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e37fe640 1 -- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8e415cb90 msgr2=0x7fa8e415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e37fe640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8e415cb90 0x7fa8e415a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e37fe640 1 -- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8e40d1400 msgr2=0x7fa8e41537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e37fe640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8e40d1400 0x7fa8e41537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e37fe640 1 -- 172.21.15.88:0/3573844485 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4009480 con 0x7fa8e40d3010 2023-11-20T07:02:03.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e8c73640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8e415cb90 0x7fa8e415a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:03.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e37fe640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e40d3010 0x7fa8e4153d30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800c7f0 tx=0x7fa8d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:03.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.629+0000 7fa8e0ff9640 1 -- 172.21.15.88:0/3573844485 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8007820 con 0x7fa8e40d3010 2023-11-20T07:02:03.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.633+0000 7fa8e0ff9640 1 -- 172.21.15.88:0/3573844485 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d8007980 con 0x7fa8e40d3010 2023-11-20T07:02:03.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.633+0000 7fa8e0ff9640 1 -- 172.21.15.88:0/3573844485 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8007d30 con 0x7fa8e40d3010 2023-11-20T07:02:03.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.633+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/3573844485 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e40b57c0 con 0x7fa8e40d3010 2023-11-20T07:02:03.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.633+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/3573844485 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e40ca170 con 0x7fa8e40d3010 2023-11-20T07:02:03.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.633+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/3573844485 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e40b5620 con 0x7fa8e40d3010 2023-11-20T07:02:03.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.633+0000 7fa8e0ff9640 1 -- 172.21.15.88:0/3573844485 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa8d80113f0 con 0x7fa8e40d3010 2023-11-20T07:02:03.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.633+0000 7fa8e0ff9640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8d00664a0 0x7fa8d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:03.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.633+0000 7fa8e0ff9640 1 -- 172.21.15.88:0/3573844485 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa8d8084570 con 0x7fa8e40d3010 2023-11-20T07:02:03.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.633+0000 7fa8e3fff640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8d00664a0 0x7fa8d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:03.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.637+0000 7fa8e3fff640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8d00664a0 0x7fa8d0068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40af000 tx=0x7fa8d40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:03.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.637+0000 7fa8e0ff9640 1 -- 172.21.15.88:0/3573844485 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8e40b5620 con 0x7fa8e40d3010 2023-11-20T07:02:03.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.801+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/3573844485 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa8e40b5620 con 0x7fa8e40d3010 2023-11-20T07:02:03.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.801+0000 7fa8e0ff9640 1 -- 172.21.15.88:0/3573844485 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa8e40b5620 con 0x7fa8e40d3010 2023-11-20T07:02:03.803 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-20T07:02:03.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.801+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8d00664a0 msgr2=0x7fa8d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.801+0000 7fa8ea6d6640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8d00664a0 0x7fa8d0068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40af000 tx=0x7fa8d40a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:03.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.801+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/3573844485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e40d3010 msgr2=0x7fa8e4153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:03.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.801+0000 7fa8ea6d6640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e40d3010 0x7fa8e4153d30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800c7f0 tx=0x7fa8d800ccb0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.805+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/3573844485 shutdown_connections 2023-11-20T07:02:03.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.805+0000 7fa8ea6d6640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa8d00664a0 0x7fa8d0068960 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.805+0000 7fa8ea6d6640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8e415cb90 0x7fa8e415a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.805+0000 7fa8ea6d6640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8e40d3010 0x7fa8e4153d30 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.805+0000 7fa8ea6d6640 1 --2- 172.21.15.88:0/3573844485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8e40d1400 0x7fa8e41537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:03.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.805+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/3573844485 >> 172.21.15.88:0/3573844485 conn(0x7fa8e409bc50 msgr2=0x7fa8e406bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:03.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.805+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/3573844485 shutdown_connections 2023-11-20T07:02:03.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:03.805+0000 7fa8ea6d6640 1 -- 172.21.15.88:0/3573844485 wait complete. 2023-11-20T07:02:03.823 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2023-11-20T07:02:03.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:03.823 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-20T07:02:03.847 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:02:03.848 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:02:03.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:03.848 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-20T07:02:03.904 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-20T07:02:03.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:02:04.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.037+0000 7f449de79640 1 Processor -- start 2023-11-20T07:02:04.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f449de79640 1 -- start start 2023-11-20T07:02:04.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f449de79640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f44980b07f0 0x7f449815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f449de79640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449815be60 con 0x7f4498070c40 2023-11-20T07:02:04.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f449de79640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449815c1f0 con 0x7f449815d690 2023-11-20T07:02:04.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f449de79640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449815b3b0 con 0x7f44980b07f0 2023-11-20T07:02:04.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44977fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4498070c40 0x7f44980b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51212/0 (socket says 172.21.15.88:51212) 2023-11-20T07:02:04.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44977fe640 1 -- 172.21.15.88:0/1083379955 learned_addr learned my addr 172.21.15.88:0/1083379955 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:04.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f4496ffd640 1 --2- 172.21.15.88:0/1083379955 >> v2:172.21.15.175:3300/0 conn(0x7f44980b07f0 0x7f449815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600120890 0 0) 0x7f449815be60 con 0x7f4498070c40 2023-11-20T07:02:04.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4480003530 con 0x7f4498070c40 2023-11-20T07:02:04.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1453855078 0 0) 0x7f4480003530 con 0x7f4498070c40 2023-11-20T07:02:04.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 >> v2:172.21.15.175:3300/0 conn(0x7f44980b07f0 msgr2=0x7f449815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:04.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 --2- 172.21.15.88:0/1083379955 >> v2:172.21.15.175:3300/0 conn(0x7f44980b07f0 0x7f449815ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 >> v1:172.21.15.175:6789/0 conn(0x7f449815d690 legacy=0x7f4498164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4498071020 con 0x7f4498070c40 2023-11-20T07:02:04.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f4488001680 con 0x7f4498070c40 2023-11-20T07:02:04.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 >> v1:172.21.15.88:6789/0 conn(0x7f4498070c40 legacy=0x7f44980b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 --2- 172.21.15.88:0/1083379955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4480003980 0x7f4480003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 --2- 172.21.15.88:0/1083379955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 0x7f4480004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 --2- 172.21.15.88:0/1083379955 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4480005190 0x7f448000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449815b3b0 con 0x7f44800047d0 2023-11-20T07:02:04.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448000c130 con 0x7f4480003980 2023-11-20T07:02:04.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448000c2f0 con 0x7f4480005190 2023-11-20T07:02:04.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f4496ffd640 1 --2- 172.21.15.88:0/1083379955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 0x7f4480004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f44977fe640 1 --2- 172.21.15.88:0/1083379955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4480003980 0x7f4480003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f4497fff640 1 --2- 172.21.15.88:0/1083379955 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4480005190 0x7f448000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f4496ffd640 1 -- 172.21.15.88:0/1083379955 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4480005190 msgr2=0x7f448000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:04.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f4496ffd640 1 --2- 172.21.15.88:0/1083379955 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4480005190 0x7f448000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f4496ffd640 1 -- 172.21.15.88:0/1083379955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4480003980 msgr2=0x7f4480003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:04.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f4496ffd640 1 --2- 172.21.15.88:0/1083379955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4480003980 0x7f4480003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f4496ffd640 1 -- 172.21.15.88:0/1083379955 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4480003530 con 0x7f44800047d0 2023-11-20T07:02:04.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.041+0000 7f4497fff640 1 -- 172.21.15.88:0/1083379955 reap_dead start 2023-11-20T07:02:04.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.045+0000 7f4496ffd640 1 --2- 172.21.15.88:0/1083379955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 0x7f4480004c50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f448c009ae0 tx=0x7f448c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c73985d6062425d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:04.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.045+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c0a5510 con 0x7f44800047d0 2023-11-20T07:02:04.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.045+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c0a5670 con 0x7f44800047d0 2023-11-20T07:02:04.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.045+0000 7f44967fc640 1 -- 172.21.15.88:0/1083379955 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c0a5a20 con 0x7f44800047d0 2023-11-20T07:02:04.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.045+0000 7f449de79640 1 -- 172.21.15.88:0/1083379955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 msgr2=0x7f4480004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.045+0000 7f449de79640 1 --2- 172.21.15.88:0/1083379955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 0x7f4480004c50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f448c009ae0 tx=0x7f448c01ca30 comp rx=0 tx=0).stop 2023-11-20T07:02:04.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.045+0000 7f449de79640 1 -- 172.21.15.88:0/1083379955 shutdown_connections 2023-11-20T07:02:04.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.045+0000 7f449de79640 1 --2- 172.21.15.88:0/1083379955 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 0x7f4480004c50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.045+0000 7f449de79640 1 -- 172.21.15.88:0/1083379955 >> 172.21.15.88:0/1083379955 conn(0x7f449806c190 msgr2=0x7f449806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:04.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.045+0000 7f449de79640 1 -- 172.21.15.88:0/1083379955 shutdown_connections 2023-11-20T07:02:04.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.045+0000 7f449de79640 1 -- 172.21.15.88:0/1083379955 wait complete. 2023-11-20T07:02:04.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f449de79640 1 Processor -- start 2023-11-20T07:02:04.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f449de79640 1 -- start start 2023-11-20T07:02:04.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f449de79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 0x7f44980b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f449de79640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4498148690 0x7f4498148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f449de79640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44980a8fb0 0x7f44980a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f449de79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4498149050 con 0x7f44800047d0 2023-11-20T07:02:04.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f449de79640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44980a9970 con 0x7f44980a8fb0 2023-11-20T07:02:04.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f449de79640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44980a7600 con 0x7f4498148690 2023-11-20T07:02:04.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f44977fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 0x7f44980b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f44977fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 0x7f44980b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49552/0 (socket says 172.21.15.88:49552) 2023-11-20T07:02:04.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f44977fe640 1 -- 172.21.15.88:0/2491731659 learned_addr learned my addr 172.21.15.88:0/2491731659 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:04.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f4497fff640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44980a8fb0 0x7f44980a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f4496ffd640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4498148690 0x7f4498148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f44977fe640 1 -- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4498148690 msgr2=0x7f4498148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f44977fe640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4498148690 0x7f4498148b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f44977fe640 1 -- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44980a8fb0 msgr2=0x7f44980a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f44977fe640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44980a8fb0 0x7f44980a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f44977fe640 1 -- 172.21.15.88:0/2491731659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44980a78e0 con 0x7f44800047d0 2023-11-20T07:02:04.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f44977fe640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 0x7f44980b1c70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f44880072c0 tx=0x7f4488007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:04.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f447ffff640 1 -- 172.21.15.88:0/2491731659 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448800f940 con 0x7f44800047d0 2023-11-20T07:02:04.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f447ffff640 1 -- 172.21.15.88:0/2491731659 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448800faa0 con 0x7f44800047d0 2023-11-20T07:02:04.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f449de79640 1 -- 172.21.15.88:0/2491731659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44980a7bc0 con 0x7f44800047d0 2023-11-20T07:02:04.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f447ffff640 1 -- 172.21.15.88:0/2491731659 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448800fe50 con 0x7f44800047d0 2023-11-20T07:02:04.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.049+0000 7f449de79640 1 -- 172.21.15.88:0/2491731659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44980a8180 con 0x7f44800047d0 2023-11-20T07:02:04.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.053+0000 7f449de79640 1 -- 172.21.15.88:0/2491731659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44980a83a0 con 0x7f44800047d0 2023-11-20T07:02:04.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.053+0000 7f447ffff640 1 -- 172.21.15.88:0/2491731659 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f448801d460 con 0x7f44800047d0 2023-11-20T07:02:04.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.053+0000 7f447ffff640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f44840664a0 0x7f4484068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.053+0000 7f447ffff640 1 -- 172.21.15.88:0/2491731659 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44880842d0 con 0x7f44800047d0 2023-11-20T07:02:04.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.053+0000 7f4496ffd640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f44840664a0 0x7f4484068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.053+0000 7f4496ffd640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f44840664a0 0x7f4484068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f448c0af000 tx=0x7f448c0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:04.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.057+0000 7f447ffff640 1 -- 172.21.15.88:0/2491731659 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4488051500 con 0x7f44800047d0 2023-11-20T07:02:04.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.237+0000 7f449de79640 1 -- 172.21.15.88:0/2491731659 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4498074010 con 0x7f44800047d0 2023-11-20T07:02:04.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.237+0000 7f447ffff640 1 -- 172.21.15.88:0/2491731659 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f4488054b20 con 0x7f44800047d0 2023-11-20T07:02:04.240 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:04.241 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/1097293366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1097293366},{"type":"v1","addr":"172.21.15.175:6836","nonce":1097293366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/438678526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":438678526},{"type":"v1","addr":"172.21.15.88:6834","nonce":438678526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1083863684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":1083863684},{"type":"v1","addr":"172.21.15.88:6835","nonce":1083863684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:00:54.012155+0000","modified":"2023-11-20T07:01:16.901950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3413113678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3413113678},{"type":"v1","addr":"172.21.15.175:6837","nonce":3413113678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T07:02:04.241 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-11-20T07:02:04.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.241+0000 7f449de79640 1 -- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f44840664a0 msgr2=0x7f4484068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.241+0000 7f449de79640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f44840664a0 0x7f4484068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f448c0af000 tx=0x7f448c0046d0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.241+0000 7f449de79640 1 -- 172.21.15.88:0/2491731659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 msgr2=0x7f44980b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.241+0000 7f449de79640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 0x7f44980b1c70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f44880072c0 tx=0x7f4488007780 comp rx=0 tx=0).stop 2023-11-20T07:02:04.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.241+0000 7f449de79640 1 -- 172.21.15.88:0/2491731659 shutdown_connections 2023-11-20T07:02:04.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.241+0000 7f449de79640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f44840664a0 0x7f4484068960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.241+0000 7f449de79640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4498148690 0x7f4498148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.241+0000 7f449de79640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44980a8fb0 0x7f44980a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.241+0000 7f449de79640 1 --2- 172.21.15.88:0/2491731659 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44800047d0 0x7f44980b1c70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.241+0000 7f449de79640 1 -- 172.21.15.88:0/2491731659 >> 172.21.15.88:0/2491731659 conn(0x7f449806c190 msgr2=0x7f44980c42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:04.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.241+0000 7f449de79640 1 -- 172.21.15.88:0/2491731659 shutdown_connections 2023-11-20T07:02:04.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.241+0000 7f449de79640 1 -- 172.21.15.88:0/2491731659 wait complete. 2023-11-20T07:02:04.261 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.397+0000 7f744413e640 1 Processor -- start 2023-11-20T07:02:04.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.397+0000 7f744413e640 1 -- start start 2023-11-20T07:02:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.397+0000 7f744413e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f743c15a800 0x7f743c0cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.397+0000 7f744413e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f743c0b21c0 0x7f743c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.397+0000 7f744413e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f743c06fda0 0x7f743c070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.397+0000 7f744413e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c0c7110 con 0x7f743c15a800 2023-11-20T07:02:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.397+0000 7f744413e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c0b2b40 con 0x7f743c06fda0 2023-11-20T07:02:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.397+0000 7f744413e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0cf820 con 0x7f743c0b21c0 2023-11-20T07:02:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f7441eda640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f743c15a800 0x7f743c0cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f7441eda640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f743c15a800 0x7f743c0cfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49558/0 (socket says 172.21.15.88:49558) 2023-11-20T07:02:04.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f7441eda640 1 -- 172.21.15.88:0/1454458018 learned_addr learned my addr 172.21.15.88:0/1454458018 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:04.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f74426db640 1 --2- 172.21.15.88:0/1454458018 >> v2:172.21.15.175:3300/0 conn(0x7f743c06fda0 0x7f743c070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f74416d9640 1 --2- 172.21.15.88:0/1454458018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f743c0b21c0 0x7f743c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f7441eda640 1 -- 172.21.15.88:0/1454458018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f743c0b21c0 msgr2=0x7f743c0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:04.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f7441eda640 1 --2- 172.21.15.88:0/1454458018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f743c0b21c0 0x7f743c0b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f7441eda640 1 -- 172.21.15.88:0/1454458018 >> v2:172.21.15.175:3300/0 conn(0x7f743c06fda0 msgr2=0x7f743c070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:04.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f7441eda640 1 --2- 172.21.15.88:0/1454458018 >> v2:172.21.15.175:3300/0 conn(0x7f743c06fda0 0x7f743c070230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f7441eda640 1 -- 172.21.15.88:0/1454458018 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0ce780 con 0x7f743c15a800 2023-11-20T07:02:04.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f7441eda640 1 --2- 172.21.15.88:0/1454458018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c15a800 0x7f743c0cfdb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f743c0726c0 tx=0x7f743801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798867c66e8a57c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:04.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f7440ed8640 1 -- 172.21.15.88:0/1454458018 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74380aa5f0 con 0x7f743c15a800 2023-11-20T07:02:04.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f7440ed8640 1 -- 172.21.15.88:0/1454458018 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74380aa750 con 0x7f743c15a800 2023-11-20T07:02:04.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.401+0000 7f7440ed8640 1 -- 172.21.15.88:0/1454458018 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74380aaae0 con 0x7f743c15a800 2023-11-20T07:02:04.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 -- 172.21.15.88:0/1454458018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c15a800 msgr2=0x7f743c0cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 --2- 172.21.15.88:0/1454458018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c15a800 0x7f743c0cfdb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f743c0726c0 tx=0x7f743801c4d0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 -- 172.21.15.88:0/1454458018 shutdown_connections 2023-11-20T07:02:04.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 --2- 172.21.15.88:0/1454458018 >> v2:172.21.15.175:3300/0 conn(0x7f743c06fda0 0x7f743c070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 --2- 172.21.15.88:0/1454458018 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f743c0b21c0 0x7f743c0b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 --2- 172.21.15.88:0/1454458018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c15a800 0x7f743c0cfdb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 -- 172.21.15.88:0/1454458018 >> 172.21.15.88:0/1454458018 conn(0x7f743c0cd1c0 msgr2=0x7f743c0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:04.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 -- 172.21.15.88:0/1454458018 shutdown_connections 2023-11-20T07:02:04.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 -- 172.21.15.88:0/1454458018 wait complete. 2023-11-20T07:02:04.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 Processor -- start 2023-11-20T07:02:04.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 -- start start 2023-11-20T07:02:04.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f743c06fda0 0x7f743c154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f743c0b21c0 0x7f743c0c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c15a800 0x7f743c151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c154b50 con 0x7f743c15a800 2023-11-20T07:02:04.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c154940 con 0x7f743c0b21c0 2023-11-20T07:02:04.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f744413e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0c7d50 con 0x7f743c06fda0 2023-11-20T07:02:04.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f74426db640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c15a800 0x7f743c151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f74426db640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c15a800 0x7f743c151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49572/0 (socket says 172.21.15.88:49572) 2023-11-20T07:02:04.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f74426db640 1 -- 172.21.15.88:0/4291490296 learned_addr learned my addr 172.21.15.88:0/4291490296 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:04.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f7441eda640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f743c06fda0 0x7f743c154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f74416d9640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f743c0b21c0 0x7f743c0c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f74426db640 1 -- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f743c06fda0 msgr2=0x7f743c154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f74426db640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f743c06fda0 0x7f743c154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f74426db640 1 -- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f743c0b21c0 msgr2=0x7f743c0c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f74426db640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f743c0b21c0 0x7f743c0c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f74426db640 1 -- 172.21.15.88:0/4291490296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380094d0 con 0x7f743c15a800 2023-11-20T07:02:04.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f7441eda640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f743c06fda0 0x7f743c154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:04.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.405+0000 7f74416d9640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f743c0b21c0 0x7f743c0c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:04.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.409+0000 7f74426db640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c15a800 0x7f743c151750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7434007e60 tx=0x7f743400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:04.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.409+0000 7f74327fc640 1 -- 172.21.15.88:0/4291490296 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434014420 con 0x7f743c15a800 2023-11-20T07:02:04.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.409+0000 7f74327fc640 1 -- 172.21.15.88:0/4291490296 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74340145a0 con 0x7f743c15a800 2023-11-20T07:02:04.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.409+0000 7f74327fc640 1 -- 172.21.15.88:0/4291490296 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7434014950 con 0x7f743c15a800 2023-11-20T07:02:04.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.409+0000 7f744413e640 1 -- 172.21.15.88:0/4291490296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c153310 con 0x7f743c15a800 2023-11-20T07:02:04.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.409+0000 7f744413e640 1 -- 172.21.15.88:0/4291490296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c152fa0 con 0x7f743c15a800 2023-11-20T07:02:04.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.409+0000 7f744413e640 1 -- 172.21.15.88:0/4291490296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c1534a0 con 0x7f743c15a800 2023-11-20T07:02:04.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.409+0000 7f74327fc640 1 -- 172.21.15.88:0/4291490296 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7434014ab0 con 0x7f743c15a800 2023-11-20T07:02:04.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.409+0000 7f74327fc640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f74200664a0 0x7f7420068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.409+0000 7f74327fc640 1 -- 172.21.15.88:0/4291490296 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7434084b30 con 0x7f743c15a800 2023-11-20T07:02:04.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.409+0000 7f7441eda640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f74200664a0 0x7f7420068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.413+0000 7f7441eda640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f74200664a0 0x7f7420068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f74380ae000 tx=0x7f74380a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:04.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.413+0000 7f74327fc640 1 -- 172.21.15.88:0/4291490296 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7434051bd0 con 0x7f743c15a800 2023-11-20T07:02:04.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 -- 172.21.15.88:0/4291490296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f743c074010 con 0x7f743c15a800 2023-11-20T07:02:04.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f74327fc640 1 -- 172.21.15.88:0/4291490296 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f74340551f0 con 0x7f743c15a800 2023-11-20T07:02:04.566 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:04.566 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:04.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 -- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f74200664a0 msgr2=0x7f7420068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f74200664a0 0x7f7420068960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f74380ae000 tx=0x7f74380a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:04.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 -- 172.21.15.88:0/4291490296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c15a800 msgr2=0x7f743c151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c15a800 0x7f743c151750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7434007e60 tx=0x7f743400e4b0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 -- 172.21.15.88:0/4291490296 shutdown_connections 2023-11-20T07:02:04.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f74200664a0 0x7f7420068960 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743c15a800 0x7f743c151750 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f743c0b21c0 0x7f743c0c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 --2- 172.21.15.88:0/4291490296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f743c06fda0 0x7f743c154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 -- 172.21.15.88:0/4291490296 >> 172.21.15.88:0/4291490296 conn(0x7f743c0cd1c0 msgr2=0x7f743c158210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:04.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 -- 172.21.15.88:0/4291490296 shutdown_connections 2023-11-20T07:02:04.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.565+0000 7f744413e640 1 -- 172.21.15.88:0/4291490296 wait complete. 2023-11-20T07:02:04.588 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:00:51.948011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:00:53.002743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-11-20T07:00:56.338705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-11-20T07:02:04.588 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:02:04.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f59b5640 1 Processor -- start 2023-11-20T07:02:04.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f59b5640 1 -- start start 2023-11-20T07:02:04.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f59b5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72f00cf210 0x7f72f00cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f59b5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f72f015cdc0 0x7f72f00b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f59b5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f00cfb30 con 0x7f72f00d3320 2023-11-20T07:02:04.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f59b5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f00d0880 con 0x7f72f015cdc0 2023-11-20T07:02:04.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f59b5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f00b1c00 con 0x7f72f00cf210 2023-11-20T07:02:04.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f49b3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72f00cf210 0x7f72f00cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f49b3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72f00cf210 0x7f72f00cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46318/0 (socket says 172.21.15.88:46318) 2023-11-20T07:02:04.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f49b3640 1 -- 172.21.15.88:0/1726285085 learned_addr learned my addr 172.21.15.88:0/1726285085 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:04.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72e7fff640 1 --2- 172.21.15.88:0/1726285085 >> v2:172.21.15.175:3300/0 conn(0x7f72f015cdc0 0x7f72f00b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f49b3640 1 -- 172.21.15.88:0/1726285085 >> v2:172.21.15.175:3300/0 conn(0x7f72f015cdc0 msgr2=0x7f72f00b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:04.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f49b3640 1 --2- 172.21.15.88:0/1726285085 >> v2:172.21.15.175:3300/0 conn(0x7f72f015cdc0 0x7f72f00b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f49b3640 1 -- 172.21.15.88:0/1726285085 >> v1:172.21.15.175:6789/0 conn(0x7f72f00d3320 legacy=0x7f72f00b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72f49b3640 1 -- 172.21.15.88:0/1726285085 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f00b1ee0 con 0x7f72f00cf210 2023-11-20T07:02:04.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.729+0000 7f72e7fff640 1 --2- 172.21.15.88:0/1726285085 >> v2:172.21.15.175:3300/0 conn(0x7f72f015cdc0 0x7f72f00b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:04.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.733+0000 7f72f49b3640 1 --2- 172.21.15.88:0/1726285085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72f00cf210 0x7f72f00cf5f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f72ec006fd0 tx=0x7f72f00b4100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bd5b00c44dc5bda server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:04.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.733+0000 7f72e77fe640 1 -- 172.21.15.88:0/1726285085 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0aa650 con 0x7f72f00cf210 2023-11-20T07:02:04.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.733+0000 7f72e77fe640 1 -- 172.21.15.88:0/1726285085 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec0aa7b0 con 0x7f72f00cf210 2023-11-20T07:02:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.733+0000 7f72e77fe640 1 -- 172.21.15.88:0/1726285085 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0aab40 con 0x7f72f00cf210 2023-11-20T07:02:04.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.733+0000 7f72f59b5640 1 -- 172.21.15.88:0/1726285085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72f00cf210 msgr2=0x7f72f00cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.733+0000 7f72f59b5640 1 --2- 172.21.15.88:0/1726285085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72f00cf210 0x7f72f00cf5f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f72ec006fd0 tx=0x7f72f00b4100 comp rx=0 tx=0).stop 2023-11-20T07:02:04.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.733+0000 7f72f59b5640 1 -- 172.21.15.88:0/1726285085 shutdown_connections 2023-11-20T07:02:04.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.733+0000 7f72f59b5640 1 --2- 172.21.15.88:0/1726285085 >> v2:172.21.15.175:3300/0 conn(0x7f72f015cdc0 0x7f72f00b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.733+0000 7f72f59b5640 1 --2- 172.21.15.88:0/1726285085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72f00cf210 0x7f72f00cf5f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.733+0000 7f72f59b5640 1 -- 172.21.15.88:0/1726285085 >> 172.21.15.88:0/1726285085 conn(0x7f72f00d2800 msgr2=0x7f72f00d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:04.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.733+0000 7f72f59b5640 1 -- 172.21.15.88:0/1726285085 shutdown_connections 2023-11-20T07:02:04.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.733+0000 7f72f59b5640 1 -- 172.21.15.88:0/1726285085 wait complete. 2023-11-20T07:02:04.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f59b5640 1 Processor -- start 2023-11-20T07:02:04.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f59b5640 1 -- start start 2023-11-20T07:02:04.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f59b5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72f00cf210 0x7f72f0151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f59b5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72f00d3320 0x7f72f015ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f59b5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72f015cdc0 0x7f72f0150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f59b5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f01589a0 con 0x7f72f00cf210 2023-11-20T07:02:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f59b5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f015c200 con 0x7f72f00d3320 2023-11-20T07:02:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f59b5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f015c4e0 con 0x7f72f015cdc0 2023-11-20T07:02:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f49b3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72f00cf210 0x7f72f0151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f49b3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72f00cf210 0x7f72f0151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49576/0 (socket says 172.21.15.88:49576) 2023-11-20T07:02:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f49b3640 1 -- 172.21.15.88:0/587188199 learned_addr learned my addr 172.21.15.88:0/587188199 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72e7fff640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72f00d3320 0x7f72f015ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f51b4640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72f015cdc0 0x7f72f0150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f49b3640 1 -- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72f015cdc0 msgr2=0x7f72f0150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f49b3640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72f015cdc0 0x7f72f0150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f49b3640 1 -- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72f00d3320 msgr2=0x7f72f015ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f49b3640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72f00d3320 0x7f72f015ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f49b3640 1 -- 172.21.15.88:0/587188199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0009420 con 0x7f72f00cf210 2023-11-20T07:02:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f49b3640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72f00cf210 0x7f72f0151410 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f72ec01aba0 tx=0x7f72ec019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72e57fa640 1 -- 172.21.15.88:0/587188199 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0aad30 con 0x7f72f00cf210 2023-11-20T07:02:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72e57fa640 1 -- 172.21.15.88:0/587188199 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec0aae90 con 0x7f72f00cf210 2023-11-20T07:02:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f59b5640 1 -- 172.21.15.88:0/587188199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec009480 con 0x7f72f00cf210 2023-11-20T07:02:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72e57fa640 1 -- 172.21.15.88:0/587188199 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec003860 con 0x7f72f00cf210 2023-11-20T07:02:04.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.737+0000 7f72f59b5640 1 -- 172.21.15.88:0/587188199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f0158650 con 0x7f72f00cf210 2023-11-20T07:02:04.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.741+0000 7f72f59b5640 1 -- 172.21.15.88:0/587188199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f004e9c0 con 0x7f72f00cf210 2023-11-20T07:02:04.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.741+0000 7f72e57fa640 1 -- 172.21.15.88:0/587188199 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f72ec0039c0 con 0x7f72f00cf210 2023-11-20T07:02:04.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.741+0000 7f72e57fa640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f72dc066470 0x7f72dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:04.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.741+0000 7f72e57fa640 1 -- 172.21.15.88:0/587188199 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f72ec11ec00 con 0x7f72f00cf210 2023-11-20T07:02:04.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.741+0000 7f72e7fff640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f72dc066470 0x7f72dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:04.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.741+0000 7f72e7fff640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f72dc066470 0x7f72dc068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f72f015f570 tx=0x7f72e0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:04.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.745+0000 7f72e57fa640 1 -- 172.21.15.88:0/587188199 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f72ec0ebcd0 con 0x7f72f00cf210 2023-11-20T07:02:04.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.893+0000 7f72f59b5640 1 -- 172.21.15.88:0/587188199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72f015d370 con 0x7f72f00cf210 2023-11-20T07:02:04.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.893+0000 7f72e57fa640 1 -- 172.21.15.88:0/587188199 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72ec0ef2f0 con 0x7f72f00cf210 2023-11-20T07:02:04.896 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:02:04.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.897+0000 7f72f59b5640 1 -- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f72dc066470 msgr2=0x7f72dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.897+0000 7f72f59b5640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f72dc066470 0x7f72dc068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f72f015f570 tx=0x7f72e0009190 comp rx=0 tx=0).stop 2023-11-20T07:02:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.897+0000 7f72f59b5640 1 -- 172.21.15.88:0/587188199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72f00cf210 msgr2=0x7f72f0151410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.897+0000 7f72f59b5640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72f00cf210 0x7f72f0151410 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f72ec01aba0 tx=0x7f72ec019290 comp rx=0 tx=0).stop 2023-11-20T07:02:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.897+0000 7f72f59b5640 1 -- 172.21.15.88:0/587188199 shutdown_connections 2023-11-20T07:02:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.897+0000 7f72f59b5640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f72dc066470 0x7f72dc068930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.897+0000 7f72f59b5640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f72f015cdc0 0x7f72f0150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.897+0000 7f72f59b5640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72f00d3320 0x7f72f015ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.897+0000 7f72f59b5640 1 --2- 172.21.15.88:0/587188199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f72f00cf210 0x7f72f0151410 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.897+0000 7f72f59b5640 1 -- 172.21.15.88:0/587188199 >> 172.21.15.88:0/587188199 conn(0x7f72f00d2800 msgr2=0x7f72f0155d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.897+0000 7f72f59b5640 1 -- 172.21.15.88:0/587188199 shutdown_connections 2023-11-20T07:02:04.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:04.897+0000 7f72f59b5640 1 -- 172.21.15.88:0/587188199 wait complete. 2023-11-20T07:02:04.917 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:02:05.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8b5db5640 1 Processor -- start 2023-11-20T07:02:05.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8b5db5640 1 -- start start 2023-11-20T07:02:05.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8b5db5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa8b00ccce0 0x7fa8b006cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8b5db5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b0159ba0 con 0x7fa8b006dba0 2023-11-20T07:02:05.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8b5db5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b00b3220 con 0x7fa8b00ceea0 2023-11-20T07:02:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8b5db5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b00b2d30 con 0x7fa8b00ccce0 2023-11-20T07:02:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8affff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa8b006dba0 0x7fa8b00ce790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51222/0 (socket says 172.21.15.88:51222) 2023-11-20T07:02:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8affff640 1 -- 172.21.15.88:0/1015933926 learned_addr learned my addr 172.21.15.88:0/1015933926 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8b4db3640 1 --2- 172.21.15.88:0/1015933926 >> v2:172.21.15.175:3300/0 conn(0x7fa8b00ccce0 0x7fa8b006cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8af7fe640 1 -- 172.21.15.88:0/1015933926 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016088358 0 0) 0x7fa8b0159ba0 con 0x7fa8b006dba0 2023-11-20T07:02:05.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8af7fe640 1 -- 172.21.15.88:0/1015933926 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa898005740 con 0x7fa8b006dba0 2023-11-20T07:02:05.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8b4db3640 1 -- 172.21.15.88:0/1015933926 >> v1:172.21.15.175:6789/0 conn(0x7fa8b00ceea0 legacy=0x7fa8b00c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8af7fe640 1 -- 172.21.15.88:0/1015933926 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369430008 0 0) 0x7fa8b00b3220 con 0x7fa8b00ceea0 2023-11-20T07:02:05.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8b4db3640 1 -- 172.21.15.88:0/1015933926 >> v1:172.21.15.88:6789/0 conn(0x7fa8b006dba0 legacy=0x7fa8b00ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.057+0000 7fa8b4db3640 1 -- 172.21.15.88:0/1015933926 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b006c1a0 con 0x7fa8b00ccce0 2023-11-20T07:02:05.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.061+0000 7fa8b4db3640 1 --2- 172.21.15.88:0/1015933926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8b00ccce0 0x7fa8b006cc40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00097c0 tx=0x7fa8a001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d6c9e23b65292a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:05.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.061+0000 7fa8af7fe640 1 -- 172.21.15.88:0/1015933926 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00ab600 con 0x7fa8b00ccce0 2023-11-20T07:02:05.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.061+0000 7fa8af7fe640 1 -- 172.21.15.88:0/1015933926 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a00a7050 con 0x7fa8b00ccce0 2023-11-20T07:02:05.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.061+0000 7fa8af7fe640 1 -- 172.21.15.88:0/1015933926 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00ab980 con 0x7fa8b00ccce0 2023-11-20T07:02:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.061+0000 7fa8b5db5640 1 -- 172.21.15.88:0/1015933926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8b00ccce0 msgr2=0x7fa8b006cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.061+0000 7fa8b5db5640 1 --2- 172.21.15.88:0/1015933926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8b00ccce0 0x7fa8b006cc40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00097c0 tx=0x7fa8a001c3a0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.061+0000 7fa8b5db5640 1 -- 172.21.15.88:0/1015933926 shutdown_connections 2023-11-20T07:02:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.061+0000 7fa8b5db5640 1 --2- 172.21.15.88:0/1015933926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8b00ccce0 0x7fa8b006cc40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.061+0000 7fa8b5db5640 1 -- 172.21.15.88:0/1015933926 >> 172.21.15.88:0/1015933926 conn(0x7fa8b006a290 msgr2=0x7fa8b006a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.061+0000 7fa8b5db5640 1 -- 172.21.15.88:0/1015933926 shutdown_connections 2023-11-20T07:02:05.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.061+0000 7fa8b5db5640 1 -- 172.21.15.88:0/1015933926 wait complete. 2023-11-20T07:02:05.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b5db5640 1 Processor -- start 2023-11-20T07:02:05.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b5db5640 1 -- start start 2023-11-20T07:02:05.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b5db5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8b006dba0 0x7fa8b0154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b5db5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8b00ccce0 0x7fa8b015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b5db5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b00ceea0 0x7fa8b015bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b5db5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b015a8f0 con 0x7fa8b00ceea0 2023-11-20T07:02:05.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b5db5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b01541d0 con 0x7fa8b006dba0 2023-11-20T07:02:05.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b5db5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b015c790 con 0x7fa8b00ccce0 2023-11-20T07:02:05.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b55b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b00ceea0 0x7fa8b015bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b55b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b00ceea0 0x7fa8b015bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49584/0 (socket says 172.21.15.88:49584) 2023-11-20T07:02:05.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b55b4640 1 -- 172.21.15.88:0/2089253342 learned_addr learned my addr 172.21.15.88:0/2089253342 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:05.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8affff640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8b00ccce0 0x7fa8b015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b4db3640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8b006dba0 0x7fa8b0154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b55b4640 1 -- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8b00ccce0 msgr2=0x7fa8b015a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b55b4640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8b00ccce0 0x7fa8b015a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b55b4640 1 -- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8b006dba0 msgr2=0x7fa8b0154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b55b4640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8b006dba0 0x7fa8b0154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b55b4640 1 -- 172.21.15.88:0/2089253342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0009420 con 0x7fa8b00ceea0 2023-11-20T07:02:05.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b4db3640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8b006dba0 0x7fa8b0154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:05.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b55b4640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b00ceea0 0x7fa8b015bd20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800c780 tx=0x7fa8a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:05.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8ad7fa640 1 -- 172.21.15.88:0/2089253342 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8003b80 con 0x7fa8b00ceea0 2023-11-20T07:02:05.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8ad7fa640 1 -- 172.21.15.88:0/2089253342 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8003d00 con 0x7fa8b00ceea0 2023-11-20T07:02:05.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8ad7fa640 1 -- 172.21.15.88:0/2089253342 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80052b0 con 0x7fa8b00ceea0 2023-11-20T07:02:05.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b5db5640 1 -- 172.21.15.88:0/2089253342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b015ca70 con 0x7fa8b00ceea0 2023-11-20T07:02:05.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.065+0000 7fa8b5db5640 1 -- 172.21.15.88:0/2089253342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b0154770 con 0x7fa8b00ceea0 2023-11-20T07:02:05.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.069+0000 7fa8b5db5640 1 -- 172.21.15.88:0/2089253342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b004e9c0 con 0x7fa8b00ceea0 2023-11-20T07:02:05.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.069+0000 7fa8ad7fa640 1 -- 172.21.15.88:0/2089253342 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa8a8005410 con 0x7fa8b00ceea0 2023-11-20T07:02:05.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.069+0000 7fa8ad7fa640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa89c0664a0 0x7fa89c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.069+0000 7fa8ad7fa640 1 -- 172.21.15.88:0/2089253342 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa8a8083f40 con 0x7fa8b00ceea0 2023-11-20T07:02:05.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.069+0000 7fa8b4db3640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa89c0664a0 0x7fa89c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.069+0000 7fa8b4db3640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa89c0664a0 0x7fa89c068960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00ad000 tx=0x7fa8a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:05.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.073+0000 7fa8ad7fa640 1 -- 172.21.15.88:0/2089253342 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8a8050f60 con 0x7fa8b00ceea0 2023-11-20T07:02:05.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 -- 172.21.15.88:0/2089253342 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8b0073000 con 0x7fa8b00ceea0 2023-11-20T07:02:05.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8ad7fa640 1 -- 172.21.15.88:0/2089253342 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8a8054580 con 0x7fa8b00ceea0 2023-11-20T07:02:05.221 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:02:05.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 -- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa89c0664a0 msgr2=0x7fa89c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa89c0664a0 0x7fa89c068960 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00ad000 tx=0x7fa8a0008040 comp rx=0 tx=0).stop 2023-11-20T07:02:05.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 -- 172.21.15.88:0/2089253342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b00ceea0 msgr2=0x7fa8b015bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b00ceea0 0x7fa8b015bd20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800c780 tx=0x7fa8a800cc40 comp rx=0 tx=0).stop 2023-11-20T07:02:05.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 -- 172.21.15.88:0/2089253342 shutdown_connections 2023-11-20T07:02:05.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa89c0664a0 0x7fa89c068960 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8b00ccce0 0x7fa8b015a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b00ceea0 0x7fa8b015bd20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 --2- 172.21.15.88:0/2089253342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8b006dba0 0x7fa8b0154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 -- 172.21.15.88:0/2089253342 >> 172.21.15.88:0/2089253342 conn(0x7fa8b006a290 msgr2=0x7fa8b00ab7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:05.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 -- 172.21.15.88:0/2089253342 shutdown_connections 2023-11-20T07:02:05.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.221+0000 7fa8b5db5640 1 -- 172.21.15.88:0/2089253342 wait complete. 2023-11-20T07:02:05.242 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:02:05.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96b5cd6640 1 Processor -- start 2023-11-20T07:02:05.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96b5cd6640 1 -- start start 2023-11-20T07:02:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96b5cd6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96b00ceda0 0x7f96b0167be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96b5cd6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b00cc330 con 0x7f96b00cb040 2023-11-20T07:02:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96b5cd6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b00cb4d0 con 0x7f96b015cc60 2023-11-20T07:02:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96b5cd6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00cb720 con 0x7f96b00ceda0 2023-11-20T07:02:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96aeffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f96b00cb040 0x7f96b00ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51236/0 (socket says 172.21.15.88:51236) 2023-11-20T07:02:05.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96aeffd640 1 -- 172.21.15.88:0/948227132 learned_addr learned my addr 172.21.15.88:0/948227132 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:05.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96affff640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96b00ceda0 0x7f96b0167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998180709 0 0) 0x7f96b00cc330 con 0x7f96b00cb040 2023-11-20T07:02:05.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9698003530 con 0x7f96b00cb040 2023-11-20T07:02:05.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084239233 0 0) 0x7f96b00cb4d0 con 0x7f96b015cc60 2023-11-20T07:02:05.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96b00cc330 con 0x7f96b015cc60 2023-11-20T07:02:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2633900386 0 0) 0x7f9698003530 con 0x7f96b00cb040 2023-11-20T07:02:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96b00ceda0 msgr2=0x7f96b0167be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96b00ceda0 0x7f96b0167be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 >> v1:172.21.15.175:6789/0 conn(0x7f96b015cc60 legacy=0x7f96b0161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b00cba00 con 0x7f96b00cb040 2023-11-20T07:02:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f96a4001680 con 0x7f96b00cb040 2023-11-20T07:02:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 >> v1:172.21.15.88:6789/0 conn(0x7f96b00cb040 legacy=0x7f96b00ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9698003b40 0x7f9698003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96b00ceda0 0x7f96980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698004d10 0x7f9698005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00cb720 con 0x7f9698003b40 2023-11-20T07:02:05.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969800ba70 con 0x7f9698004d10 2023-11-20T07:02:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969800bc30 con 0x7f96b00ceda0 2023-11-20T07:02:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96af7fe640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9698003b40 0x7f9698003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96aeffd640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96b00ceda0 0x7f96980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.381+0000 7f96affff640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698004d10 0x7f9698005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.385+0000 7f96af7fe640 1 -- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96b00ceda0 msgr2=0x7f96980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.385+0000 7f96af7fe640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96b00ceda0 0x7f96980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.385+0000 7f96af7fe640 1 -- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698004d10 msgr2=0x7f9698005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.385+0000 7f96af7fe640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698004d10 0x7f9698005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.385+0000 7f96af7fe640 1 -- 172.21.15.88:0/948227132 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9698003530 con 0x7f9698003b40 2023-11-20T07:02:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.385+0000 7f96aeffd640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96b00ceda0 0x7f96980047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:05.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.385+0000 7f96affff640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698004d10 0x7f9698005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:05.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.385+0000 7f96af7fe640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9698003b40 0x7f9698003f40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f96a00018d0 tx=0x7f96a001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4338a9fd6dbbbb server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:05.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.385+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00052d0 con 0x7f9698003b40 2023-11-20T07:02:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.385+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a0005450 con 0x7f9698003b40 2023-11-20T07:02:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.385+0000 7f96ae7fc640 1 -- 172.21.15.88:0/948227132 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0003840 con 0x7f9698003b40 2023-11-20T07:02:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 -- 172.21.15.88:0/948227132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9698003b40 msgr2=0x7f9698003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 --2- 172.21.15.88:0/948227132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9698003b40 0x7f9698003f40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f96a00018d0 tx=0x7f96a001c530 comp rx=0 tx=0).stop 2023-11-20T07:02:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96affff640 1 -- 172.21.15.88:0/948227132 reap_dead start 2023-11-20T07:02:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 -- 172.21.15.88:0/948227132 shutdown_connections 2023-11-20T07:02:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 -- 172.21.15.88:0/948227132 >> 172.21.15.88:0/948227132 conn(0x7f96b006e570 msgr2=0x7f96b006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 -- 172.21.15.88:0/948227132 shutdown_connections 2023-11-20T07:02:05.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 -- 172.21.15.88:0/948227132 wait complete. 2023-11-20T07:02:05.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 Processor -- start 2023-11-20T07:02:05.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 -- start start 2023-11-20T07:02:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9698003b40 0x7f96b01510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96b01519a0 0x7f96b00c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96b00c8740 0x7f96b006b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00b5fd0 con 0x7f96b01519a0 2023-11-20T07:02:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b0151630 con 0x7f96b00c8740 2023-11-20T07:02:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96b5cd6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b00b5450 con 0x7f9698003b40 2023-11-20T07:02:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96aeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96b01519a0 0x7f96b00c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96aeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96b01519a0 0x7f96b00c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49606/0 (socket says 172.21.15.88:49606) 2023-11-20T07:02:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96aeffd640 1 -- 172.21.15.88:0/118756648 learned_addr learned my addr 172.21.15.88:0/118756648 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:05.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96affff640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96b00c8740 0x7f96b006b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96aeffd640 1 -- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9698003b40 msgr2=0x7f96b01510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96af7fe640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9698003b40 0x7f96b01510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96aeffd640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9698003b40 0x7f96b01510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96aeffd640 1 -- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96b00c8740 msgr2=0x7f96b006b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96aeffd640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96b00c8740 0x7f96b006b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96aeffd640 1 -- 172.21.15.88:0/118756648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b00b5730 con 0x7f96b01519a0 2023-11-20T07:02:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96affff640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96b00c8740 0x7f96b006b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.389+0000 7f96af7fe640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9698003b40 0x7f96b01510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.393+0000 7f96aeffd640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96b01519a0 0x7f96b00c8200 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f96a400e7a0 tx=0x7f96a400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.393+0000 7f9697fff640 1 -- 172.21.15.88:0/118756648 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a400eeb0 con 0x7f96b01519a0 2023-11-20T07:02:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.393+0000 7f9697fff640 1 -- 172.21.15.88:0/118756648 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a400c8d0 con 0x7f96b01519a0 2023-11-20T07:02:05.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.393+0000 7f9697fff640 1 -- 172.21.15.88:0/118756648 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a400cc40 con 0x7f96b01519a0 2023-11-20T07:02:05.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.393+0000 7f96b5cd6640 1 -- 172.21.15.88:0/118756648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b00b5a10 con 0x7f96b01519a0 2023-11-20T07:02:05.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.393+0000 7f96b5cd6640 1 -- 172.21.15.88:0/118756648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b0152510 con 0x7f96b01519a0 2023-11-20T07:02:05.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.393+0000 7f96b5cd6640 1 -- 172.21.15.88:0/118756648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b004e170 con 0x7f96b01519a0 2023-11-20T07:02:05.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.393+0000 7f9697fff640 1 -- 172.21.15.88:0/118756648 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f96a401d460 con 0x7f96b01519a0 2023-11-20T07:02:05.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.393+0000 7f9697fff640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f969c0664a0 0x7f969c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.393+0000 7f9697fff640 1 -- 172.21.15.88:0/118756648 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f96a40842a0 con 0x7f96b01519a0 2023-11-20T07:02:05.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.393+0000 7f96af7fe640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f969c0664a0 0x7f969c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.397+0000 7f96af7fe640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f969c0664a0 0x7f969c068960 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f96a00ad000 tx=0x7f96a00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:05.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.397+0000 7f9697fff640 1 -- 172.21.15.88:0/118756648 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f96a4054d50 con 0x7f96b01519a0 2023-11-20T07:02:05.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.545+0000 7f96b5cd6640 1 -- 172.21.15.88:0/118756648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96b00b6830 con 0x7f96b01519a0 2023-11-20T07:02:05.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.545+0000 7f9697fff640 1 -- 172.21.15.88:0/118756648 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96a40548e0 con 0x7f96b01519a0 2023-11-20T07:02:05.547 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:02:05.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.549+0000 7f96b5cd6640 1 -- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f969c0664a0 msgr2=0x7f969c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.549+0000 7f96b5cd6640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f969c0664a0 0x7f969c068960 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f96a00ad000 tx=0x7f96a00a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:05.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.549+0000 7f96b5cd6640 1 -- 172.21.15.88:0/118756648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96b01519a0 msgr2=0x7f96b00c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.549+0000 7f96b5cd6640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96b01519a0 0x7f96b00c8200 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f96a400e7a0 tx=0x7f96a400ec60 comp rx=0 tx=0).stop 2023-11-20T07:02:05.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.549+0000 7f96b5cd6640 1 -- 172.21.15.88:0/118756648 shutdown_connections 2023-11-20T07:02:05.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.549+0000 7f96b5cd6640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f969c0664a0 0x7f969c068960 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.549+0000 7f96b5cd6640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96b00c8740 0x7f96b006b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.549+0000 7f96b5cd6640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96b01519a0 0x7f96b00c8200 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.549+0000 7f96b5cd6640 1 --2- 172.21.15.88:0/118756648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9698003b40 0x7f96b01510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.549+0000 7f96b5cd6640 1 -- 172.21.15.88:0/118756648 >> 172.21.15.88:0/118756648 conn(0x7f96b006e570 msgr2=0x7f96b015faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:05.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.549+0000 7f96b5cd6640 1 -- 172.21.15.88:0/118756648 shutdown_connections 2023-11-20T07:02:05.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.549+0000 7f96b5cd6640 1 -- 172.21.15.88:0/118756648 wait complete. 2023-11-20T07:02:05.568 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-11-20T07:02:05.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0cafd3640 1 Processor -- start 2023-11-20T07:02:05.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0cafd3640 1 -- start start 2023-11-20T07:02:05.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0cafd3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa0c406a5a0 0x7fa0c406e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0cafd3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c40b4370 con 0x7fa0c40b3f00 2023-11-20T07:02:05.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0cafd3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c40b4600 con 0x7fa0c4159900 2023-11-20T07:02:05.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0cafd3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c40cd740 con 0x7fa0c406a5a0 2023-11-20T07:02:05.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c9570640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa0c40b3f00 0x7fa0c40c9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51240/0 (socket says 172.21.15.88:51240) 2023-11-20T07:02:05.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c9570640 1 -- 172.21.15.88:0/531578887 learned_addr learned my addr 172.21.15.88:0/531578887 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c3fff640 1 --2- 172.21.15.88:0/531578887 >> v2:172.21.15.175:3300/0 conn(0x7fa0c406a5a0 0x7fa0c406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545329835 0 0) 0x7fa0c40b4370 con 0x7fa0c40b3f00 2023-11-20T07:02:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b4003530 con 0x7fa0c40b3f00 2023-11-20T07:02:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 867720381 0 0) 0x7fa0b4003530 con 0x7fa0c40b3f00 2023-11-20T07:02:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 >> v2:172.21.15.175:3300/0 conn(0x7fa0c406a5a0 msgr2=0x7fa0c406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c37fe640 1 --2- 172.21.15.88:0/531578887 >> v2:172.21.15.175:3300/0 conn(0x7fa0c406a5a0 0x7fa0c406e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 >> v1:172.21.15.175:6789/0 conn(0x7fa0c4159900 legacy=0x7fa0c4069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c40c8dd0 con 0x7fa0c40b3f00 2023-11-20T07:02:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fa0bc001a00 con 0x7fa0c40b3f00 2023-11-20T07:02:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 >> v1:172.21.15.88:6789/0 conn(0x7fa0c40b3f00 legacy=0x7fa0c40c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c37fe640 1 --2- 172.21.15.88:0/531578887 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0b4003980 0x7fa0b4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.709+0000 7fa0c37fe640 1 --2- 172.21.15.88:0/531578887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 0x7fa0b4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c37fe640 1 --2- 172.21.15.88:0/531578887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0b4005190 0x7fa0b400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40cd740 con 0x7fa0b40047d0 2023-11-20T07:02:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b400c030 con 0x7fa0b4005190 2023-11-20T07:02:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b400c1f0 con 0x7fa0b4003980 2023-11-20T07:02:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c3fff640 1 --2- 172.21.15.88:0/531578887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 0x7fa0b4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c8d6f640 1 --2- 172.21.15.88:0/531578887 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0b4003980 0x7fa0b4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c9570640 1 --2- 172.21.15.88:0/531578887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0b4005190 0x7fa0b400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c3fff640 1 -- 172.21.15.88:0/531578887 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0b4003980 msgr2=0x7fa0b4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c3fff640 1 --2- 172.21.15.88:0/531578887 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0b4003980 0x7fa0b4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c3fff640 1 -- 172.21.15.88:0/531578887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0b4005190 msgr2=0x7fa0b400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c3fff640 1 --2- 172.21.15.88:0/531578887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0b4005190 0x7fa0b400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c3fff640 1 -- 172.21.15.88:0/531578887 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4003530 con 0x7fa0b40047d0 2023-11-20T07:02:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c9570640 1 -- 172.21.15.88:0/531578887 reap_dead start 2023-11-20T07:02:05.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c3fff640 1 --2- 172.21.15.88:0/531578887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 0x7fa0b4004c50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009670 tx=0x7fa0b001ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4000f6c0feb7f0b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:05.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b00a7770 con 0x7fa0b40047d0 2023-11-20T07:02:05.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b00a78d0 con 0x7fa0b40047d0 2023-11-20T07:02:05.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.713+0000 7fa0c37fe640 1 -- 172.21.15.88:0/531578887 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b00a7c80 con 0x7fa0b40047d0 2023-11-20T07:02:05.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 -- 172.21.15.88:0/531578887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 msgr2=0x7fa0b4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 --2- 172.21.15.88:0/531578887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 0x7fa0b4004c50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009670 tx=0x7fa0b001ec80 comp rx=0 tx=0).stop 2023-11-20T07:02:05.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 -- 172.21.15.88:0/531578887 shutdown_connections 2023-11-20T07:02:05.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 --2- 172.21.15.88:0/531578887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 0x7fa0b4004c50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 -- 172.21.15.88:0/531578887 >> 172.21.15.88:0/531578887 conn(0x7fa0c40b0da0 msgr2=0x7fa0c40ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:05.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 -- 172.21.15.88:0/531578887 shutdown_connections 2023-11-20T07:02:05.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 -- 172.21.15.88:0/531578887 wait complete. 2023-11-20T07:02:05.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 Processor -- start 2023-11-20T07:02:05.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 -- start start 2023-11-20T07:02:05.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 0x7fa0c40c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40acf70 0x7fa0c4070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0c40c8190 0x7fa0c40c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c41f53e0 con 0x7fa0b40047d0 2023-11-20T07:02:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c41f6380 con 0x7fa0c40acf70 2023-11-20T07:02:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0cafd3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c40c6a40 con 0x7fa0c40c8190 2023-11-20T07:02:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0c8d6f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 0x7fa0c40c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0c8d6f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 0x7fa0c40c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49616/0 (socket says 172.21.15.88:49616) 2023-11-20T07:02:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0c8d6f640 1 -- 172.21.15.88:0/4073824275 learned_addr learned my addr 172.21.15.88:0/4073824275 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0c3fff640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40acf70 0x7fa0c4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.717+0000 7fa0c9570640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0c40c8190 0x7fa0c40c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0c8d6f640 1 -- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0c40c8190 msgr2=0x7fa0c40c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0c8d6f640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0c40c8190 0x7fa0c40c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0c8d6f640 1 -- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40acf70 msgr2=0x7fa0c4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0c8d6f640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40acf70 0x7fa0c4070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0c8d6f640 1 -- 172.21.15.88:0/4073824275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c40c8b50 con 0x7fa0b40047d0 2023-11-20T07:02:05.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0c8d6f640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 0x7fa0c40c61f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800e580 tx=0x7fa0b800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:05.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0c17fa640 1 -- 172.21.15.88:0/4073824275 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80052e0 con 0x7fa0b40047d0 2023-11-20T07:02:05.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0c17fa640 1 -- 172.21.15.88:0/4073824275 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b8005440 con 0x7fa0b40047d0 2023-11-20T07:02:05.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0c17fa640 1 -- 172.21.15.88:0/4073824275 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8003820 con 0x7fa0b40047d0 2023-11-20T07:02:05.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0cafd3640 1 -- 172.21.15.88:0/4073824275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c415ae60 con 0x7fa0b40047d0 2023-11-20T07:02:05.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0cafd3640 1 -- 172.21.15.88:0/4073824275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c41f58a0 con 0x7fa0b40047d0 2023-11-20T07:02:05.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0cafd3640 1 -- 172.21.15.88:0/4073824275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c404e170 con 0x7fa0b40047d0 2023-11-20T07:02:05.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0c17fa640 1 -- 172.21.15.88:0/4073824275 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa0b8003980 con 0x7fa0b40047d0 2023-11-20T07:02:05.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0c17fa640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa0a80664d0 0x7fa0a8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:05.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.721+0000 7fa0c17fa640 1 -- 172.21.15.88:0/4073824275 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa0b80838c0 con 0x7fa0b40047d0 2023-11-20T07:02:05.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.725+0000 7fa0c3fff640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa0a80664d0 0x7fa0a8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:05.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.725+0000 7fa0c3fff640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa0a80664d0 0x7fa0a8068990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa0b00b1000 tx=0x7fa0b00a9040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:05.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.729+0000 7fa0c17fa640 1 -- 172.21.15.88:0/4073824275 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa0b8050a40 con 0x7fa0b40047d0 2023-11-20T07:02:05.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.877+0000 7fa0cafd3640 1 -- 172.21.15.88:0/4073824275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa0c40c8b50 con 0x7fa0b40047d0 2023-11-20T07:02:05.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.877+0000 7fa0c17fa640 1 -- 172.21.15.88:0/4073824275 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa0c40c8b50 con 0x7fa0b40047d0 2023-11-20T07:02:05.879 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:02:05.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.877+0000 7fa0cafd3640 1 -- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa0a80664d0 msgr2=0x7fa0a8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.877+0000 7fa0cafd3640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa0a80664d0 0x7fa0a8068990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa0b00b1000 tx=0x7fa0b00a9040 comp rx=0 tx=0).stop 2023-11-20T07:02:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.877+0000 7fa0cafd3640 1 -- 172.21.15.88:0/4073824275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 msgr2=0x7fa0c40c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.877+0000 7fa0cafd3640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 0x7fa0c40c61f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800e580 tx=0x7fa0b800ea40 comp rx=0 tx=0).stop 2023-11-20T07:02:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.881+0000 7fa0cafd3640 1 -- 172.21.15.88:0/4073824275 shutdown_connections 2023-11-20T07:02:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.881+0000 7fa0cafd3640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa0a80664d0 0x7fa0a8068990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.881+0000 7fa0cafd3640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0c40c8190 0x7fa0c40c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.881+0000 7fa0cafd3640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0c40acf70 0x7fa0c4070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.881+0000 7fa0cafd3640 1 --2- 172.21.15.88:0/4073824275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0b40047d0 0x7fa0c40c61f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.881+0000 7fa0cafd3640 1 -- 172.21.15.88:0/4073824275 >> 172.21.15.88:0/4073824275 conn(0x7fa0c40b0da0 msgr2=0x7fa0c4158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.881+0000 7fa0cafd3640 1 -- 172.21.15.88:0/4073824275 shutdown_connections 2023-11-20T07:02:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:05.881+0000 7fa0cafd3640 1 -- 172.21.15.88:0/4073824275 wait complete. 2023-11-20T07:02:05.900 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:02:06.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86cdc79640 1 Processor -- start 2023-11-20T07:02:06.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86cdc79640 1 -- start start 2023-11-20T07:02:06.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86cdc79640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86c815cb90 0x7f86c80cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86cdc79640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f86c80d3010 0x7f86c80d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86cdc79640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c80ce770 con 0x7f86c80d1400 2023-11-20T07:02:06.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86cdc79640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c80d1890 con 0x7f86c80d3010 2023-11-20T07:02:06.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86cdc79640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80d0600 con 0x7f86c815cb90 2023-11-20T07:02:06.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86c6ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f86c80d3010 0x7f86c80d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86c6ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f86c80d3010 0x7f86c80d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49622/0 (socket says 172.21.15.88:49622) 2023-11-20T07:02:06.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86c6ffd640 1 -- 172.21.15.88:0/2138429023 learned_addr learned my addr 172.21.15.88:0/2138429023 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:06.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86c7fff640 1 --1- 172.21.15.88:0/2138429023 >> v1:172.21.15.88:6789/0 conn(0x7f86c80d1400 0x7f86c80cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51242/0 (socket says 172.21.15.88:51242) 2023-11-20T07:02:06.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86c6ffd640 1 -- 172.21.15.88:0/2138429023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86c815cb90 msgr2=0x7f86c80cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:06.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86c6ffd640 1 --2- 172.21.15.88:0/2138429023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86c815cb90 0x7f86c80cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86c6ffd640 1 -- 172.21.15.88:0/2138429023 >> v1:172.21.15.88:6789/0 conn(0x7f86c80d1400 legacy=0x7f86c80cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.037+0000 7f86c6ffd640 1 -- 172.21.15.88:0/2138429023 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c80c6450 con 0x7f86c80d3010 2023-11-20T07:02:06.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.041+0000 7f86c6ffd640 1 --2- 172.21.15.88:0/2138429023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86c80d3010 0x7f86c80d0ec0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009870 tx=0x7f86bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725320fa15e933c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:06.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.041+0000 7f86c67fc640 1 -- 172.21.15.88:0/2138429023 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0ab680 con 0x7f86c80d3010 2023-11-20T07:02:06.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.041+0000 7f86c67fc640 1 -- 172.21.15.88:0/2138429023 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0ab7e0 con 0x7f86c80d3010 2023-11-20T07:02:06.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.041+0000 7f86c67fc640 1 -- 172.21.15.88:0/2138429023 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0abb70 con 0x7f86c80d3010 2023-11-20T07:02:06.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.041+0000 7f86cdc79640 1 -- 172.21.15.88:0/2138429023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86c80d3010 msgr2=0x7f86c80d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.041+0000 7f86cdc79640 1 --2- 172.21.15.88:0/2138429023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86c80d3010 0x7f86c80d0ec0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009870 tx=0x7f86bc01c480 comp rx=0 tx=0).stop 2023-11-20T07:02:06.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.041+0000 7f86cdc79640 1 -- 172.21.15.88:0/2138429023 shutdown_connections 2023-11-20T07:02:06.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.041+0000 7f86cdc79640 1 --2- 172.21.15.88:0/2138429023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86c80d3010 0x7f86c80d0ec0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.041+0000 7f86cdc79640 1 --2- 172.21.15.88:0/2138429023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86c815cb90 0x7f86c80cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.041+0000 7f86cdc79640 1 -- 172.21.15.88:0/2138429023 >> 172.21.15.88:0/2138429023 conn(0x7f86c809bc50 msgr2=0x7f86c80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:06.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.041+0000 7f86cdc79640 1 -- 172.21.15.88:0/2138429023 shutdown_connections 2023-11-20T07:02:06.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.041+0000 7f86cdc79640 1 -- 172.21.15.88:0/2138429023 wait complete. 2023-11-20T07:02:06.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86cdc79640 1 Processor -- start 2023-11-20T07:02:06.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86cdc79640 1 -- start start 2023-11-20T07:02:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86cdc79640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86c80d1400 0x7f86c814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86cdc79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86c80d3010 0x7f86c814bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86cdc79640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86c815cb90 0x7f86c814b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86cdc79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c815aab0 con 0x7f86c80d3010 2023-11-20T07:02:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86cdc79640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c814c2e0 con 0x7f86c80d1400 2023-11-20T07:02:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86cdc79640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c814c060 con 0x7f86c815cb90 2023-11-20T07:02:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86c6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86c80d3010 0x7f86c814bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86c6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86c80d3010 0x7f86c814bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49634/0 (socket says 172.21.15.88:49634) 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86c6ffd640 1 -- 172.21.15.88:0/1295934604 learned_addr learned my addr 172.21.15.88:0/1295934604 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86c77fe640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86c80d1400 0x7f86c814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86c7fff640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86c815cb90 0x7f86c814b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86c6ffd640 1 -- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86c815cb90 msgr2=0x7f86c814b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86c6ffd640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86c815cb90 0x7f86c814b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86c6ffd640 1 -- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86c80d1400 msgr2=0x7f86c814f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86c6ffd640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86c80d1400 0x7f86c814f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86c6ffd640 1 -- 172.21.15.88:0/1295934604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc0094d0 con 0x7f86c80d3010 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86c6ffd640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86c80d3010 0x7f86c814bb20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ad040 tx=0x7f86bc01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86affff640 1 -- 172.21.15.88:0/1295934604 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0b4800 con 0x7f86c80d3010 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86affff640 1 -- 172.21.15.88:0/1295934604 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0b4980 con 0x7f86c80d3010 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86cdc79640 1 -- 172.21.15.88:0/1295934604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c815a180 con 0x7f86c80d3010 2023-11-20T07:02:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86affff640 1 -- 172.21.15.88:0/1295934604 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0b4d30 con 0x7f86c80d3010 2023-11-20T07:02:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86cdc79640 1 -- 172.21.15.88:0/1295934604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c815a740 con 0x7f86c80d3010 2023-11-20T07:02:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.045+0000 7f86cdc79640 1 -- 172.21.15.88:0/1295934604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c8074010 con 0x7f86c80d3010 2023-11-20T07:02:06.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.049+0000 7f86affff640 1 -- 172.21.15.88:0/1295934604 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f86bc0be3f0 con 0x7f86c80d3010 2023-11-20T07:02:06.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.049+0000 7f86affff640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f86b40664a0 0x7f86b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.049+0000 7f86affff640 1 -- 172.21.15.88:0/1295934604 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f86bc11ef20 con 0x7f86c80d3010 2023-11-20T07:02:06.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.049+0000 7f86c77fe640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f86b40664a0 0x7f86b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.049+0000 7f86c77fe640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f86b40664a0 0x7f86b4068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009990 tx=0x7f86b8009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:06.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.053+0000 7f86affff640 1 -- 172.21.15.88:0/1295934604 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f86bc0ec090 con 0x7f86c80d3010 2023-11-20T07:02:06.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 -- 172.21.15.88:0/1295934604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86c815abf0 con 0x7f86c80d3010 2023-11-20T07:02:06.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86affff640 1 -- 172.21.15.88:0/1295934604 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f86bc0ef6b0 con 0x7f86c80d3010 2023-11-20T07:02:06.234 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:06.234 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/1097293366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1097293366},{"type":"v1","addr":"172.21.15.175:6836","nonce":1097293366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/438678526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":438678526},{"type":"v1","addr":"172.21.15.88:6834","nonce":438678526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1083863684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":1083863684},{"type":"v1","addr":"172.21.15.88:6835","nonce":1083863684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:00:54.012155+0000","modified":"2023-11-20T07:01:16.901950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3413113678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3413113678},{"type":"v1","addr":"172.21.15.175:6837","nonce":3413113678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T07:02:06.234 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-11-20T07:02:06.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 -- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f86b40664a0 msgr2=0x7f86b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f86b40664a0 0x7f86b4068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009990 tx=0x7f86b8009110 comp rx=0 tx=0).stop 2023-11-20T07:02:06.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 -- 172.21.15.88:0/1295934604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86c80d3010 msgr2=0x7f86c814bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86c80d3010 0x7f86c814bb20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ad040 tx=0x7f86bc01acc0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 -- 172.21.15.88:0/1295934604 shutdown_connections 2023-11-20T07:02:06.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f86b40664a0 0x7f86b4068960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86c815cb90 0x7f86c814b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86c80d3010 0x7f86c814bb20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 --2- 172.21.15.88:0/1295934604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86c80d1400 0x7f86c814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 -- 172.21.15.88:0/1295934604 >> 172.21.15.88:0/1295934604 conn(0x7f86c809bc50 msgr2=0x7f86c806b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:06.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 -- 172.21.15.88:0/1295934604 shutdown_connections 2023-11-20T07:02:06.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.233+0000 7f86cdc79640 1 -- 172.21.15.88:0/1295934604 wait complete. 2023-11-20T07:02:06.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:06.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.393+0000 7f24a58d6640 1 Processor -- start 2023-11-20T07:02:06.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.393+0000 7f24a58d6640 1 -- start start 2023-11-20T07:02:06.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f24a58d6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f24a015ca70 0x7f24a00d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f24a58d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00d3550 0x7f24a00cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f24a58d6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a00c65f0 con 0x7f24a00cf5d0 2023-11-20T07:02:06.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f24a58d6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a00ce820 con 0x7f24a015ca70 2023-11-20T07:02:06.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f24a58d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00cfa40 con 0x7f24a00d3550 2023-11-20T07:02:06.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f24a00cf5d0 0x7f24a00d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48764/0 (socket says 172.21.15.88:48764) 2023-11-20T07:02:06.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249f7fe640 1 -- 172.21.15.88:0/3381038932 learned_addr learned my addr 172.21.15.88:0/3381038932 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:06.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249effd640 1 --2- 172.21.15.88:0/3381038932 >> v2:172.21.15.175:3300/0 conn(0x7f24a015ca70 0x7f24a00d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f24967fc640 1 --2- 172.21.15.88:0/3381038932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00d3550 0x7f24a00cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196911290 0 0) 0x7f24a00c65f0 con 0x7f24a00cf5d0 2023-11-20T07:02:06.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f248c003530 con 0x7f24a00cf5d0 2023-11-20T07:02:06.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3867938219 0 0) 0x7f248c003530 con 0x7f24a00cf5d0 2023-11-20T07:02:06.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00d3550 msgr2=0x7f24a00cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:06.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 --2- 172.21.15.88:0/3381038932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00d3550 0x7f24a00cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 >> v2:172.21.15.175:3300/0 conn(0x7f24a015ca70 msgr2=0x7f24a00d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:06.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 --2- 172.21.15.88:0/3381038932 >> v2:172.21.15.175:3300/0 conn(0x7f24a015ca70 0x7f24a00d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a00cdf80 con 0x7f24a00cf5d0 2023-11-20T07:02:06.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f2498001680 con 0x7f24a00cf5d0 2023-11-20T07:02:06.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 >> v1:172.21.15.88:6789/0 conn(0x7f24a00cf5d0 legacy=0x7f24a00d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 --2- 172.21.15.88:0/3381038932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00d3550 0x7f248c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 --2- 172.21.15.88:0/3381038932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f248c003f30 0x7f248c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 --2- 172.21.15.88:0/3381038932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f248c004d10 0x7f248c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00ce820 con 0x7f248c004d10 2023-11-20T07:02:06.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00cfa40 con 0x7f248c003f30 2023-11-20T07:02:06.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248c00b990 con 0x7f24a00d3550 2023-11-20T07:02:06.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249f7fe640 1 --2- 172.21.15.88:0/3381038932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f248c004d10 0x7f248c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f24967fc640 1 --2- 172.21.15.88:0/3381038932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f248c003f30 0x7f248c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249effd640 1 --2- 172.21.15.88:0/3381038932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00d3550 0x7f248c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249f7fe640 1 -- 172.21.15.88:0/3381038932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00d3550 msgr2=0x7f248c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:06.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249f7fe640 1 --2- 172.21.15.88:0/3381038932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00d3550 0x7f248c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249f7fe640 1 -- 172.21.15.88:0/3381038932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f248c003f30 msgr2=0x7f248c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:06.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249f7fe640 1 --2- 172.21.15.88:0/3381038932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f248c003f30 0x7f248c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.397+0000 7f249f7fe640 1 -- 172.21.15.88:0/3381038932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c003530 con 0x7f248c004d10 2023-11-20T07:02:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.401+0000 7f249f7fe640 1 --2- 172.21.15.88:0/3381038932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f248c004d10 0x7f248c005190 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f249800c240 tx=0x7f249801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d339d42fa6cdfe server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.401+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24980a5b40 con 0x7f248c004d10 2023-11-20T07:02:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.401+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24980a5cc0 con 0x7f248c004d10 2023-11-20T07:02:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.401+0000 7f249e7fc640 1 -- 172.21.15.88:0/3381038932 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498005b20 con 0x7f248c004d10 2023-11-20T07:02:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.401+0000 7f24a58d6640 1 -- 172.21.15.88:0/3381038932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f248c004d10 msgr2=0x7f248c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.401+0000 7f24a58d6640 1 --2- 172.21.15.88:0/3381038932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f248c004d10 0x7f248c005190 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f249800c240 tx=0x7f249801cc40 comp rx=0 tx=0).stop 2023-11-20T07:02:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.401+0000 7f249f7fe640 1 -- 172.21.15.88:0/3381038932 reap_dead start 2023-11-20T07:02:06.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.401+0000 7f24a58d6640 1 -- 172.21.15.88:0/3381038932 shutdown_connections 2023-11-20T07:02:06.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.401+0000 7f24a58d6640 1 -- 172.21.15.88:0/3381038932 >> 172.21.15.88:0/3381038932 conn(0x7f24a009bc50 msgr2=0x7f24a00d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:06.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.401+0000 7f24a58d6640 1 -- 172.21.15.88:0/3381038932 shutdown_connections 2023-11-20T07:02:06.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.401+0000 7f24a58d6640 1 -- 172.21.15.88:0/3381038932 wait complete. 2023-11-20T07:02:06.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.401+0000 7f24a58d6640 1 Processor -- start 2023-11-20T07:02:06.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f24a58d6640 1 -- start start 2023-11-20T07:02:06.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f24a58d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f248c004d10 0x7f24a00b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f24a58d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00cb4e0 0x7f24a01510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f24a58d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24a01f1ba0 0x7f24a0150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f24a58d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00cb050 con 0x7f24a01f1ba0 2023-11-20T07:02:06.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f24a58d6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a01515e0 con 0x7f248c004d10 2023-11-20T07:02:06.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f24a58d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00ca720 con 0x7f24a00cb4e0 2023-11-20T07:02:06.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24a01f1ba0 0x7f24a0150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24a01f1ba0 0x7f24a0150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59072/0 (socket says 172.21.15.88:59072) 2023-11-20T07:02:06.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249f7fe640 1 -- 172.21.15.88:0/2745716301 learned_addr learned my addr 172.21.15.88:0/2745716301 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:06.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f24967fc640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00cb4e0 0x7f24a01510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249effd640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f248c004d10 0x7f24a00b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249f7fe640 1 -- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00cb4e0 msgr2=0x7f24a01510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249f7fe640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00cb4e0 0x7f24a01510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249f7fe640 1 -- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f248c004d10 msgr2=0x7f24a00b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249f7fe640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f248c004d10 0x7f24a00b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249f7fe640 1 -- 172.21.15.88:0/2745716301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a00caa00 con 0x7f24a01f1ba0 2023-11-20T07:02:06.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249f7fe640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24a01f1ba0 0x7f24a0150340 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f249800c240 tx=0x7f248c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249cff9640 1 -- 172.21.15.88:0/2745716301 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24980b4070 con 0x7f24a01f1ba0 2023-11-20T07:02:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249cff9640 1 -- 172.21.15.88:0/2745716301 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24980a5b50 con 0x7f24a01f1ba0 2023-11-20T07:02:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f249cff9640 1 -- 172.21.15.88:0/2745716301 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498004e70 con 0x7f24a01f1ba0 2023-11-20T07:02:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f24a58d6640 1 -- 172.21.15.88:0/2745716301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a00cace0 con 0x7f24a01f1ba0 2023-11-20T07:02:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f24a58d6640 1 -- 172.21.15.88:0/2745716301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a01f2030 con 0x7f24a01f1ba0 2023-11-20T07:02:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.405+0000 7f24a58d6640 1 -- 172.21.15.88:0/2745716301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a00cb200 con 0x7f24a01f1ba0 2023-11-20T07:02:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.409+0000 7f249cff9640 1 -- 172.21.15.88:0/2745716301 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2498001440 con 0x7f24a01f1ba0 2023-11-20T07:02:06.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.409+0000 7f249cff9640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f24800664a0 0x7f2480068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.409+0000 7f249cff9640 1 -- 172.21.15.88:0/2745716301 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f249811dbe0 con 0x7f24a01f1ba0 2023-11-20T07:02:06.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.409+0000 7f249effd640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f24800664a0 0x7f2480068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.409+0000 7f249effd640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f24800664a0 0x7f2480068960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2490009c40 tx=0x7f2490006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.413+0000 7f249cff9640 1 -- 172.21.15.88:0/2745716301 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f24a00cb200 con 0x7f24a01f1ba0 2023-11-20T07:02:06.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.561+0000 7f24a58d6640 1 -- 172.21.15.88:0/2745716301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24a0074010 con 0x7f24a01f1ba0 2023-11-20T07:02:06.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f249cff9640 1 -- 172.21.15.88:0/2745716301 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f24980eac00 con 0x7f24a01f1ba0 2023-11-20T07:02:06.565 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:06.565 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f24a58d6640 1 -- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f24800664a0 msgr2=0x7f2480068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f24a58d6640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f24800664a0 0x7f2480068960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2490009c40 tx=0x7f2490006f90 comp rx=0 tx=0).stop 2023-11-20T07:02:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f24a58d6640 1 -- 172.21.15.88:0/2745716301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24a01f1ba0 msgr2=0x7f24a0150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f24a58d6640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24a01f1ba0 0x7f24a0150340 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f249800c240 tx=0x7f248c005800 comp rx=0 tx=0).stop 2023-11-20T07:02:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f24a58d6640 1 -- 172.21.15.88:0/2745716301 shutdown_connections 2023-11-20T07:02:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f24a58d6640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f24800664a0 0x7f2480068960 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f24a58d6640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24a00cb4e0 0x7f24a01510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f24a58d6640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24a01f1ba0 0x7f24a0150340 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f24a58d6640 1 --2- 172.21.15.88:0/2745716301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f248c004d10 0x7f24a00b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f24a58d6640 1 -- 172.21.15.88:0/2745716301 >> 172.21.15.88:0/2745716301 conn(0x7f24a009bc50 msgr2=0x7f24a0155290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f24a58d6640 1 -- 172.21.15.88:0/2745716301 shutdown_connections 2023-11-20T07:02:06.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.565+0000 7f24a58d6640 1 -- 172.21.15.88:0/2745716301 wait complete. 2023-11-20T07:02:06.586 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-20T07:02:06.586 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:02:06.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.721+0000 7faec4c9c640 1 Processor -- start 2023-11-20T07:02:06.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.721+0000 7faec4c9c640 1 -- start start 2023-11-20T07:02:06.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faec4c9c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faec0070c40 0x7faec015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faec4c9c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec00b4020 0x7faec00b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faec4c9c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec015be60 con 0x7faec00b0620 2023-11-20T07:02:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faec4c9c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec015b3b0 con 0x7faec0070c40 2023-11-20T07:02:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faec4c9c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec00b0a90 con 0x7faec00b4020 2023-11-20T07:02:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faebe59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faec0070c40 0x7faec015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faebed9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faec00b0620 0x7faec015c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48770/0 (socket says 172.21.15.88:48770) 2023-11-20T07:02:06.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faebe59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faec0070c40 0x7faec015ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59078/0 (socket says 172.21.15.88:59078) 2023-11-20T07:02:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faebed9d640 1 -- 172.21.15.88:0/2180980969 learned_addr learned my addr 172.21.15.88:0/2180980969 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faebdd9b640 1 --2- 172.21.15.88:0/2180980969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec00b4020 0x7faec00b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faebe59c640 1 -- 172.21.15.88:0/2180980969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec00b4020 msgr2=0x7faec00b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faebe59c640 1 --2- 172.21.15.88:0/2180980969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec00b4020 0x7faec00b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faebe59c640 1 -- 172.21.15.88:0/2180980969 >> v1:172.21.15.88:6789/0 conn(0x7faec00b0620 legacy=0x7faec015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.725+0000 7faebe59c640 1 -- 172.21.15.88:0/2180980969 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec015c1f0 con 0x7faec0070c40 2023-11-20T07:02:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faebe59c640 1 --2- 172.21.15.88:0/2180980969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec0070c40 0x7faec015ae70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faeb00097c0 tx=0x7faeb001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a47bf504fa5e891 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faebd59a640 1 -- 172.21.15.88:0/2180980969 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb00ab5f0 con 0x7faec0070c40 2023-11-20T07:02:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faebd59a640 1 -- 172.21.15.88:0/2180980969 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb00ab750 con 0x7faec0070c40 2023-11-20T07:02:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faebd59a640 1 -- 172.21.15.88:0/2180980969 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb00abae0 con 0x7faec0070c40 2023-11-20T07:02:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faec4c9c640 1 -- 172.21.15.88:0/2180980969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec0070c40 msgr2=0x7faec015ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faec4c9c640 1 --2- 172.21.15.88:0/2180980969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec0070c40 0x7faec015ae70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7faeb00097c0 tx=0x7faeb001c3f0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faec4c9c640 1 -- 172.21.15.88:0/2180980969 shutdown_connections 2023-11-20T07:02:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faec4c9c640 1 --2- 172.21.15.88:0/2180980969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec00b4020 0x7faec00b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faec4c9c640 1 --2- 172.21.15.88:0/2180980969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec0070c40 0x7faec015ae70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faec4c9c640 1 -- 172.21.15.88:0/2180980969 >> 172.21.15.88:0/2180980969 conn(0x7faec006c190 msgr2=0x7faec006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faec4c9c640 1 -- 172.21.15.88:0/2180980969 shutdown_connections 2023-11-20T07:02:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faec4c9c640 1 -- 172.21.15.88:0/2180980969 wait complete. 2023-11-20T07:02:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faec4c9c640 1 Processor -- start 2023-11-20T07:02:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.729+0000 7faec4c9c640 1 -- start start 2023-11-20T07:02:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faec4c9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec0070c40 0x7faec014f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faec4c9c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec00b0620 0x7faec00cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faec4c9c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec00b4020 0x7faec00cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faec4c9c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec014f6a0 con 0x7faec00b4020 2023-11-20T07:02:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faec4c9c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec014f990 con 0x7faec0070c40 2023-11-20T07:02:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faec4c9c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec014fc70 con 0x7faec00b0620 2023-11-20T07:02:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faebed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec00b4020 0x7faec00cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faebed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec00b4020 0x7faec00cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59086/0 (socket says 172.21.15.88:59086) 2023-11-20T07:02:06.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faebed9d640 1 -- 172.21.15.88:0/2633733125 learned_addr learned my addr 172.21.15.88:0/2633733125 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:06.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faebe59c640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec0070c40 0x7faec014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faebdd9b640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec00b0620 0x7faec00cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faebed9d640 1 -- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec00b0620 msgr2=0x7faec00cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faebed9d640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec00b0620 0x7faec00cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faebed9d640 1 -- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec0070c40 msgr2=0x7faec014f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faebed9d640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec0070c40 0x7faec014f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faebed9d640 1 -- 172.21.15.88:0/2633733125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb0009420 con 0x7faec00b4020 2023-11-20T07:02:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faebed9d640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec00b4020 0x7faec00cd960 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faeb800ca70 tx=0x7faeb800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faeaeffd640 1 -- 172.21.15.88:0/2633733125 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb800abd0 con 0x7faec00b4020 2023-11-20T07:02:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faeaeffd640 1 -- 172.21.15.88:0/2633733125 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb800ad30 con 0x7faec00b4020 2023-11-20T07:02:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faec4c9c640 1 -- 172.21.15.88:0/2633733125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec014ff50 con 0x7faec00b4020 2023-11-20T07:02:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faeaeffd640 1 -- 172.21.15.88:0/2633733125 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8012600 con 0x7faec00b4020 2023-11-20T07:02:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faec4c9c640 1 -- 172.21.15.88:0/2633733125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec0150510 con 0x7faec00b4020 2023-11-20T07:02:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faec4c9c640 1 -- 172.21.15.88:0/2633733125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec0150700 con 0x7faec00b4020 2023-11-20T07:02:06.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.733+0000 7faeaeffd640 1 -- 172.21.15.88:0/2633733125 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faeb8007070 con 0x7faec00b4020 2023-11-20T07:02:06.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.737+0000 7faeaeffd640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faea00664a0 0x7faea0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:06.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.737+0000 7faeaeffd640 1 -- 172.21.15.88:0/2633733125 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faeb8083fd0 con 0x7faec00b4020 2023-11-20T07:02:06.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.737+0000 7faebe59c640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faea00664a0 0x7faea0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:06.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.737+0000 7faebe59c640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faea00664a0 0x7faea0068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faeb00af000 tx=0x7faeb00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:06.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.741+0000 7faeaeffd640 1 -- 172.21.15.88:0/2633733125 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faeb8051130 con 0x7faec00b4020 2023-11-20T07:02:06.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.921+0000 7faec4c9c640 1 -- 172.21.15.88:0/2633733125 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faec0074010 con 0x7faec00b4020 2023-11-20T07:02:06.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.921+0000 7faeaeffd640 1 -- 172.21.15.88:0/2633733125 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7faeb8017090 con 0x7faec00b4020 2023-11-20T07:02:06.923 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:06.924 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/1097293366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1097293366},{"type":"v1","addr":"172.21.15.175:6836","nonce":1097293366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/438678526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":438678526},{"type":"v1","addr":"172.21.15.88:6834","nonce":438678526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1083863684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":1083863684},{"type":"v1","addr":"172.21.15.88:6835","nonce":1083863684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:00:54.012155+0000","modified":"2023-11-20T07:01:16.901950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3413113678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3413113678},{"type":"v1","addr":"172.21.15.175:6837","nonce":3413113678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T07:02:06.924 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-11-20T07:02:06.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.925+0000 7faec4c9c640 1 -- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faea00664a0 msgr2=0x7faea0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.925+0000 7faec4c9c640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faea00664a0 0x7faea0068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faeb00af000 tx=0x7faeb00a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:06.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.925+0000 7faec4c9c640 1 -- 172.21.15.88:0/2633733125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec00b4020 msgr2=0x7faec00cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:06.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.925+0000 7faec4c9c640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec00b4020 0x7faec00cd960 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faeb800ca70 tx=0x7faeb800cf30 comp rx=0 tx=0).stop 2023-11-20T07:02:06.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.925+0000 7faec4c9c640 1 -- 172.21.15.88:0/2633733125 shutdown_connections 2023-11-20T07:02:06.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.925+0000 7faec4c9c640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faea00664a0 0x7faea0068960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.925+0000 7faec4c9c640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec00b0620 0x7faec00cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.925+0000 7faec4c9c640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faec00b4020 0x7faec00cd960 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.925+0000 7faec4c9c640 1 --2- 172.21.15.88:0/2633733125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec0070c40 0x7faec014f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:06.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.925+0000 7faec4c9c640 1 -- 172.21.15.88:0/2633733125 >> 172.21.15.88:0/2633733125 conn(0x7faec006c190 msgr2=0x7faec00b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:06.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.925+0000 7faec4c9c640 1 -- 172.21.15.88:0/2633733125 shutdown_connections 2023-11-20T07:02:06.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:06.925+0000 7faec4c9c640 1 -- 172.21.15.88:0/2633733125 wait complete. 2023-11-20T07:02:06.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:02:07.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f73438d6640 1 Processor -- start 2023-11-20T07:02:07.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f73438d6640 1 -- start start 2023-11-20T07:02:07.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f73438d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f733c0d15d0 0x7f733c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f73438d6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f733c0d3010 0x7f733c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f73438d6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f733c0ce770 con 0x7f733c15cb90 2023-11-20T07:02:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f73438d6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733c0d0600 con 0x7f733c0d3010 2023-11-20T07:02:07.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f73438d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c0c6450 con 0x7f733c0d15d0 2023-11-20T07:02:07.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f7341e73640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f733c0d3010 0x7f733c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f7341e73640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f733c0d3010 0x7f733c0c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59102/0 (socket says 172.21.15.88:59102) 2023-11-20T07:02:07.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f7341e73640 1 -- 172.21.15.88:0/3980568307 learned_addr learned my addr 172.21.15.88:0/3980568307 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:07.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f7340e71640 1 --2- 172.21.15.88:0/3980568307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f733c0d15d0 0x7f733c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f7341e73640 1 -- 172.21.15.88:0/3980568307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f733c0d15d0 msgr2=0x7f733c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:07.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f7341e73640 1 --2- 172.21.15.88:0/3980568307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f733c0d15d0 0x7f733c0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f7341e73640 1 -- 172.21.15.88:0/3980568307 >> v1:172.21.15.175:6789/0 conn(0x7f733c15cb90 legacy=0x7f733c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f7341e73640 1 -- 172.21.15.88:0/3980568307 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c0d08a0 con 0x7f733c0d3010 2023-11-20T07:02:07.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.081+0000 7f7340e71640 1 --2- 172.21.15.88:0/3980568307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f733c0d15d0 0x7f733c0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:07.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.085+0000 7f7341e73640 1 --2- 172.21.15.88:0/3980568307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f733c0d3010 0x7f733c0c6c10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7334009e50 tx=0x7f733401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b30a49ce064755 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:07.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.085+0000 7f7333fff640 1 -- 172.21.15.88:0/3980568307 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73340a5810 con 0x7f733c0d3010 2023-11-20T07:02:07.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.085+0000 7f7333fff640 1 -- 172.21.15.88:0/3980568307 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73340a5970 con 0x7f733c0d3010 2023-11-20T07:02:07.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.085+0000 7f7333fff640 1 -- 172.21.15.88:0/3980568307 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73340a5d00 con 0x7f733c0d3010 2023-11-20T07:02:07.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.085+0000 7f73438d6640 1 -- 172.21.15.88:0/3980568307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f733c0d3010 msgr2=0x7f733c0c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.085+0000 7f73438d6640 1 --2- 172.21.15.88:0/3980568307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f733c0d3010 0x7f733c0c6c10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7334009e50 tx=0x7f733401c950 comp rx=0 tx=0).stop 2023-11-20T07:02:07.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.085+0000 7f73438d6640 1 -- 172.21.15.88:0/3980568307 shutdown_connections 2023-11-20T07:02:07.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.085+0000 7f73438d6640 1 --2- 172.21.15.88:0/3980568307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f733c0d3010 0x7f733c0c6c10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.085+0000 7f73438d6640 1 --2- 172.21.15.88:0/3980568307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f733c0d15d0 0x7f733c0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.085+0000 7f73438d6640 1 -- 172.21.15.88:0/3980568307 >> 172.21.15.88:0/3980568307 conn(0x7f733c09bc50 msgr2=0x7f733c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:07.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.085+0000 7f73438d6640 1 -- 172.21.15.88:0/3980568307 shutdown_connections 2023-11-20T07:02:07.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.085+0000 7f73438d6640 1 -- 172.21.15.88:0/3980568307 wait complete. 2023-11-20T07:02:07.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f73438d6640 1 Processor -- start 2023-11-20T07:02:07.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f73438d6640 1 -- start start 2023-11-20T07:02:07.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f73438d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f733c0d15d0 0x7f733c0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f73438d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f733c0d3010 0x7f733c150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f73438d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f733c15cb90 0x7f733c0b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f73438d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c153f70 con 0x7f733c15cb90 2023-11-20T07:02:07.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f73438d6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c157bf0 con 0x7f733c0d15d0 2023-11-20T07:02:07.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f73438d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733c157ed0 con 0x7f733c0d3010 2023-11-20T07:02:07.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7341e73640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f733c15cb90 0x7f733c0b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7341e73640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f733c15cb90 0x7f733c0b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59104/0 (socket says 172.21.15.88:59104) 2023-11-20T07:02:07.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7341e73640 1 -- 172.21.15.88:0/3953164535 learned_addr learned my addr 172.21.15.88:0/3953164535 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:07.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7341672640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f733c0d15d0 0x7f733c0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7340e71640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f733c0d3010 0x7f733c150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7341e73640 1 -- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f733c0d3010 msgr2=0x7f733c150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7341e73640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f733c0d3010 0x7f733c150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7341e73640 1 -- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f733c0d15d0 msgr2=0x7f733c0b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7341e73640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f733c0d15d0 0x7f733c0b78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7341e73640 1 -- 172.21.15.88:0/3953164535 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7334009b30 con 0x7f733c15cb90 2023-11-20T07:02:07.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7340e71640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f733c0d3010 0x7f733c150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:07.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7341672640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f733c0d15d0 0x7f733c0b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:07.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7341e73640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f733c15cb90 0x7f733c0b5520 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f73340af040 tx=0x7f73340196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:07.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7331ffb640 1 -- 172.21.15.88:0/3953164535 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73340b8670 con 0x7f733c15cb90 2023-11-20T07:02:07.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7331ffb640 1 -- 172.21.15.88:0/3953164535 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73340b87d0 con 0x7f733c15cb90 2023-11-20T07:02:07.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f73438d6640 1 -- 172.21.15.88:0/3953164535 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733c153920 con 0x7f733c15cb90 2023-11-20T07:02:07.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f7331ffb640 1 -- 172.21.15.88:0/3953164535 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73340b8b60 con 0x7f733c15cb90 2023-11-20T07:02:07.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f73438d6640 1 -- 172.21.15.88:0/3953164535 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733c0b7e10 con 0x7f733c15cb90 2023-11-20T07:02:07.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.089+0000 7f73438d6640 1 -- 172.21.15.88:0/3953164535 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733c1540e0 con 0x7f733c15cb90 2023-11-20T07:02:07.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.093+0000 7f7331ffb640 1 -- 172.21.15.88:0/3953164535 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f73340b8cc0 con 0x7f733c15cb90 2023-11-20T07:02:07.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.093+0000 7f7331ffb640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f73200664a0 0x7f7320068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.093+0000 7f7331ffb640 1 -- 172.21.15.88:0/3953164535 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f733411f9c0 con 0x7f733c15cb90 2023-11-20T07:02:07.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.093+0000 7f7341672640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f73200664a0 0x7f7320068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.093+0000 7f7341672640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f73200664a0 0x7f7320068960 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7338007fd0 tx=0x7f7338009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:07.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.097+0000 7f7331ffb640 1 -- 172.21.15.88:0/3953164535 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f73340ecb00 con 0x7f733c15cb90 2023-11-20T07:02:07.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 -- 172.21.15.88:0/3953164535 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f733c074010 con 0x7f733c15cb90 2023-11-20T07:02:07.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f7331ffb640 1 -- 172.21.15.88:0/3953164535 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f73340f0120 con 0x7f733c15cb90 2023-11-20T07:02:07.282 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:07.282 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/1097293366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1097293366},{"type":"v1","addr":"172.21.15.175:6836","nonce":1097293366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/438678526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":438678526},{"type":"v1","addr":"172.21.15.88:6834","nonce":438678526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/1083863684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":1083863684},{"type":"v1","addr":"172.21.15.88:6835","nonce":1083863684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:00:54.012155+0000","modified":"2023-11-20T07:01:16.901950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3413113678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3413113678},{"type":"v1","addr":"172.21.15.175:6837","nonce":3413113678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-20T07:02:07.282 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-11-20T07:02:07.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 -- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f73200664a0 msgr2=0x7f7320068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f73200664a0 0x7f7320068960 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7338007fd0 tx=0x7f7338009040 comp rx=0 tx=0).stop 2023-11-20T07:02:07.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 -- 172.21.15.88:0/3953164535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f733c15cb90 msgr2=0x7f733c0b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f733c15cb90 0x7f733c0b5520 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f73340af040 tx=0x7f73340196f0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 -- 172.21.15.88:0/3953164535 shutdown_connections 2023-11-20T07:02:07.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f73200664a0 0x7f7320068960 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f733c0d3010 0x7f733c150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f733c15cb90 0x7f733c0b5520 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 --2- 172.21.15.88:0/3953164535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f733c0d15d0 0x7f733c0b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 -- 172.21.15.88:0/3953164535 >> 172.21.15.88:0/3953164535 conn(0x7f733c09bc50 msgr2=0x7f733c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:07.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 -- 172.21.15.88:0/3953164535 shutdown_connections 2023-11-20T07:02:07.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.281+0000 7f73438d6640 1 -- 172.21.15.88:0/3953164535 wait complete. 2023-11-20T07:02:07.303 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:07.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.437+0000 7f34ff9d3640 1 Processor -- start 2023-11-20T07:02:07.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34ff9d3640 1 -- start start 2023-11-20T07:02:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34ff9d3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f34f80c8cb0 0x7f34f80cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34ff9d3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80723d0 con 0x7f34f8159ba0 2023-11-20T07:02:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34ff9d3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80717c0 con 0x7f34f81597c0 2023-11-20T07:02:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34ff9d3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f8071aa0 con 0x7f34f80c8cb0 2023-11-20T07:02:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34fdf70640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f34f80c8cb0 0x7f34f80cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34fdf70640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f34f80c8cb0 0x7f34f80cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59116/0 (socket says 172.21.15.88:59116) 2023-11-20T07:02:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34fdf70640 1 -- 172.21.15.88:0/1201901394 learned_addr learned my addr 172.21.15.88:0/1201901394 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:07.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34fcf6e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f34f8159ba0 0x7f34f80cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48784/0 (socket says 172.21.15.88:48784) 2023-11-20T07:02:07.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34fdf70640 1 -- 172.21.15.88:0/1201901394 >> v1:172.21.15.175:6789/0 conn(0x7f34f81597c0 legacy=0x7f34f80ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:07.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34fdf70640 1 -- 172.21.15.88:0/1201901394 >> v1:172.21.15.88:6789/0 conn(0x7f34f8159ba0 legacy=0x7f34f80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34fdf70640 1 -- 172.21.15.88:0/1201901394 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f8071d80 con 0x7f34f80c8cb0 2023-11-20T07:02:07.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.441+0000 7f34effff640 1 -- 172.21.15.88:0/1201901394 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970019934 0 0) 0x7f34f80723d0 con 0x7f34f8159ba0 2023-11-20T07:02:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34fdf70640 1 --2- 172.21.15.88:0/1201901394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f80c8cb0 0x7f34f80cb520 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009e50 tx=0x7f34f001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954115dff3045764 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34effff640 1 -- 172.21.15.88:0/1201901394 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00a5830 con 0x7f34f80c8cb0 2023-11-20T07:02:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34effff640 1 -- 172.21.15.88:0/1201901394 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f00a5990 con 0x7f34f80c8cb0 2023-11-20T07:02:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34effff640 1 -- 172.21.15.88:0/1201901394 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00a5d20 con 0x7f34f80c8cb0 2023-11-20T07:02:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34ff9d3640 1 -- 172.21.15.88:0/1201901394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f80c8cb0 msgr2=0x7f34f80cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34ff9d3640 1 --2- 172.21.15.88:0/1201901394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f80c8cb0 0x7f34f80cb520 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009e50 tx=0x7f34f001c9d0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34ff9d3640 1 -- 172.21.15.88:0/1201901394 shutdown_connections 2023-11-20T07:02:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34ff9d3640 1 --2- 172.21.15.88:0/1201901394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f80c8cb0 0x7f34f80cb520 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34ff9d3640 1 -- 172.21.15.88:0/1201901394 >> 172.21.15.88:0/1201901394 conn(0x7f34f806c190 msgr2=0x7f34f806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34ff9d3640 1 -- 172.21.15.88:0/1201901394 shutdown_connections 2023-11-20T07:02:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34ff9d3640 1 -- 172.21.15.88:0/1201901394 wait complete. 2023-11-20T07:02:07.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34ff9d3640 1 Processor -- start 2023-11-20T07:02:07.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.445+0000 7f34ff9d3640 1 -- start start 2023-11-20T07:02:07.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34ff9d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f80c8cb0 0x7f34f8148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34ff9d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34f81597c0 0x7f34f80ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34ff9d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34f8159ba0 0x7f34f80aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34ff9d3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8149060 con 0x7f34f80c8cb0 2023-11-20T07:02:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34ff9d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f814f220 con 0x7f34f8159ba0 2023-11-20T07:02:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34ff9d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f814f500 con 0x7f34f81597c0 2023-11-20T07:02:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34fd76f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f80c8cb0 0x7f34f8148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34fd76f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f80c8cb0 0x7f34f8148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59118/0 (socket says 172.21.15.88:59118) 2023-11-20T07:02:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34fd76f640 1 -- 172.21.15.88:0/2137911809 learned_addr learned my addr 172.21.15.88:0/2137911809 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34fdf70640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34f8159ba0 0x7f34f80aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34fcf6e640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34f81597c0 0x7f34f80ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34fd76f640 1 -- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34f81597c0 msgr2=0x7f34f80ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34fd76f640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34f81597c0 0x7f34f80ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34fd76f640 1 -- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34f8159ba0 msgr2=0x7f34f80aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34fd76f640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34f8159ba0 0x7f34f80aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34fd76f640 1 -- 172.21.15.88:0/2137911809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f0009b30 con 0x7f34f80c8cb0 2023-11-20T07:02:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34fd76f640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f80c8cb0 0x7f34f8148b20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f34f400c450 tx=0x7f34f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34edffb640 1 -- 172.21.15.88:0/2137911809 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4012830 con 0x7f34f80c8cb0 2023-11-20T07:02:07.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34edffb640 1 -- 172.21.15.88:0/2137911809 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f40129b0 con 0x7f34f80c8cb0 2023-11-20T07:02:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34edffb640 1 -- 172.21.15.88:0/2137911809 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4012d60 con 0x7f34f80c8cb0 2023-11-20T07:02:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34ff9d3640 1 -- 172.21.15.88:0/2137911809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f814f7e0 con 0x7f34f80c8cb0 2023-11-20T07:02:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34ff9d3640 1 -- 172.21.15.88:0/2137911809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f814e4b0 con 0x7f34f80c8cb0 2023-11-20T07:02:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34ff9d3640 1 -- 172.21.15.88:0/2137911809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f814f9d0 con 0x7f34f80c8cb0 2023-11-20T07:02:07.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.449+0000 7f34edffb640 1 -- 172.21.15.88:0/2137911809 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34f401c460 con 0x7f34f80c8cb0 2023-11-20T07:02:07.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.453+0000 7f34edffb640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34dc0664a0 0x7f34dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.453+0000 7f34edffb640 1 -- 172.21.15.88:0/2137911809 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34f4084150 con 0x7f34f80c8cb0 2023-11-20T07:02:07.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.453+0000 7f34fcf6e640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34dc0664a0 0x7f34dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.453+0000 7f34fcf6e640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34dc0664a0 0x7f34dc068960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f34f81f86e0 tx=0x7f34e8007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:07.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.457+0000 7f34edffb640 1 -- 172.21.15.88:0/2137911809 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34f4051170 con 0x7f34f80c8cb0 2023-11-20T07:02:07.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.605+0000 7f34ff9d3640 1 -- 172.21.15.88:0/2137911809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34f8074010 con 0x7f34f80c8cb0 2023-11-20T07:02:07.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.605+0000 7f34edffb640 1 -- 172.21.15.88:0/2137911809 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18699 (secure 0 0 0) 0x7f34f4054790 con 0x7f34f80c8cb0 2023-11-20T07:02:07.607 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:07.607 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:01:35.301955+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:00:51.948011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-20T07:00:53.002743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-11-20T07:00:56.338705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.609+0000 7f34ff9d3640 1 -- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34dc0664a0 msgr2=0x7f34dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.609+0000 7f34ff9d3640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34dc0664a0 0x7f34dc068960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f34f81f86e0 tx=0x7f34e8007c10 comp rx=0 tx=0).stop 2023-11-20T07:02:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.609+0000 7f34ff9d3640 1 -- 172.21.15.88:0/2137911809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f80c8cb0 msgr2=0x7f34f8148b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.609+0000 7f34ff9d3640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f80c8cb0 0x7f34f8148b20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f34f400c450 tx=0x7f34f400c910 comp rx=0 tx=0).stop 2023-11-20T07:02:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.609+0000 7f34ff9d3640 1 -- 172.21.15.88:0/2137911809 shutdown_connections 2023-11-20T07:02:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.609+0000 7f34ff9d3640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34dc0664a0 0x7f34dc068960 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.609+0000 7f34ff9d3640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34f81597c0 0x7f34f80ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.609+0000 7f34ff9d3640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34f8159ba0 0x7f34f80aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.609+0000 7f34ff9d3640 1 --2- 172.21.15.88:0/2137911809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34f80c8cb0 0x7f34f8148b20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.609+0000 7f34ff9d3640 1 -- 172.21.15.88:0/2137911809 >> 172.21.15.88:0/2137911809 conn(0x7f34f806c190 msgr2=0x7f34f80ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.609+0000 7f34ff9d3640 1 -- 172.21.15.88:0/2137911809 shutdown_connections 2023-11-20T07:02:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.609+0000 7f34ff9d3640 1 -- 172.21.15.88:0/2137911809 wait complete. 2023-11-20T07:02:07.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-20T07:02:07.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa96d794640 1 Processor -- start 2023-11-20T07:02:07.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa96d794640 1 -- start start 2023-11-20T07:02:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa96d794640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa96815cb90 0x7fa9680cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa96d794640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680d3010 0x7fa9680d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa96d794640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9680ce770 con 0x7fa9680d1400 2023-11-20T07:02:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa96d794640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9680d1890 con 0x7fa96815cb90 2023-11-20T07:02:07.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa96d794640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680d0600 con 0x7fa9680d3010 2023-11-20T07:02:07.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa966ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa96815cb90 0x7fa9680cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa9677fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa9680d1400 0x7fa9680cd3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:55794/0 (socket says 172.21.15.88:55794) 2023-11-20T07:02:07.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa966ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa96815cb90 0x7fa9680cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:56052/0 (socket says 172.21.15.88:56052) 2023-11-20T07:02:07.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa9677fe640 1 -- 172.21.15.88:0/224813679 learned_addr learned my addr 172.21.15.88:0/224813679 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:07.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa95e7fc640 1 --2- 172.21.15.88:0/224813679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680d3010 0x7fa9680d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa966ffd640 1 -- 172.21.15.88:0/224813679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680d3010 msgr2=0x7fa9680d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:07.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa966ffd640 1 --2- 172.21.15.88:0/224813679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680d3010 0x7fa9680d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa966ffd640 1 -- 172.21.15.88:0/224813679 >> v1:172.21.15.175:6789/0 conn(0x7fa9680d1400 legacy=0x7fa9680cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.769+0000 7fa966ffd640 1 -- 172.21.15.88:0/224813679 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680c6450 con 0x7fa96815cb90 2023-11-20T07:02:07.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.773+0000 7fa966ffd640 1 --2- 172.21.15.88:0/224813679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa96815cb90 0x7fa9680cfb10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa9580097a0 tx=0x7fa95801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=961421402ed803a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:07.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.773+0000 7fa9667fc640 1 -- 172.21.15.88:0/224813679 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580ac600 con 0x7fa96815cb90 2023-11-20T07:02:07.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.773+0000 7fa9667fc640 1 -- 172.21.15.88:0/224813679 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9580a8050 con 0x7fa96815cb90 2023-11-20T07:02:07.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.773+0000 7fa9667fc640 1 -- 172.21.15.88:0/224813679 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580ac980 con 0x7fa96815cb90 2023-11-20T07:02:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.773+0000 7fa96d794640 1 -- 172.21.15.88:0/224813679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa96815cb90 msgr2=0x7fa9680cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.773+0000 7fa96d794640 1 --2- 172.21.15.88:0/224813679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa96815cb90 0x7fa9680cfb10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa9580097a0 tx=0x7fa95801c3a0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.773+0000 7fa96d794640 1 -- 172.21.15.88:0/224813679 shutdown_connections 2023-11-20T07:02:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.773+0000 7fa96d794640 1 --2- 172.21.15.88:0/224813679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680d3010 0x7fa9680d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.773+0000 7fa96d794640 1 --2- 172.21.15.88:0/224813679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa96815cb90 0x7fa9680cfb10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.773+0000 7fa96d794640 1 -- 172.21.15.88:0/224813679 >> 172.21.15.88:0/224813679 conn(0x7fa96809bc50 msgr2=0x7fa9680d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.773+0000 7fa96d794640 1 -- 172.21.15.88:0/224813679 shutdown_connections 2023-11-20T07:02:07.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.773+0000 7fa96d794640 1 -- 172.21.15.88:0/224813679 wait complete. 2023-11-20T07:02:07.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa96d794640 1 Processor -- start 2023-11-20T07:02:07.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa96d794640 1 -- start start 2023-11-20T07:02:07.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa96d794640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680d1400 0x7fa968152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa96d794640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9680d3010 0x7fa9680b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa96d794640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa96815cb90 0x7fa9680b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa96d794640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968157b00 con 0x7fa96815cb90 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa96d794640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968157de0 con 0x7fa9680d3010 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa96d794640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9681580c0 con 0x7fa9680d1400 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa9677fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa96815cb90 0x7fa9680b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa9677fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa96815cb90 0x7fa9680b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59128/0 (socket says 172.21.15.88:59128) 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa9677fe640 1 -- 172.21.15.88:0/3814298761 learned_addr learned my addr 172.21.15.88:0/3814298761 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa95e7fc640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9680d3010 0x7fa9680b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa966ffd640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680d1400 0x7fa968152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa9677fe640 1 -- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680d1400 msgr2=0x7fa968152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa9677fe640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680d1400 0x7fa968152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa9677fe640 1 -- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9680d3010 msgr2=0x7fa9680b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa9677fe640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9680d3010 0x7fa9680b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa9677fe640 1 -- 172.21.15.88:0/3814298761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9580093b0 con 0x7fa96815cb90 2023-11-20T07:02:07.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa9677fe640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa96815cb90 0x7fa9680b5b40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa96000ca80 tx=0x7fa96000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:07.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa95ffff640 1 -- 172.21.15.88:0/3814298761 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000ac30 con 0x7fa96815cb90 2023-11-20T07:02:07.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa95ffff640 1 -- 172.21.15.88:0/3814298761 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96000ad90 con 0x7fa96815cb90 2023-11-20T07:02:07.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa96d794640 1 -- 172.21.15.88:0/3814298761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9681583a0 con 0x7fa96815cb90 2023-11-20T07:02:07.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa95ffff640 1 -- 172.21.15.88:0/3814298761 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960012600 con 0x7fa96815cb90 2023-11-20T07:02:07.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.777+0000 7fa96d794640 1 -- 172.21.15.88:0/3814298761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9680b6080 con 0x7fa96815cb90 2023-11-20T07:02:07.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.781+0000 7fa96d794640 1 -- 172.21.15.88:0/3814298761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa968074010 con 0x7fa96815cb90 2023-11-20T07:02:07.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.781+0000 7fa95ffff640 1 -- 172.21.15.88:0/3814298761 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa960007070 con 0x7fa96815cb90 2023-11-20T07:02:07.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.781+0000 7fa95ffff640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa9480664d0 0x7fa948068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:07.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.781+0000 7fa95ffff640 1 -- 172.21.15.88:0/3814298761 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa960083f60 con 0x7fa96815cb90 2023-11-20T07:02:07.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.781+0000 7fa966ffd640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa9480664d0 0x7fa948068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:07.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.781+0000 7fa966ffd640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa9480664d0 0x7fa948068990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa9580ae000 tx=0x7fa9580a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:07.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.785+0000 7fa95ffff640 1 -- 172.21.15.88:0/3814298761 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa960051160 con 0x7fa96815cb90 2023-11-20T07:02:07.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.965+0000 7fa96d794640 1 -- 172.21.15.88:0/3814298761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa968157c40 con 0x7fa96815cb90 2023-11-20T07:02:07.967 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-11-20T07:02:07.965+0000 7f5e6f7b2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-20T07:02:07.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.969+0000 7fa95ffff640 1 -- 172.21.15.88:0/3814298761 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa968157c40 con 0x7fa96815cb90 2023-11-20T07:02:07.970 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-20T07:02:07.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.969+0000 7fa96d794640 1 -- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa9480664d0 msgr2=0x7fa948068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.969+0000 7fa96d794640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa9480664d0 0x7fa948068990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa9580ae000 tx=0x7fa9580a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:07.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.969+0000 7fa96d794640 1 -- 172.21.15.88:0/3814298761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa96815cb90 msgr2=0x7fa9680b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:07.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.969+0000 7fa96d794640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa96815cb90 0x7fa9680b5b40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa96000ca80 tx=0x7fa96000cf40 comp rx=0 tx=0).stop 2023-11-20T07:02:07.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.973+0000 7fa96d794640 1 -- 172.21.15.88:0/3814298761 shutdown_connections 2023-11-20T07:02:07.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.973+0000 7fa96d794640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fa9480664d0 0x7fa948068990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.973+0000 7fa96d794640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa96815cb90 0x7fa9680b5b40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.973+0000 7fa96d794640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9680d3010 0x7fa9680b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.973+0000 7fa96d794640 1 --2- 172.21.15.88:0/3814298761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9680d1400 0x7fa968152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:07.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.973+0000 7fa96d794640 1 -- 172.21.15.88:0/3814298761 >> 172.21.15.88:0/3814298761 conn(0x7fa96809bc50 msgr2=0x7fa9680b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:07.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.973+0000 7fa96d794640 1 -- 172.21.15.88:0/3814298761 shutdown_connections 2023-11-20T07:02:07.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:07.973+0000 7fa96d794640 1 -- 172.21.15.88:0/3814298761 wait complete. 2023-11-20T07:02:07.983 INFO:tasks.ceph.mds.d.smithi175.stderr: -4302> 2023-11-20T07:00:58.333+0000 7fc53f0a1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-20T07:02:07.992 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-20T07:02:08.032 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-11-20T07:02:08.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.129+0000 7f4ad57c4640 1 Processor -- start 2023-11-20T07:02:08.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.129+0000 7f4ad57c4640 1 -- start start 2023-11-20T07:02:08.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4ad57c4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ad015cba0 0x7f4ad00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:08.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4ad57c4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad00b84e0 0x7f4ad00cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:08.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4ad57c4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad00d1670 con 0x7f4ad00d0040 2023-11-20T07:02:08.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4ad57c4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad00d1460 con 0x7f4ad015cba0 2023-11-20T07:02:08.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4ad57c4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00d04b0 con 0x7f4ad00b84e0 2023-11-20T07:02:08.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4ac67fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad00b84e0 0x7f4ad00cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:08.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4ac67fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad00b84e0 0x7f4ad00cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:35768/0 (socket says 172.21.15.88:35768) 2023-11-20T07:02:08.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4ac67fc640 1 -- 172.21.15.88:0/914867424 learned_addr learned my addr 172.21.15.88:0/914867424 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:08.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4aceffd640 1 --2- 172.21.15.88:0/914867424 >> v2:172.21.15.175:3300/0 conn(0x7f4ad015cba0 0x7f4ad00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:08.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4ac67fc640 1 -- 172.21.15.88:0/914867424 >> v2:172.21.15.175:3300/0 conn(0x7f4ad015cba0 msgr2=0x7f4ad00d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:08.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4ac67fc640 1 --2- 172.21.15.88:0/914867424 >> v2:172.21.15.175:3300/0 conn(0x7f4ad015cba0 0x7f4ad00d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:08.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4ac67fc640 1 -- 172.21.15.88:0/914867424 >> v1:172.21.15.175:6789/0 conn(0x7f4ad00d0040 legacy=0x7f4ad00d2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:08.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.133+0000 7f4ac67fc640 1 -- 172.21.15.88:0/914867424 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad00d1950 con 0x7f4ad00b84e0 2023-11-20T07:02:08.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ac67fc640 1 --2- 172.21.15.88:0/914867424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad00b84e0 0x7f4ad00cfb00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009870 tx=0x7f4ab801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b85a77b6956bc88b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:08.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ace7fc640 1 -- 172.21.15.88:0/914867424 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80ab660 con 0x7f4ad00b84e0 2023-11-20T07:02:08.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ace7fc640 1 -- 172.21.15.88:0/914867424 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab80ab7c0 con 0x7f4ad00b84e0 2023-11-20T07:02:08.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ace7fc640 1 -- 172.21.15.88:0/914867424 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80abb50 con 0x7f4ad00b84e0 2023-11-20T07:02:08.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ad57c4640 1 -- 172.21.15.88:0/914867424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad00b84e0 msgr2=0x7f4ad00cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:08.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ad57c4640 1 --2- 172.21.15.88:0/914867424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad00b84e0 0x7f4ad00cfb00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8009870 tx=0x7f4ab801c540 comp rx=0 tx=0).stop 2023-11-20T07:02:08.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ad57c4640 1 -- 172.21.15.88:0/914867424 shutdown_connections 2023-11-20T07:02:08.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ad57c4640 1 --2- 172.21.15.88:0/914867424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad00b84e0 0x7f4ad00cfb00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:08.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ad57c4640 1 --2- 172.21.15.88:0/914867424 >> v2:172.21.15.175:3300/0 conn(0x7f4ad015cba0 0x7f4ad00d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:08.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ad57c4640 1 -- 172.21.15.88:0/914867424 >> 172.21.15.88:0/914867424 conn(0x7f4ad00719c0 msgr2=0x7f4ad0071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:08.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ad57c4640 1 -- 172.21.15.88:0/914867424 shutdown_connections 2023-11-20T07:02:08.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ad57c4640 1 -- 172.21.15.88:0/914867424 wait complete. 2023-11-20T07:02:08.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ad57c4640 1 Processor -- start 2023-11-20T07:02:08.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.137+0000 7f4ad57c4640 1 -- start start 2023-11-20T07:02:08.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ad57c4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad00b84e0 0x7f4ad014dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:08.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ad57c4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ad00d0040 0x7f4ad00cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:08.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ad57c4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad015cba0 0x7f4ad00cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:08.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ad57c4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00cc480 con 0x7f4ad00d0040 2023-11-20T07:02:08.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ad57c4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0154c60 con 0x7f4ad00b84e0 2023-11-20T07:02:08.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ad57c4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00cd170 con 0x7f4ad015cba0 2023-11-20T07:02:08.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ad00d0040 0x7f4ad00cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:08.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ad00d0040 0x7f4ad00cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59136/0 (socket says 172.21.15.88:59136) 2023-11-20T07:02:08.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac67fc640 1 -- 172.21.15.88:0/2359624045 learned_addr learned my addr 172.21.15.88:0/2359624045 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:08.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4aceffd640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad00b84e0 0x7f4ad014dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:08.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4acf7fe640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad015cba0 0x7f4ad00cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:08.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac67fc640 1 -- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad015cba0 msgr2=0x7f4ad00cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:08.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac67fc640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad015cba0 0x7f4ad00cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:08.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac67fc640 1 -- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad00b84e0 msgr2=0x7f4ad014dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:08.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac67fc640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad00b84e0 0x7f4ad014dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:08.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac67fc640 1 -- 172.21.15.88:0/2359624045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80094d0 con 0x7f4ad00d0040 2023-11-20T07:02:08.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4acf7fe640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad015cba0 0x7f4ad00cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:08.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac67fc640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ad00d0040 0x7f4ad00cb120 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4ab801a170 tx=0x7f4ab801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:08.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac7fff640 1 -- 172.21.15.88:0/2359624045 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80ab660 con 0x7f4ad00d0040 2023-11-20T07:02:08.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac7fff640 1 -- 172.21.15.88:0/2359624045 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab80b4800 con 0x7f4ad00d0040 2023-11-20T07:02:08.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ad57c4640 1 -- 172.21.15.88:0/2359624045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad0154eb0 con 0x7f4ad00d0040 2023-11-20T07:02:08.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac7fff640 1 -- 172.21.15.88:0/2359624045 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80b4bb0 con 0x7f4ad00d0040 2023-11-20T07:02:08.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ad57c4640 1 -- 172.21.15.88:0/2359624045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad00cc1a0 con 0x7f4ad00d0040 2023-11-20T07:02:08.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ad57c4640 1 -- 172.21.15.88:0/2359624045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad004e170 con 0x7f4ad00d0040 2023-11-20T07:02:08.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.141+0000 7f4ac7fff640 1 -- 172.21.15.88:0/2359624045 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4ab80a9070 con 0x7f4ad00d0040 2023-11-20T07:02:08.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.145+0000 7f4ac7fff640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4ab00664d0 0x7f4ab0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:08.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.145+0000 7f4ac7fff640 1 -- 172.21.15.88:0/2359624045 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f4ab811e630 con 0x7f4ad00d0040 2023-11-20T07:02:08.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.145+0000 7f4aceffd640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4ab00664d0 0x7f4ab0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:08.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.145+0000 7f4aceffd640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4ab00664d0 0x7f4ab0068990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00d1430 tx=0x7f4ac000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:08.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.149+0000 7f4ac7fff640 1 -- 172.21.15.88:0/2359624045 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4ab80eb7d0 con 0x7f4ad00d0040 2023-11-20T07:02:08.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.329+0000 7f4ad57c4640 1 -- 172.21.15.88:0/2359624045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4ad00cfdd0 con 0x7f4ad00d0040 2023-11-20T07:02:08.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.973+0000 7f4ac7fff640 1 -- 172.21.15.88:0/2359624045 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4ab80eedf0 con 0x7f4ad00d0040 2023-11-20T07:02:08.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.977+0000 7f4ad57c4640 1 -- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4ab00664d0 msgr2=0x7f4ab0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:08.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.977+0000 7f4ad57c4640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4ab00664d0 0x7f4ab0068990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00d1430 tx=0x7f4ac000b040 comp rx=0 tx=0).stop 2023-11-20T07:02:08.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.977+0000 7f4ad57c4640 1 -- 172.21.15.88:0/2359624045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ad00d0040 msgr2=0x7f4ad00cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.977+0000 7f4ad57c4640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ad00d0040 0x7f4ad00cb120 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4ab801a170 tx=0x7f4ab801ad80 comp rx=0 tx=0).stop 2023-11-20T07:02:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.977+0000 7f4ad57c4640 1 -- 172.21.15.88:0/2359624045 shutdown_connections 2023-11-20T07:02:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.977+0000 7f4ad57c4640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4ab00664d0 0x7f4ab0068990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.977+0000 7f4ad57c4640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad015cba0 0x7f4ad00cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:08.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.977+0000 7f4ad57c4640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ad00d0040 0x7f4ad00cb120 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:08.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.977+0000 7f4ad57c4640 1 --2- 172.21.15.88:0/2359624045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad00b84e0 0x7f4ad014dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:08.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.977+0000 7f4ad57c4640 1 -- 172.21.15.88:0/2359624045 >> 172.21.15.88:0/2359624045 conn(0x7f4ad00719c0 msgr2=0x7f4ad00b76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:08.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.977+0000 7f4ad57c4640 1 -- 172.21.15.88:0/2359624045 shutdown_connections 2023-11-20T07:02:08.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:08.977+0000 7f4ad57c4640 1 -- 172.21.15.88:0/2359624045 wait complete. 2023-11-20T07:02:09.001 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-20T07:02:09.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a16b72640 1 Processor -- start 2023-11-20T07:02:09.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a16b72640 1 -- start start 2023-11-20T07:02:09.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a16b72640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7a100b1c60 0x7f7a100cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:09.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a16b72640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a100cb360 0x7f7a100c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:09.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a16b72640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1015e5f0 con 0x7f7a101441a0 2023-11-20T07:02:09.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a16b72640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1015e8d0 con 0x7f7a100b1c60 2023-11-20T07:02:09.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a16b72640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1015ebb0 con 0x7f7a100cb360 2023-11-20T07:02:09.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a1510f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a100cb360 0x7f7a100c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:09.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a0ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7a100b1c60 0x7f7a100cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:09.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a1510f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a100cb360 0x7f7a100c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:35788/0 (socket says 172.21.15.88:35788) 2023-11-20T07:02:09.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a1510f640 1 -- 172.21.15.88:0/2692014587 learned_addr learned my addr 172.21.15.88:0/2692014587 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:09.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a1490e640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7a101441a0 0x7f7a100b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:55818/0 (socket says 172.21.15.88:55818) 2023-11-20T07:02:09.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a0f7fe640 1 -- 172.21.15.88:0/2692014587 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428866609 0 0) 0x7f7a1015e5f0 con 0x7f7a101441a0 2023-11-20T07:02:09.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a1510f640 1 -- 172.21.15.88:0/2692014587 >> v2:172.21.15.175:3300/0 conn(0x7f7a100b1c60 msgr2=0x7f7a100cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:09.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a1510f640 1 --2- 172.21.15.88:0/2692014587 >> v2:172.21.15.175:3300/0 conn(0x7f7a100b1c60 0x7f7a100cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:09.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a1510f640 1 -- 172.21.15.88:0/2692014587 >> v1:172.21.15.175:6789/0 conn(0x7f7a101441a0 legacy=0x7f7a100b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:09.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.145+0000 7f7a1510f640 1 -- 172.21.15.88:0/2692014587 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1015ee90 con 0x7f7a100cb360 2023-11-20T07:02:09.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.149+0000 7f7a1510f640 1 --2- 172.21.15.88:0/2692014587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a100cb360 0x7f7a100c8fc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009e50 tx=0x7f7a0801ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bc5c79b3c51aa2f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:09.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.149+0000 7f7a0f7fe640 1 -- 172.21.15.88:0/2692014587 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080a5700 con 0x7f7a100cb360 2023-11-20T07:02:09.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.149+0000 7f7a0f7fe640 1 -- 172.21.15.88:0/2692014587 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a080a5860 con 0x7f7a100cb360 2023-11-20T07:02:09.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.149+0000 7f7a0f7fe640 1 -- 172.21.15.88:0/2692014587 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a080a5bf0 con 0x7f7a100cb360 2023-11-20T07:02:09.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.149+0000 7f7a16b72640 1 -- 172.21.15.88:0/2692014587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a100cb360 msgr2=0x7f7a100c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:09.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.149+0000 7f7a16b72640 1 --2- 172.21.15.88:0/2692014587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a100cb360 0x7f7a100c8fc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009e50 tx=0x7f7a0801ca10 comp rx=0 tx=0).stop 2023-11-20T07:02:09.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.149+0000 7f7a16b72640 1 -- 172.21.15.88:0/2692014587 shutdown_connections 2023-11-20T07:02:09.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.149+0000 7f7a16b72640 1 --2- 172.21.15.88:0/2692014587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a100cb360 0x7f7a100c8fc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:09.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.149+0000 7f7a16b72640 1 --2- 172.21.15.88:0/2692014587 >> v2:172.21.15.175:3300/0 conn(0x7f7a100b1c60 0x7f7a100cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:09.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.149+0000 7f7a16b72640 1 -- 172.21.15.88:0/2692014587 >> 172.21.15.88:0/2692014587 conn(0x7f7a1006a820 msgr2=0x7f7a100b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:09.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.149+0000 7f7a16b72640 1 -- 172.21.15.88:0/2692014587 shutdown_connections 2023-11-20T07:02:09.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.149+0000 7f7a16b72640 1 -- 172.21.15.88:0/2692014587 wait complete. 2023-11-20T07:02:09.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a16b72640 1 Processor -- start 2023-11-20T07:02:09.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a16b72640 1 -- start start 2023-11-20T07:02:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a16b72640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a100b1c60 0x7f7a10134af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a16b72640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a100cb360 0x7f7a10154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:09.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a16b72640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a101441a0 0x7f7a10157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a16b72640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10135030 con 0x7f7a100b1c60 2023-11-20T07:02:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a16b72640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10155370 con 0x7f7a101441a0 2023-11-20T07:02:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a16b72640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10157cf0 con 0x7f7a100cb360 2023-11-20T07:02:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a1490e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a100b1c60 0x7f7a10134af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a1490e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a100b1c60 0x7f7a10134af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59144/0 (socket says 172.21.15.88:59144) 2023-11-20T07:02:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a1490e640 1 -- 172.21.15.88:0/1565111989 learned_addr learned my addr 172.21.15.88:0/1565111989 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a1510f640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a101441a0 0x7f7a10157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a0ffff640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a100cb360 0x7f7a10154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a1490e640 1 -- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a100cb360 msgr2=0x7f7a10154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a1490e640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a100cb360 0x7f7a10154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a1490e640 1 -- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a101441a0 msgr2=0x7f7a10157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a1490e640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a101441a0 0x7f7a10157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a1490e640 1 -- 172.21.15.88:0/1565111989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08009b30 con 0x7f7a100b1c60 2023-11-20T07:02:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a1510f640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a101441a0 0x7f7a10157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a1490e640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a100b1c60 0x7f7a10134af0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400c410 tx=0x7f7a0400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a0d7fa640 1 -- 172.21.15.88:0/1565111989 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a040074e0 con 0x7f7a100b1c60 2023-11-20T07:02:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a0d7fa640 1 -- 172.21.15.88:0/1565111989 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a04007640 con 0x7f7a100b1c60 2023-11-20T07:02:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a0d7fa640 1 -- 172.21.15.88:0/1565111989 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04004a30 con 0x7f7a100b1c60 2023-11-20T07:02:09.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a16b72640 1 -- 172.21.15.88:0/1565111989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a10157a10 con 0x7f7a100b1c60 2023-11-20T07:02:09.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.153+0000 7f7a16b72640 1 -- 172.21.15.88:0/1565111989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a10151f10 con 0x7f7a100b1c60 2023-11-20T07:02:09.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.157+0000 7f7a16b72640 1 -- 172.21.15.88:0/1565111989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1004e170 con 0x7f7a100b1c60 2023-11-20T07:02:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.157+0000 7f7a0d7fa640 1 -- 172.21.15.88:0/1565111989 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7a04004b90 con 0x7f7a100b1c60 2023-11-20T07:02:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.157+0000 7f7a0d7fa640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f79f40664a0 0x7f79f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.157+0000 7f7a0d7fa640 1 -- 172.21.15.88:0/1565111989 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f7a04083c50 con 0x7f7a100b1c60 2023-11-20T07:02:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.157+0000 7f7a0ffff640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f79f40664a0 0x7f79f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:09.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.157+0000 7f7a0ffff640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f79f40664a0 0x7f79f4068960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a1015a140 tx=0x7f79fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:09.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.161+0000 7f7a0d7fa640 1 -- 172.21.15.88:0/1565111989 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7a04050cb0 con 0x7f7a100b1c60 2023-11-20T07:02:09.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.313+0000 7f7a16b72640 1 -- 172.21.15.88:0/1565111989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7a100c86c0 con 0x7f7a100b1c60 2023-11-20T07:02:09.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.981+0000 7f7a0d7fa640 1 -- 172.21.15.88:0/1565111989 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7a040542d0 con 0x7f7a100b1c60 2023-11-20T07:02:09.982 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2023-11-20T07:02:09.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.981+0000 7f7a16b72640 1 -- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f79f40664a0 msgr2=0x7f79f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.981+0000 7f7a16b72640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f79f40664a0 0x7f79f4068960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a1015a140 tx=0x7f79fc008040 comp rx=0 tx=0).stop 2023-11-20T07:02:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.981+0000 7f7a16b72640 1 -- 172.21.15.88:0/1565111989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a100b1c60 msgr2=0x7f7a10134af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.981+0000 7f7a16b72640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a100b1c60 0x7f7a10134af0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400c410 tx=0x7f7a0400c8d0 comp rx=0 tx=0).stop 2023-11-20T07:02:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.985+0000 7f7a16b72640 1 -- 172.21.15.88:0/1565111989 shutdown_connections 2023-11-20T07:02:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.985+0000 7f7a16b72640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f79f40664a0 0x7f79f4068960 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.985+0000 7f7a16b72640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a100cb360 0x7f7a10154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.985+0000 7f7a16b72640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a101441a0 0x7f7a10157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.985+0000 7f7a16b72640 1 --2- 172.21.15.88:0/1565111989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a100b1c60 0x7f7a10134af0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.985+0000 7f7a16b72640 1 -- 172.21.15.88:0/1565111989 >> 172.21.15.88:0/1565111989 conn(0x7f7a1006a820 msgr2=0x7f7a100b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.985+0000 7f7a16b72640 1 -- 172.21.15.88:0/1565111989 shutdown_connections 2023-11-20T07:02:09.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:09.985+0000 7f7a16b72640 1 -- 172.21.15.88:0/1565111989 wait complete. 2023-11-20T07:02:10.012 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-20T07:02:10.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.153+0000 7f60a1f3e640 1 Processor -- start 2023-11-20T07:02:10.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f60a1f3e640 1 -- start start 2023-11-20T07:02:10.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f60a1f3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f609c0b1c60 0x7f609c0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:10.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f60a1f3e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f609c0cb360 0x7f609c0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:10.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f60a1f3e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c15e5f0 con 0x7f609c1441a0 2023-11-20T07:02:10.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f60a1f3e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c15e8d0 con 0x7f609c0cb360 2023-11-20T07:02:10.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f60a1f3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c15ebb0 con 0x7f609c0b1c60 2023-11-20T07:02:10.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f609bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f609c0cb360 0x7f609c0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:10.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f609bfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f609c0cb360 0x7f609c0c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59152/0 (socket says 172.21.15.88:59152) 2023-11-20T07:02:10.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f609bfff640 1 -- 172.21.15.88:0/1786103387 learned_addr learned my addr 172.21.15.88:0/1786103387 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:10.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f609affd640 1 --2- 172.21.15.88:0/1786103387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f609c0b1c60 0x7f609c0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:10.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f609bfff640 1 -- 172.21.15.88:0/1786103387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f609c0b1c60 msgr2=0x7f609c0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:10.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f609bfff640 1 --2- 172.21.15.88:0/1786103387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f609c0b1c60 0x7f609c0cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:10.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f609bfff640 1 -- 172.21.15.88:0/1786103387 >> v1:172.21.15.175:6789/0 conn(0x7f609c1441a0 legacy=0x7f609c0b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:10.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.157+0000 7f609bfff640 1 -- 172.21.15.88:0/1786103387 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c15ee90 con 0x7f609c0cb360 2023-11-20T07:02:10.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f609bfff640 1 --2- 172.21.15.88:0/1786103387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c0cb360 0x7f609c0c8fc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6094009e50 tx=0x7f609401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8744ec3f5f06ec3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:10.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f609a7fc640 1 -- 172.21.15.88:0/1786103387 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60940a57f0 con 0x7f609c0cb360 2023-11-20T07:02:10.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f609a7fc640 1 -- 172.21.15.88:0/1786103387 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60940a5950 con 0x7f609c0cb360 2023-11-20T07:02:10.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f609a7fc640 1 -- 172.21.15.88:0/1786103387 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60940a5ce0 con 0x7f609c0cb360 2023-11-20T07:02:10.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1786103387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c0cb360 msgr2=0x7f609c0c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:10.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f60a1f3e640 1 --2- 172.21.15.88:0/1786103387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c0cb360 0x7f609c0c8fc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6094009e50 tx=0x7f609401ca10 comp rx=0 tx=0).stop 2023-11-20T07:02:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1786103387 shutdown_connections 2023-11-20T07:02:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f60a1f3e640 1 --2- 172.21.15.88:0/1786103387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c0cb360 0x7f609c0c8fc0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f60a1f3e640 1 --2- 172.21.15.88:0/1786103387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f609c0b1c60 0x7f609c0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1786103387 >> 172.21.15.88:0/1786103387 conn(0x7f609c06a820 msgr2=0x7f609c0b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1786103387 shutdown_connections 2023-11-20T07:02:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1786103387 wait complete. 2023-11-20T07:02:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f60a1f3e640 1 Processor -- start 2023-11-20T07:02:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.161+0000 7f60a1f3e640 1 -- start start 2023-11-20T07:02:10.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f60a1f3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f609c0b1c60 0x7f609c13da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:10.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f60a1f3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c0cb360 0x7f609c13aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f60a1f3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c1441a0 0x7f609c1f8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f60a1f3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1576a0 con 0x7f609c0cb360 2023-11-20T07:02:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f60a1f3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c15c340 con 0x7f609c1441a0 2023-11-20T07:02:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f60a1f3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c143560 con 0x7f609c0b1c60 2023-11-20T07:02:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f609affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c0cb360 0x7f609c13aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f609affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c0cb360 0x7f609c13aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59158/0 (socket says 172.21.15.88:59158) 2023-11-20T07:02:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f609affd640 1 -- 172.21.15.88:0/1876246359 learned_addr learned my addr 172.21.15.88:0/1876246359 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f609b7fe640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f609c0b1c60 0x7f609c13da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f609bfff640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c1441a0 0x7f609c1f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f609affd640 1 -- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f609c0b1c60 msgr2=0x7f609c13da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f609affd640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f609c0b1c60 0x7f609c13da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f609affd640 1 -- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c1441a0 msgr2=0x7f609c1f8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f609affd640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c1441a0 0x7f609c1f8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f609affd640 1 -- 172.21.15.88:0/1876246359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6094009b30 con 0x7f609c0cb360 2023-11-20T07:02:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f609b7fe640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f609c0b1c60 0x7f609c13da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f609affd640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c0cb360 0x7f609c13aca0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f609000d800 tx=0x7f609000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f6083fff640 1 -- 172.21.15.88:0/1876246359 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609000b6c0 con 0x7f609c0cb360 2023-11-20T07:02:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f6083fff640 1 -- 172.21.15.88:0/1876246359 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609000b820 con 0x7f609c0cb360 2023-11-20T07:02:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f6083fff640 1 -- 172.21.15.88:0/1876246359 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609000bb90 con 0x7f609c0cb360 2023-11-20T07:02:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1876246359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c156d00 con 0x7f609c0cb360 2023-11-20T07:02:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1876246359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c1572c0 con 0x7f609c0cb360 2023-11-20T07:02:10.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.165+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1876246359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c157910 con 0x7f609c0cb360 2023-11-20T07:02:10.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.169+0000 7f6083fff640 1 -- 172.21.15.88:0/1876246359 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f609000bcf0 con 0x7f609c0cb360 2023-11-20T07:02:10.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.169+0000 7f6083fff640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f60880664a0 0x7f6088068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:10.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.169+0000 7f6083fff640 1 -- 172.21.15.88:0/1876246359 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f6090084570 con 0x7f609c0cb360 2023-11-20T07:02:10.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.169+0000 7f609b7fe640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f60880664a0 0x7f6088068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:10.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.169+0000 7f609b7fe640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f60880664a0 0x7f6088068960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f608c000f70 tx=0x7f608c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:10.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.173+0000 7f6083fff640 1 -- 172.21.15.88:0/1876246359 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6090051780 con 0x7f609c0cb360 2023-11-20T07:02:10.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.345+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1876246359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f609c04e170 con 0x7f609c0cb360 2023-11-20T07:02:10.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f6083fff640 1 -- 172.21.15.88:0/1876246359 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6090054da0 con 0x7f609c0cb360 2023-11-20T07:02:10.984 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2023-11-20T07:02:10.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f60880664a0 msgr2=0x7f6088068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:10.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f60a1f3e640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f60880664a0 0x7f6088068960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f608c000f70 tx=0x7f608c009040 comp rx=0 tx=0).stop 2023-11-20T07:02:10.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1876246359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c0cb360 msgr2=0x7f609c13aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:10.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f60a1f3e640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c0cb360 0x7f609c13aca0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f609000d800 tx=0x7f609000dcc0 comp rx=0 tx=0).stop 2023-11-20T07:02:10.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1876246359 shutdown_connections 2023-11-20T07:02:10.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f60a1f3e640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f60880664a0 0x7f6088068960 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:10.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f60a1f3e640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c1441a0 0x7f609c1f8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:10.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f60a1f3e640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c0cb360 0x7f609c13aca0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:10.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f60a1f3e640 1 --2- 172.21.15.88:0/1876246359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f609c0b1c60 0x7f609c13da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:10.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1876246359 >> 172.21.15.88:0/1876246359 conn(0x7f609c06a820 msgr2=0x7f609c159970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:10.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1876246359 shutdown_connections 2023-11-20T07:02:10.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:10.985+0000 7f60a1f3e640 1 -- 172.21.15.88:0/1876246359 wait complete. 2023-11-20T07:02:11.015 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-11-20T07:02:11.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.157+0000 7fb724a79640 1 Processor -- start 2023-11-20T07:02:11.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.157+0000 7fb724a79640 1 -- start start 2023-11-20T07:02:11.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.161+0000 7fb724a79640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7200ccdb0 0x7fb7200cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:11.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.161+0000 7fb724a79640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7200cb940 con 0x7fb720153540 2023-11-20T07:02:11.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.161+0000 7fb724a79640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb720159510 con 0x7fb7200cb510 2023-11-20T07:02:11.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.161+0000 7fb724a79640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb720159790 con 0x7fb7200ccdb0 2023-11-20T07:02:11.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.161+0000 7fb717fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7200ccdb0 0x7fb7200cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:11.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.161+0000 7fb717fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7200ccdb0 0x7fb7200cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59166/0 (socket says 172.21.15.88:59166) 2023-11-20T07:02:11.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.161+0000 7fb71e59c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb720153540 0x7fb7200afaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48788/0 (socket says 172.21.15.88:48788) 2023-11-20T07:02:11.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.161+0000 7fb717fff640 1 -- 172.21.15.88:0/3873204084 learned_addr learned my addr 172.21.15.88:0/3873204084 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:11.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.161+0000 7fb717fff640 1 -- 172.21.15.88:0/3873204084 >> v1:172.21.15.175:6789/0 conn(0x7fb7200cb510 legacy=0x7fb72015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:11.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.161+0000 7fb717fff640 1 -- 172.21.15.88:0/3873204084 >> v1:172.21.15.88:6789/0 conn(0x7fb720153540 legacy=0x7fb7200afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:11.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.161+0000 7fb717fff640 1 -- 172.21.15.88:0/3873204084 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720159a70 con 0x7fb7200ccdb0 2023-11-20T07:02:11.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.161+0000 7fb71dd9b640 1 -- 172.21.15.88:0/3873204084 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106283406 0 0) 0x7fb7200cb940 con 0x7fb720153540 2023-11-20T07:02:11.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb717fff640 1 --2- 172.21.15.88:0/3873204084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7200ccdb0 0x7fb7200cafd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb708009870 tx=0x7fb70801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6725ea7eb7f6361d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb71dd9b640 1 -- 172.21.15.88:0/3873204084 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7080ab600 con 0x7fb7200ccdb0 2023-11-20T07:02:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb71dd9b640 1 -- 172.21.15.88:0/3873204084 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7080ab760 con 0x7fb7200ccdb0 2023-11-20T07:02:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb71dd9b640 1 -- 172.21.15.88:0/3873204084 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7080abaf0 con 0x7fb7200ccdb0 2023-11-20T07:02:11.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb724a79640 1 -- 172.21.15.88:0/3873204084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7200ccdb0 msgr2=0x7fb7200cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:11.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb724a79640 1 --2- 172.21.15.88:0/3873204084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7200ccdb0 0x7fb7200cafd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb708009870 tx=0x7fb70801c450 comp rx=0 tx=0).stop 2023-11-20T07:02:11.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb724a79640 1 -- 172.21.15.88:0/3873204084 shutdown_connections 2023-11-20T07:02:11.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb724a79640 1 --2- 172.21.15.88:0/3873204084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7200ccdb0 0x7fb7200cafd0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:11.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb724a79640 1 -- 172.21.15.88:0/3873204084 >> 172.21.15.88:0/3873204084 conn(0x7fb72006a820 msgr2=0x7fb7200b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:11.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb724a79640 1 -- 172.21.15.88:0/3873204084 shutdown_connections 2023-11-20T07:02:11.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb724a79640 1 -- 172.21.15.88:0/3873204084 wait complete. 2023-11-20T07:02:11.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb724a79640 1 Processor -- start 2023-11-20T07:02:11.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.165+0000 7fb724a79640 1 -- start start 2023-11-20T07:02:11.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb724a79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7200cb510 0x7fb720146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:11.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb724a79640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7200ccdb0 0x7fb720070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:11.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb724a79640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb720153540 0x7fb7200cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:11.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb724a79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb720070990 con 0x7fb7200cb510 2023-11-20T07:02:11.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb724a79640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb720071ec0 con 0x7fb720153540 2023-11-20T07:02:11.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb724a79640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb720070340 con 0x7fb7200ccdb0 2023-11-20T07:02:11.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb71e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7200cb510 0x7fb720146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:11.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb71e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7200cb510 0x7fb720146fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59178/0 (socket says 172.21.15.88:59178) 2023-11-20T07:02:11.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb71e59c640 1 -- 172.21.15.88:0/3282861025 learned_addr learned my addr 172.21.15.88:0/3282861025 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:11.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb717fff640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7200ccdb0 0x7fb720070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:11.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb71ed9d640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb720153540 0x7fb7200cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:11.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb71e59c640 1 -- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7200ccdb0 msgr2=0x7fb720070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:11.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb71e59c640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7200ccdb0 0x7fb720070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:11.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb71e59c640 1 -- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb720153540 msgr2=0x7fb7200cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:11.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb71e59c640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb720153540 0x7fb7200cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:11.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb71e59c640 1 -- 172.21.15.88:0/3282861025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7080094d0 con 0x7fb7200cb510 2023-11-20T07:02:11.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb71e59c640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7200cb510 0x7fb720146fd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb71000c410 tx=0x7fb71000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:11.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb716ffd640 1 -- 172.21.15.88:0/3282861025 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100074e0 con 0x7fb7200cb510 2023-11-20T07:02:11.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb716ffd640 1 -- 172.21.15.88:0/3282861025 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb710007660 con 0x7fb7200cb510 2023-11-20T07:02:11.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb716ffd640 1 -- 172.21.15.88:0/3282861025 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710004a30 con 0x7fb7200cb510 2023-11-20T07:02:11.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb724a79640 1 -- 172.21.15.88:0/3282861025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb720070620 con 0x7fb7200cb510 2023-11-20T07:02:11.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb724a79640 1 -- 172.21.15.88:0/3282861025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb720071360 con 0x7fb7200cb510 2023-11-20T07:02:11.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb724a79640 1 -- 172.21.15.88:0/3282861025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7200701a0 con 0x7fb7200cb510 2023-11-20T07:02:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.169+0000 7fb716ffd640 1 -- 172.21.15.88:0/3282861025 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb710004b90 con 0x7fb7200cb510 2023-11-20T07:02:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.173+0000 7fb716ffd640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7000664a0 0x7fb700068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.173+0000 7fb716ffd640 1 -- 172.21.15.88:0/3282861025 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fb7100838f0 con 0x7fb7200cb510 2023-11-20T07:02:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.173+0000 7fb717fff640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7000664a0 0x7fb700068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.173+0000 7fb717fff640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7000664a0 0x7fb700068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb7080af000 tx=0x7fb7080a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:11.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.177+0000 7fb716ffd640 1 -- 172.21.15.88:0/3282861025 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb7200701a0 con 0x7fb7200cb510 2023-11-20T07:02:11.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:11.325+0000 7fb724a79640 1 -- 172.21.15.88:0/3282861025 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb7200701a0 con 0x7fb7200cb510 2023-11-20T07:02:12.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.001+0000 7fb716ffd640 1 -- 172.21.15.88:0/3282861025 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7fb7200701a0 con 0x7fb7200cb510 2023-11-20T07:02:12.002 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data_ec' removed 2023-11-20T07:02:12.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.001+0000 7fb724a79640 1 -- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7000664a0 msgr2=0x7fb700068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:12.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.001+0000 7fb724a79640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7000664a0 0x7fb700068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb7080af000 tx=0x7fb7080a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.001+0000 7fb724a79640 1 -- 172.21.15.88:0/3282861025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7200cb510 msgr2=0x7fb720146fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.001+0000 7fb724a79640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7200cb510 0x7fb720146fd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb71000c410 tx=0x7fb71000c8d0 comp rx=0 tx=0).stop 2023-11-20T07:02:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.005+0000 7fb724a79640 1 -- 172.21.15.88:0/3282861025 shutdown_connections 2023-11-20T07:02:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.005+0000 7fb724a79640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb7000664a0 0x7fb700068960 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.005+0000 7fb724a79640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7200ccdb0 0x7fb720070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.005+0000 7fb724a79640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb720153540 0x7fb7200cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.005+0000 7fb724a79640 1 --2- 172.21.15.88:0/3282861025 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7200cb510 0x7fb720146fd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.005+0000 7fb724a79640 1 -- 172.21.15.88:0/3282861025 >> 172.21.15.88:0/3282861025 conn(0x7fb72006a820 msgr2=0x7fb7200c78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.005+0000 7fb724a79640 1 -- 172.21.15.88:0/3282861025 shutdown_connections 2023-11-20T07:02:12.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.005+0000 7fb724a79640 1 -- 172.21.15.88:0/3282861025 wait complete. 2023-11-20T07:02:12.029 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-20T07:02:12.029 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-20T07:02:12.029 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-20T07:02:12.029 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:02:12.030 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-20T07:02:12.030 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-20T07:02:12.030 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-20T07:02:12.030 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:02:12.030 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-20T07:02:12.030 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-20T07:02:12.031 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-20T07:02:12.031 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:02:12.031 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-20T07:02:12.031 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-20T07:02:12.031 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-20T07:02:12.031 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:02:12.044 INFO:tasks.ceph.mds.a:Stopped 2023-11-20T07:02:12.044 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-20T07:02:12.045 INFO:tasks.ceph.mds.c:Stopped 2023-11-20T07:02:12.045 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-20T07:02:12.046 INFO:tasks.ceph.mds.b:Stopped 2023-11-20T07:02:12.046 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-20T07:02:12.047 INFO:tasks.ceph.mds.d:Stopped 2023-11-20T07:02:12.047 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-20T07:02:12.094 INFO:tasks.ceph.mds.b:Started 2023-11-20T07:02:12.094 DEBUG:teuthology.parallel:result is None 2023-11-20T07:02:12.095 INFO:tasks.ceph.mds.a:Started 2023-11-20T07:02:12.095 DEBUG:teuthology.parallel:result is None 2023-11-20T07:02:12.095 INFO:tasks.ceph.mds.d:Started 2023-11-20T07:02:12.096 DEBUG:teuthology.parallel:result is None 2023-11-20T07:02:12.096 INFO:tasks.ceph.mds.c:Started 2023-11-20T07:02:12.097 DEBUG:teuthology.parallel:result is None 2023-11-20T07:02:12.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-20T07:02:12.183 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-11-20T07:02:12.183 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-11-20T07:02:12.184 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-11-20T07:02:12.184 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-11-20T07:02:12.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4dd980640 1 Processor -- start 2023-11-20T07:02:12.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4dd980640 1 -- start start 2023-11-20T07:02:12.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4dd980640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d815cf00 0x7fc4d80cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:12.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4dd980640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d80ce340 con 0x7fc4d80d1410 2023-11-20T07:02:12.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4dd980640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d80d1930 con 0x7fc4d80cdee0 2023-11-20T07:02:12.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4dd980640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d815d2e0 con 0x7fc4d815cf00 2023-11-20T07:02:12.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4d77fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc4d80d1410 0x7fc4d80b6650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48818/0 (socket says 172.21.15.88:48818) 2023-11-20T07:02:12.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4d77fe640 1 -- 172.21.15.88:0/2418497316 learned_addr learned my addr 172.21.15.88:0/2418497316 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:12.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4d6ffd640 1 --2- 172.21.15.88:0/2418497316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d815cf00 0x7fc4d80cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:12.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4d67fc640 1 -- 172.21.15.88:0/2418497316 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491842871 0 0) 0x7fc4d80ce340 con 0x7fc4d80d1410 2023-11-20T07:02:12.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4d67fc640 1 -- 172.21.15.88:0/2418497316 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4c4003530 con 0x7fc4d80d1410 2023-11-20T07:02:12.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4d67fc640 1 -- 172.21.15.88:0/2418497316 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909304927 0 0) 0x7fc4d80d1930 con 0x7fc4d80cdee0 2023-11-20T07:02:12.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4d67fc640 1 -- 172.21.15.88:0/2418497316 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4d80ce340 con 0x7fc4d80cdee0 2023-11-20T07:02:12.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4d6ffd640 1 -- 172.21.15.88:0/2418497316 >> v1:172.21.15.175:6789/0 conn(0x7fc4d80cdee0 legacy=0x7fc4d80d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:12.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4d6ffd640 1 -- 172.21.15.88:0/2418497316 >> v1:172.21.15.88:6789/0 conn(0x7fc4d80d1410 legacy=0x7fc4d80b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:12.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.245+0000 7fc4d6ffd640 1 -- 172.21.15.88:0/2418497316 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d80d1c10 con 0x7fc4d815cf00 2023-11-20T07:02:12.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.249+0000 7fc4d6ffd640 1 --2- 172.21.15.88:0/2418497316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d815cf00 0x7fc4d80cd9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80097f0 tx=0x7fc4c801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b539be3fef0e8595 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:12.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.249+0000 7fc4d67fc640 1 -- 172.21.15.88:0/2418497316 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80a7070 con 0x7fc4d815cf00 2023-11-20T07:02:12.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.249+0000 7fc4d67fc640 1 -- 172.21.15.88:0/2418497316 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c80ab430 con 0x7fc4d815cf00 2023-11-20T07:02:12.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.249+0000 7fc4d67fc640 1 -- 172.21.15.88:0/2418497316 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80ab7c0 con 0x7fc4d815cf00 2023-11-20T07:02:12.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.249+0000 7fc4dd980640 1 -- 172.21.15.88:0/2418497316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d815cf00 msgr2=0x7fc4d80cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:12.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.249+0000 7fc4dd980640 1 --2- 172.21.15.88:0/2418497316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d815cf00 0x7fc4d80cd9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80097f0 tx=0x7fc4c801c430 comp rx=0 tx=0).stop 2023-11-20T07:02:12.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.249+0000 7fc4dd980640 1 -- 172.21.15.88:0/2418497316 shutdown_connections 2023-11-20T07:02:12.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.249+0000 7fc4dd980640 1 --2- 172.21.15.88:0/2418497316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d815cf00 0x7fc4d80cd9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:12.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.249+0000 7fc4dd980640 1 -- 172.21.15.88:0/2418497316 >> 172.21.15.88:0/2418497316 conn(0x7fc4d80b4470 msgr2=0x7fc4d80b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:12.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.249+0000 7fc4dd980640 1 -- 172.21.15.88:0/2418497316 shutdown_connections 2023-11-20T07:02:12.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.249+0000 7fc4dd980640 1 -- 172.21.15.88:0/2418497316 wait complete. 2023-11-20T07:02:12.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4dd980640 1 Processor -- start 2023-11-20T07:02:12.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4dd980640 1 -- start start 2023-11-20T07:02:12.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4dd980640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d80cdee0 0x7fc4d815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4dd980640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d80d1410 0x7fc4d814d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4dd980640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4d815cf00 0x7fc4d814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4dd980640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d814cb50 con 0x7fc4d80d1410 2023-11-20T07:02:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4dd980640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d80cc600 con 0x7fc4d815cf00 2023-11-20T07:02:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4dd980640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d80b2d70 con 0x7fc4d80cdee0 2023-11-20T07:02:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4cffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d80d1410 0x7fc4d814d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4cffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d80d1410 0x7fc4d814d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59216/0 (socket says 172.21.15.88:59216) 2023-11-20T07:02:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4cffff640 1 -- 172.21.15.88:0/895902531 learned_addr learned my addr 172.21.15.88:0/895902531 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4d6ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d80cdee0 0x7fc4d815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4d77fe640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4d815cf00 0x7fc4d814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4cffff640 1 -- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d80cdee0 msgr2=0x7fc4d815c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:12.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4cffff640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d80cdee0 0x7fc4d815c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4cffff640 1 -- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4d815cf00 msgr2=0x7fc4d814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4cffff640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4d815cf00 0x7fc4d814ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4cffff640 1 -- 172.21.15.88:0/895902531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c8009420 con 0x7fc4d80d1410 2023-11-20T07:02:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4cffff640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d80d1410 0x7fc4d814d8e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000c530 tx=0x7fc4c000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4d4ff9640 1 -- 172.21.15.88:0/895902531 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00052d0 con 0x7fc4d80d1410 2023-11-20T07:02:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4d4ff9640 1 -- 172.21.15.88:0/895902531 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c0005450 con 0x7fc4d80d1410 2023-11-20T07:02:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4dd980640 1 -- 172.21.15.88:0/895902531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d8153fa0 con 0x7fc4d80d1410 2023-11-20T07:02:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4d4ff9640 1 -- 172.21.15.88:0/895902531 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0012870 con 0x7fc4d80d1410 2023-11-20T07:02:12.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.253+0000 7fc4dd980640 1 -- 172.21.15.88:0/895902531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d814c740 con 0x7fc4d80d1410 2023-11-20T07:02:12.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.257+0000 7fc4dd980640 1 -- 172.21.15.88:0/895902531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d8074010 con 0x7fc4d80d1410 2023-11-20T07:02:12.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.257+0000 7fc4d4ff9640 1 -- 172.21.15.88:0/895902531 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc4c00129d0 con 0x7fc4d80d1410 2023-11-20T07:02:12.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.257+0000 7fc4d4ff9640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc4b80664d0 0x7fc4b8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:12.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.257+0000 7fc4d4ff9640 1 -- 172.21.15.88:0/895902531 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc4c0083760 con 0x7fc4d80d1410 2023-11-20T07:02:12.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.257+0000 7fc4d6ffd640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc4b80664d0 0x7fc4b8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:12.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.257+0000 7fc4d6ffd640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc4b80664d0 0x7fc4b8068990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80af000 tx=0x7fc4c80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:12.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.261+0000 7fc4d4ff9640 1 -- 172.21.15.88:0/895902531 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc4c0050e70 con 0x7fc4d80d1410 2023-11-20T07:02:12.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:12.421+0000 7fc4dd980640 1 -- 172.21.15.88:0/895902531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc4d80ced60 con 0x7fc4d80d1410 2023-11-20T07:02:13.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.013+0000 7fc4d4ff9640 1 -- 172.21.15.88:0/895902531 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc4c0054490 con 0x7fc4d80d1410 2023-11-20T07:02:13.014 INFO:teuthology.orchestra.run.smithi088.stderr: removed all blocklist entries 2023-11-20T07:02:13.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.013+0000 7fc4dd980640 1 -- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc4b80664d0 msgr2=0x7fc4b8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.013+0000 7fc4dd980640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc4b80664d0 0x7fc4b8068990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80af000 tx=0x7fc4c80a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:13.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.013+0000 7fc4dd980640 1 -- 172.21.15.88:0/895902531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d80d1410 msgr2=0x7fc4d814d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.013+0000 7fc4dd980640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d80d1410 0x7fc4d814d8e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000c530 tx=0x7fc4c000c9f0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.013+0000 7fc4dd980640 1 -- 172.21.15.88:0/895902531 shutdown_connections 2023-11-20T07:02:13.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.013+0000 7fc4dd980640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc4b80664d0 0x7fc4b8068990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.013+0000 7fc4dd980640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4d815cf00 0x7fc4d814ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.013+0000 7fc4dd980640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d80d1410 0x7fc4d814d8e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.013+0000 7fc4dd980640 1 --2- 172.21.15.88:0/895902531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d80cdee0 0x7fc4d815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.017+0000 7fc4dd980640 1 -- 172.21.15.88:0/895902531 >> 172.21.15.88:0/895902531 conn(0x7fc4d80b4470 msgr2=0x7fc4d80d24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:13.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.017+0000 7fc4dd980640 1 -- 172.21.15.88:0/895902531 shutdown_connections 2023-11-20T07:02:13.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.017+0000 7fc4dd980640 1 -- 172.21.15.88:0/895902531 wait complete. 2023-11-20T07:02:13.039 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-20T07:02:13.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.173+0000 7f86865aa640 1 Processor -- start 2023-11-20T07:02:13.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.173+0000 7f86865aa640 1 -- start start 2023-11-20T07:02:13.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f86865aa640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8680159ba0 0x7f86800cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f86865aa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86800c8cb0 0x7f86800cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f86865aa640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86800723d0 con 0x7f86801597c0 2023-11-20T07:02:13.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f86865aa640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86800717c0 con 0x7f8680159ba0 2023-11-20T07:02:13.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f86865aa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8680071aa0 con 0x7f86800c8cb0 2023-11-20T07:02:13.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f867f7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8680159ba0 0x7f86800cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f8684b47640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86800c8cb0 0x7f86800cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f867f7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8680159ba0 0x7f86800cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:56166/0 (socket says 172.21.15.88:56166) 2023-11-20T07:02:13.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f867f7fe640 1 -- 172.21.15.88:0/4046964290 learned_addr learned my addr 172.21.15.88:0/4046964290 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:13.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f867f7fe640 1 -- 172.21.15.88:0/4046964290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86800c8cb0 msgr2=0x7f86800cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:13.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f867f7fe640 1 --2- 172.21.15.88:0/4046964290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86800c8cb0 0x7f86800cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f867f7fe640 1 -- 172.21.15.88:0/4046964290 >> v1:172.21.15.175:6789/0 conn(0x7f86801597c0 legacy=0x7f86800ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.177+0000 7f867f7fe640 1 -- 172.21.15.88:0/4046964290 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680071d80 con 0x7f8680159ba0 2023-11-20T07:02:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f867f7fe640 1 --2- 172.21.15.88:0/4046964290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8680159ba0 0x7f86800cae10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8674009870 tx=0x7f867401e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91455f61fddf18e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f867effd640 1 -- 172.21.15.88:0/4046964290 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740a8690 con 0x7f8680159ba0 2023-11-20T07:02:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f867effd640 1 -- 172.21.15.88:0/4046964290 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86740a87f0 con 0x7f8680159ba0 2023-11-20T07:02:13.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f867effd640 1 -- 172.21.15.88:0/4046964290 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740a8b80 con 0x7f8680159ba0 2023-11-20T07:02:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f86865aa640 1 -- 172.21.15.88:0/4046964290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8680159ba0 msgr2=0x7f86800cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f86865aa640 1 --2- 172.21.15.88:0/4046964290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8680159ba0 0x7f86800cae10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8674009870 tx=0x7f867401e720 comp rx=0 tx=0).stop 2023-11-20T07:02:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f86865aa640 1 -- 172.21.15.88:0/4046964290 shutdown_connections 2023-11-20T07:02:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f86865aa640 1 --2- 172.21.15.88:0/4046964290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86800c8cb0 0x7f86800cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f86865aa640 1 --2- 172.21.15.88:0/4046964290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8680159ba0 0x7f86800cae10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f86865aa640 1 -- 172.21.15.88:0/4046964290 >> 172.21.15.88:0/4046964290 conn(0x7f868006c190 msgr2=0x7f868006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:13.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f86865aa640 1 -- 172.21.15.88:0/4046964290 shutdown_connections 2023-11-20T07:02:13.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f86865aa640 1 -- 172.21.15.88:0/4046964290 wait complete. 2023-11-20T07:02:13.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f86865aa640 1 Processor -- start 2023-11-20T07:02:13.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.181+0000 7f86865aa640 1 -- start start 2023-11-20T07:02:13.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f86865aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86800c8cb0 0x7f86800c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f86865aa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86801597c0 0x7f8680147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f86865aa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8680159ba0 0x7f86800c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f86865aa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86801523b0 con 0x7f86800c8cb0 2023-11-20T07:02:13.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f86865aa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8680152fa0 con 0x7f86801597c0 2023-11-20T07:02:13.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f86865aa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8680151df0 con 0x7f8680159ba0 2023-11-20T07:02:13.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86800c8cb0 0x7f86800c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86800c8cb0 0x7f86800c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59226/0 (socket says 172.21.15.88:59226) 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867ffff640 1 -- 172.21.15.88:0/4274411422 learned_addr learned my addr 172.21.15.88:0/4274411422 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f8684b47640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8680159ba0 0x7f86800c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867f7fe640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86801597c0 0x7f8680147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867ffff640 1 -- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8680159ba0 msgr2=0x7f86800c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867ffff640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8680159ba0 0x7f86800c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867ffff640 1 -- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86801597c0 msgr2=0x7f8680147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867ffff640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86801597c0 0x7f8680147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867ffff640 1 -- 172.21.15.88:0/4274411422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86740094d0 con 0x7f86800c8cb0 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867f7fe640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86801597c0 0x7f8680147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867ffff640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86800c8cb0 0x7f86800c6140 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f867000c500 tx=0x7f867000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867cff9640 1 -- 172.21.15.88:0/4274411422 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670005220 con 0x7f86800c8cb0 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867cff9640 1 -- 172.21.15.88:0/4274411422 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8670005380 con 0x7f86800c8cb0 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f86865aa640 1 -- 172.21.15.88:0/4274411422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86801520d0 con 0x7f86800c8cb0 2023-11-20T07:02:13.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867cff9640 1 -- 172.21.15.88:0/4274411422 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670007270 con 0x7f86800c8cb0 2023-11-20T07:02:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f86865aa640 1 -- 172.21.15.88:0/4274411422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8680147c90 con 0x7f86800c8cb0 2023-11-20T07:02:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f86865aa640 1 -- 172.21.15.88:0/4274411422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86801538d0 con 0x7f86800c8cb0 2023-11-20T07:02:13.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.185+0000 7f867cff9640 1 -- 172.21.15.88:0/4274411422 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f86700073d0 con 0x7f86800c8cb0 2023-11-20T07:02:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.189+0000 7f867cff9640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f866c0664a0 0x7f866c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.189+0000 7f867cff9640 1 -- 172.21.15.88:0/4274411422 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f86700835f0 con 0x7f86800c8cb0 2023-11-20T07:02:13.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.189+0000 7f867f7fe640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f866c0664a0 0x7f866c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.189+0000 7f867f7fe640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f866c0664a0 0x7f866c068960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f86740b0000 tx=0x7f86740a9000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:13.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.193+0000 7f867cff9640 1 -- 172.21.15.88:0/4274411422 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f86801538d0 con 0x7f86800c8cb0 2023-11-20T07:02:13.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.393+0000 7f86865aa640 1 -- 172.21.15.88:0/4274411422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f86801538d0 con 0x7f86800c8cb0 2023-11-20T07:02:13.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f867cff9640 1 -- 172.21.15.88:0/4274411422 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f8670050bf0 con 0x7f86800c8cb0 2023-11-20T07:02:13.396 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:13.397 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:02:13.397 INFO:teuthology.orchestra.run.smithi088.stdout: "auth_dump": [ 2023-11-20T07:02:13.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.397 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.a", 2023-11-20T07:02:13.397 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDkA1tl/y0WOxAAdq5wTKyfuOxiZ6Q8ckw93w==", 2023-11-20T07:02:13.397 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.397 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-11-20T07:02:13.397 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-11-20T07:02:13.397 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-11-20T07:02:13.397 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.397 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.398 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.b", 2023-11-20T07:02:13.398 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDlA1tlf+srDBAAf//Tdho9hIGFQtFDpTo0SQ==", 2023-11-20T07:02:13.398 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.398 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-11-20T07:02:13.398 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-11-20T07:02:13.398 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-11-20T07:02:13.398 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.398 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.c", 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDlA1tltEAEBxAAHgggAANkIKo2R8P4jjPrLw==", 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mds.d", 2023-11-20T07:02:13.399 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDlA1tlsOl+ExAADfD3GbTACjZ6Ha8LJ8o9CQ==", 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.0", 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDoA1tlezLgJxAASzvc82a86q2qZrMdetIz3A==", 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-11-20T07:02:13.400 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.1", 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDrA1tly9Y+LxAAthOefOOSsuhlefFMvvDWeg==", 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.402 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.2", 2023-11-20T07:02:13.402 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDuA1tl2Zc8NRAAx057Q19yRux8JAHdeuzKew==", 2023-11-20T07:02:13.402 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.402 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-11-20T07:02:13.402 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-11-20T07:02:13.402 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.402 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.402 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.3", 2023-11-20T07:02:13.402 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDxA1tlxXhbOxAAVexn3zBZ1Oqf7J+WOEZUYA==", 2023-11-20T07:02:13.402 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.4", 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQD4A1tlLWrfBhAA1QmzT7o5CzQeEvyr/ywVTg==", 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.404 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.5", 2023-11-20T07:02:13.404 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQD7A1tlGZo3DhAAHB9bpcv5h2QVXOUbUUVi1Q==", 2023-11-20T07:02:13.404 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.404 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-11-20T07:02:13.404 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-11-20T07:02:13.404 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.404 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.405 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.6", 2023-11-20T07:02:13.405 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQD+A1tlDXy/FBAA0Fj7D0H48hgjb1yoQW6tKA==", 2023-11-20T07:02:13.405 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.405 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-11-20T07:02:13.405 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-11-20T07:02:13.405 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.406 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.406 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "osd.7", 2023-11-20T07:02:13.406 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQABBFtlZJH2GxAA4orHS1ptWdKZVkrzdRT3sg==", 2023-11-20T07:02:13.406 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow profile osd", 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile osd", 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.0", 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDlA1tlJRZoFxAAjx3lxpd5CSyg4vcDb18mMQ==", 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow r", 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw", 2023-11-20T07:02:13.407 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rwx" 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.1", 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDlA1tlmFBNIRAAG3PLBIcfXgYsdDDiPyVHhg==", 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow r", 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw", 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rwx" 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.2", 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDlA1tlqdGfHRAAA14f+qcizfbitieltn5MPQ==", 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow r", 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw", 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rwx" 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.3", 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDlA1tlSkd5JxAAA8WgMlLOvlnG/dIdBPkngA==", 2023-11-20T07:02:13.409 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.410 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow", 2023-11-20T07:02:13.410 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow r", 2023-11-20T07:02:13.410 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow rw", 2023-11-20T07:02:13.410 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow rwx" 2023-11-20T07:02:13.410 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.410 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.admin", 2023-11-20T07:02:13.410 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDkA1tlUTG1HhAA69TXMVArfR6YrY6BxXbUxQ==", 2023-11-20T07:02:13.410 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.410 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-11-20T07:02:13.410 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": "allow *", 2023-11-20T07:02:13.411 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow *", 2023-11-20T07:02:13.411 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.411 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.412 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-mds", 2023-11-20T07:02:13.412 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQAMBFtl5b6hHhAAHCEs5GPZ4nHaRzxTs8z7Iw==", 2023-11-20T07:02:13.412 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.412 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-mds" 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-mgr", 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQAMBFtlcM2hHhAA9kQ/r1pM0+/hSJ6Ycpf6Lg==", 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-osd", 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQAMBFtl09uhHhAAP0J3WWKXhgHGjzYv0Evx8w==", 2023-11-20T07:02:13.413 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.414 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-osd" 2023-11-20T07:02:13.414 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.414 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rbd", 2023-11-20T07:02:13.414 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQAMBFtl3+ihHhAAjsgR2QdK5X+IwmRgTjaCUA==", 2023-11-20T07:02:13.414 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.414 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-20T07:02:13.414 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.414 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQAMBFtlVvehHhAAnuDGyyvsrZaM//ryl8hInA==", 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "client.bootstrap-rgw", 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQAMBFtl/wSiHhAATYQvr8MjirVE485QgT3WgQ==", 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.x", 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDkA1tlbeSlNhAA3Radpg9vlQ2jD1ES/Blvgg==", 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: "entity": "mgr.y", 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "AQDkA1tlZzunMhAA6Df88OUJQTIAvDGgyi0LFg==", 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: "caps": { 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": "allow *", 2023-11-20T07:02:13.416 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": "allow profile mgr", 2023-11-20T07:02:13.417 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": "allow *" 2023-11-20T07:02:13.417 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.417 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:13.417 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2023-11-20T07:02:13.417 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:02:13.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f86865aa640 1 -- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f866c0664a0 msgr2=0x7f866c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f86865aa640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f866c0664a0 0x7f866c068960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f86740b0000 tx=0x7f86740a9000 comp rx=0 tx=0).stop 2023-11-20T07:02:13.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f86865aa640 1 -- 172.21.15.88:0/4274411422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86800c8cb0 msgr2=0x7f86800c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f86865aa640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86800c8cb0 0x7f86800c6140 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f867000c500 tx=0x7f867000c9c0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f86865aa640 1 -- 172.21.15.88:0/4274411422 shutdown_connections 2023-11-20T07:02:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f86865aa640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f866c0664a0 0x7f866c068960 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f86865aa640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8680159ba0 0x7f86800c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f86865aa640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86801597c0 0x7f8680147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f86865aa640 1 --2- 172.21.15.88:0/4274411422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86800c8cb0 0x7f86800c6140 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f86865aa640 1 -- 172.21.15.88:0/4274411422 >> 172.21.15.88:0/4274411422 conn(0x7f868006c190 msgr2=0x7f86800cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f86865aa640 1 -- 172.21.15.88:0/4274411422 shutdown_connections 2023-11-20T07:02:13.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.397+0000 7f86865aa640 1 -- 172.21.15.88:0/4274411422 wait complete. 2023-11-20T07:02:13.419 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-20T07:02:13.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.557+0000 7f8ca9c6b640 1 Processor -- start 2023-11-20T07:02:13.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.557+0000 7f8ca9c6b640 1 -- start start 2023-11-20T07:02:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.557+0000 7f8ca9c6b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8ca40c8cb0 0x7f8ca40cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.557+0000 7f8ca9c6b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca40723d0 con 0x7f8ca41597c0 2023-11-20T07:02:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.557+0000 7f8ca9c6b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca40717c0 con 0x7f8ca4159ba0 2023-11-20T07:02:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.557+0000 7f8ca9c6b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca4071aa0 con 0x7f8ca40c8cb0 2023-11-20T07:02:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.557+0000 7f8ca37fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8ca41597c0 0x7f8ca40ad6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48826/0 (socket says 172.21.15.88:48826) 2023-11-20T07:02:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.557+0000 7f8ca37fe640 1 -- 172.21.15.88:0/1302382958 learned_addr learned my addr 172.21.15.88:0/1302382958 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:13.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca3fff640 1 --2- 172.21.15.88:0/1302382958 >> v2:172.21.15.175:3300/0 conn(0x7f8ca40c8cb0 0x7f8ca40cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503231208 0 0) 0x7f8ca40723d0 con 0x7f8ca41597c0 2023-11-20T07:02:13.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c8c003530 con 0x7f8ca41597c0 2023-11-20T07:02:13.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3785501784 0 0) 0x7f8c8c003530 con 0x7f8ca41597c0 2023-11-20T07:02:13.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 >> v2:172.21.15.175:3300/0 conn(0x7f8ca40c8cb0 msgr2=0x7f8ca40cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:13.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 --2- 172.21.15.88:0/1302382958 >> v2:172.21.15.175:3300/0 conn(0x7f8ca40c8cb0 0x7f8ca40cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 >> v1:172.21.15.175:6789/0 conn(0x7f8ca4159ba0 legacy=0x7f8ca40cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca4071d80 con 0x7f8ca41597c0 2023-11-20T07:02:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f8c94001680 con 0x7f8ca41597c0 2023-11-20T07:02:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 >> v1:172.21.15.88:6789/0 conn(0x7f8ca41597c0 legacy=0x7f8ca40ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 --2- 172.21.15.88:0/1302382958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c8c003980 0x7f8c8c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 --2- 172.21.15.88:0/1302382958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c8c0047d0 0x7f8c8c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 --2- 172.21.15.88:0/1302382958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c005190 0x7f8c8c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca4071aa0 con 0x7f8c8c0047d0 2023-11-20T07:02:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c00c030 con 0x7f8c8c005190 2023-11-20T07:02:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c00c1f0 con 0x7f8c8c003980 2023-11-20T07:02:13.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca2ffd640 1 --2- 172.21.15.88:0/1302382958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c8c0047d0 0x7f8c8c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca3fff640 1 --2- 172.21.15.88:0/1302382958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c005190 0x7f8c8c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca37fe640 1 --2- 172.21.15.88:0/1302382958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c8c003980 0x7f8c8c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca2ffd640 1 -- 172.21.15.88:0/1302382958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c8c003980 msgr2=0x7f8c8c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:13.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca2ffd640 1 --2- 172.21.15.88:0/1302382958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c8c003980 0x7f8c8c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca2ffd640 1 -- 172.21.15.88:0/1302382958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c005190 msgr2=0x7f8c8c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:13.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca2ffd640 1 --2- 172.21.15.88:0/1302382958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c005190 0x7f8c8c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca2ffd640 1 -- 172.21.15.88:0/1302382958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c003530 con 0x7f8c8c0047d0 2023-11-20T07:02:13.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.561+0000 7f8ca3fff640 1 -- 172.21.15.88:0/1302382958 reap_dead start 2023-11-20T07:02:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca2ffd640 1 --2- 172.21.15.88:0/1302382958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c8c0047d0 0x7f8c8c004c50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4159fb0 tx=0x7f8c9801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28baa91bca7ea186 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c980052d0 con 0x7f8c8c0047d0 2023-11-20T07:02:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c980a7050 con 0x7f8c8c0047d0 2023-11-20T07:02:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca27fc640 1 -- 172.21.15.88:0/1302382958 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98003600 con 0x7f8c8c0047d0 2023-11-20T07:02:13.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1302382958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c8c0047d0 msgr2=0x7f8c8c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca9c6b640 1 --2- 172.21.15.88:0/1302382958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c8c0047d0 0x7f8c8c004c50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4159fb0 tx=0x7f8c9801c380 comp rx=0 tx=0).stop 2023-11-20T07:02:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1302382958 shutdown_connections 2023-11-20T07:02:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca9c6b640 1 --2- 172.21.15.88:0/1302382958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c8c0047d0 0x7f8c8c004c50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1302382958 >> 172.21.15.88:0/1302382958 conn(0x7f8ca406c190 msgr2=0x7f8ca406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1302382958 shutdown_connections 2023-11-20T07:02:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1302382958 wait complete. 2023-11-20T07:02:13.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca9c6b640 1 Processor -- start 2023-11-20T07:02:13.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.565+0000 7f8ca9c6b640 1 -- start start 2023-11-20T07:02:13.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca9c6b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c0047d0 0x7f8ca41f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca9c6b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ca41ed9b0 0x7f8ca415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca9c6b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca41f0f60 0x7f8ca41f13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca9c6b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca415c2d0 con 0x7f8ca41f0f60 2023-11-20T07:02:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca9c6b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca41f1920 con 0x7f8c8c0047d0 2023-11-20T07:02:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca9c6b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40c66e0 con 0x7f8ca41ed9b0 2023-11-20T07:02:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca41f0f60 0x7f8ca41f13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca41f0f60 0x7f8ca41f13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59242/0 (socket says 172.21.15.88:59242) 2023-11-20T07:02:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca3fff640 1 -- 172.21.15.88:0/1718980194 learned_addr learned my addr 172.21.15.88:0/1718980194 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca37fe640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c0047d0 0x7f8ca41f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca2ffd640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ca41ed9b0 0x7f8ca415bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca3fff640 1 -- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ca41ed9b0 msgr2=0x7f8ca415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca3fff640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ca41ed9b0 0x7f8ca415bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca3fff640 1 -- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c0047d0 msgr2=0x7f8ca41f08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca3fff640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c0047d0 0x7f8ca41f08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca3fff640 1 -- 172.21.15.88:0/1718980194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca41ede30 con 0x7f8ca41f0f60 2023-11-20T07:02:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca37fe640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c0047d0 0x7f8ca41f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca3fff640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca41f0f60 0x7f8ca41f13e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40cdff0 tx=0x7f8c9c011790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8c8bfff640 1 -- 172.21.15.88:0/1718980194 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c00e040 con 0x7f8ca41f0f60 2023-11-20T07:02:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8c8bfff640 1 -- 172.21.15.88:0/1718980194 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c00f040 con 0x7f8ca41f0f60 2023-11-20T07:02:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8c8bfff640 1 -- 172.21.15.88:0/1718980194 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0079a0 con 0x7f8ca41f0f60 2023-11-20T07:02:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1718980194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca414d5c0 con 0x7f8ca41f0f60 2023-11-20T07:02:13.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1718980194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca40c5db0 con 0x7f8ca41f0f60 2023-11-20T07:02:13.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1718980194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca4074010 con 0x7f8ca41f0f60 2023-11-20T07:02:13.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.569+0000 7f8c8bfff640 1 -- 172.21.15.88:0/1718980194 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8c9c007b00 con 0x7f8ca41f0f60 2023-11-20T07:02:13.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.573+0000 7f8c8bfff640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8c900664d0 0x7f8c90068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.573+0000 7f8c8bfff640 1 -- 172.21.15.88:0/1718980194 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8c9c086280 con 0x7f8ca41f0f60 2023-11-20T07:02:13.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.573+0000 7f8ca37fe640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8c900664d0 0x7f8c90068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.573+0000 7f8ca37fe640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8c900664d0 0x7f8c90068990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8c94007cc0 tx=0x7f8c94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:13.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.577+0000 7f8c8bfff640 1 -- 172.21.15.88:0/1718980194 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8c9c053980 con 0x7f8ca41f0f60 2023-11-20T07:02:13.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.781+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1718980194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f8ca40c6820 con 0x7f8ca41f0f60 2023-11-20T07:02:13.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8c8bfff640 1 -- 172.21.15.88:0/1718980194 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8c9c056fa0 con 0x7f8ca41f0f60 2023-11-20T07:02:13.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8c900664d0 msgr2=0x7f8c90068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8ca9c6b640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8c900664d0 0x7f8c90068990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8c94007cc0 tx=0x7f8c94009040 comp rx=0 tx=0).stop 2023-11-20T07:02:13.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1718980194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca41f0f60 msgr2=0x7f8ca41f13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8ca9c6b640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca41f0f60 0x7f8ca41f13e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40cdff0 tx=0x7f8c9c011790 comp rx=0 tx=0).stop 2023-11-20T07:02:13.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1718980194 shutdown_connections 2023-11-20T07:02:13.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8ca9c6b640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8c900664d0 0x7f8c90068990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8ca9c6b640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ca41ed9b0 0x7f8ca415bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8ca9c6b640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca41f0f60 0x7f8ca41f13e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8ca9c6b640 1 --2- 172.21.15.88:0/1718980194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8c0047d0 0x7f8ca41f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1718980194 >> 172.21.15.88:0/1718980194 conn(0x7f8ca406c190 msgr2=0x7f8ca40aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:13.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1718980194 shutdown_connections 2023-11-20T07:02:13.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.785+0000 7f8ca9c6b640 1 -- 172.21.15.88:0/1718980194 wait complete. 2023-11-20T07:02:13.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-20T07:02:13.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f1475abb640 1 Processor -- start 2023-11-20T07:02:13.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f1475abb640 1 -- start start 2023-11-20T07:02:13.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f1475abb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f147015ab10 0x7f14700b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f1475abb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1470069e90 0x7f147006a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f1475abb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147006a820 con 0x7f14700b4480 2023-11-20T07:02:13.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f1475abb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147015aef0 con 0x7f147015ab10 2023-11-20T07:02:13.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f1475abb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14700c9620 con 0x7f1470069e90 2023-11-20T07:02:13.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f146ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1470069e90 0x7f147006a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f146f7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f147015ab10 0x7f14700b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f146f7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f147015ab10 0x7f14700b3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:56206/0 (socket says 172.21.15.88:56206) 2023-11-20T07:02:13.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f146f7fe640 1 -- 172.21.15.88:0/3253759581 learned_addr learned my addr 172.21.15.88:0/3253759581 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:13.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f146ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1470069e90 0x7f147006a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:35924/0 (socket says 172.21.15.88:35924) 2023-11-20T07:02:13.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.945+0000 7f1467fff640 1 --1- 172.21.15.88:0/3253759581 >> v1:172.21.15.175:6789/0 conn(0x7f14700b4480 0x7f14700b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:55884/0 (socket says 172.21.15.88:55884) 2023-11-20T07:02:13.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.949+0000 7f146f7fe640 1 -- 172.21.15.88:0/3253759581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1470069e90 msgr2=0x7f147006a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:13.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.949+0000 7f146f7fe640 1 --2- 172.21.15.88:0/3253759581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1470069e90 0x7f147006a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.949+0000 7f146f7fe640 1 -- 172.21.15.88:0/3253759581 >> v1:172.21.15.175:6789/0 conn(0x7f14700b4480 legacy=0x7f14700b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.949+0000 7f146f7fe640 1 -- 172.21.15.88:0/3253759581 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14700c9900 con 0x7f147015ab10 2023-11-20T07:02:13.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.949+0000 7f146effd640 1 -- 172.21.15.88:0/3253759581 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475617039 0 0) 0x7f1458001120 con 0x7f14700b4480 2023-11-20T07:02:13.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.949+0000 7f146f7fe640 1 --2- 172.21.15.88:0/3253759581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147015ab10 0x7f14700b3f40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1460009870 tx=0x7f146001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e1429ade3296cfc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:13.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.949+0000 7f146effd640 1 -- 172.21.15.88:0/3253759581 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14600ab680 con 0x7f147015ab10 2023-11-20T07:02:13.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.949+0000 7f146effd640 1 -- 172.21.15.88:0/3253759581 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14600ab7e0 con 0x7f147015ab10 2023-11-20T07:02:13.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.949+0000 7f146effd640 1 -- 172.21.15.88:0/3253759581 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14600abb70 con 0x7f147015ab10 2023-11-20T07:02:13.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 -- 172.21.15.88:0/3253759581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147015ab10 msgr2=0x7f14700b3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 --2- 172.21.15.88:0/3253759581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147015ab10 0x7f14700b3f40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1460009870 tx=0x7f146001c480 comp rx=0 tx=0).stop 2023-11-20T07:02:13.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 -- 172.21.15.88:0/3253759581 shutdown_connections 2023-11-20T07:02:13.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 --2- 172.21.15.88:0/3253759581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1470069e90 0x7f147006a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 --2- 172.21.15.88:0/3253759581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147015ab10 0x7f14700b3f40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 -- 172.21.15.88:0/3253759581 >> 172.21.15.88:0/3253759581 conn(0x7f14700b0d30 msgr2=0x7f14700ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:13.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 -- 172.21.15.88:0/3253759581 shutdown_connections 2023-11-20T07:02:13.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 -- 172.21.15.88:0/3253759581 wait complete. 2023-11-20T07:02:13.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 Processor -- start 2023-11-20T07:02:13.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 -- start start 2023-11-20T07:02:13.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470069e90 0x7f1470154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14700b4480 0x7f14701f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147015ab10 0x7f14701f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14701456f0 con 0x7f1470069e90 2023-11-20T07:02:13.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14701539c0 con 0x7f147015ab10 2023-11-20T07:02:13.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1475abb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14701547e0 con 0x7f14700b4480 2023-11-20T07:02:13.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f146f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470069e90 0x7f1470154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f146f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470069e90 0x7f1470154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59252/0 (socket says 172.21.15.88:59252) 2023-11-20T07:02:13.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f146f7fe640 1 -- 172.21.15.88:0/3128875427 learned_addr learned my addr 172.21.15.88:0/3128875427 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:13.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f1467fff640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14700b4480 0x7f14701f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f146ffff640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147015ab10 0x7f14701f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f146f7fe640 1 -- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14700b4480 msgr2=0x7f14701f8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f146f7fe640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14700b4480 0x7f14701f8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f146f7fe640 1 -- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147015ab10 msgr2=0x7f14701f8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:13.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f146f7fe640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147015ab10 0x7f14701f8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:13.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.953+0000 7f146f7fe640 1 -- 172.21.15.88:0/3128875427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14600094d0 con 0x7f1470069e90 2023-11-20T07:02:13.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.957+0000 7f146f7fe640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470069e90 0x7f1470154c70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f14600ad040 tx=0x7f146001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:13.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.957+0000 7f146cff9640 1 -- 172.21.15.88:0/3128875427 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14600b4800 con 0x7f1470069e90 2023-11-20T07:02:13.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.957+0000 7f146cff9640 1 -- 172.21.15.88:0/3128875427 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14600b4960 con 0x7f1470069e90 2023-11-20T07:02:13.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.957+0000 7f146cff9640 1 -- 172.21.15.88:0/3128875427 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14600b4d10 con 0x7f1470069e90 2023-11-20T07:02:13.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.957+0000 7f1475abb640 1 -- 172.21.15.88:0/3128875427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1470153bd0 con 0x7f1470069e90 2023-11-20T07:02:13.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.957+0000 7f1475abb640 1 -- 172.21.15.88:0/3128875427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1470154190 con 0x7f1470069e90 2023-11-20T07:02:13.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.957+0000 7f1475abb640 1 -- 172.21.15.88:0/3128875427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147004e170 con 0x7f1470069e90 2023-11-20T07:02:13.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.957+0000 7f146cff9640 1 -- 172.21.15.88:0/3128875427 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f14600c83a0 con 0x7f1470069e90 2023-11-20T07:02:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.957+0000 7f146cff9640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f14500664a0 0x7f1450068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.957+0000 7f146cff9640 1 -- 172.21.15.88:0/3128875427 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f146011e9e0 con 0x7f1470069e90 2023-11-20T07:02:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.961+0000 7f1467fff640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f14500664a0 0x7f1450068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:13.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.961+0000 7f1467fff640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f14500664a0 0x7f1450068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f14701655c0 tx=0x7f1458007ba0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:13.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:13.961+0000 7f146cff9640 1 -- 172.21.15.88:0/3128875427 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f14600ec080 con 0x7f1470069e90 2023-11-20T07:02:14.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.169+0000 7f1475abb640 1 -- 172.21.15.88:0/3128875427 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f14700afcf0 con 0x7f1470069e90 2023-11-20T07:02:14.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f146cff9640 1 -- 172.21.15.88:0/3128875427 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f14600c40a0 con 0x7f1470069e90 2023-11-20T07:02:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f1475abb640 1 -- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f14500664a0 msgr2=0x7f1450068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f1475abb640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f14500664a0 0x7f1450068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f14701655c0 tx=0x7f1458007ba0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f1475abb640 1 -- 172.21.15.88:0/3128875427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470069e90 msgr2=0x7f1470154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f1475abb640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470069e90 0x7f1470154c70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f14600ad040 tx=0x7f146001acc0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f1475abb640 1 -- 172.21.15.88:0/3128875427 shutdown_connections 2023-11-20T07:02:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f1475abb640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f14500664a0 0x7f1450068960 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f1475abb640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14700b4480 0x7f14701f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f1475abb640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147015ab10 0x7f14701f8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f1475abb640 1 --2- 172.21.15.88:0/3128875427 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470069e90 0x7f1470154c70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f1475abb640 1 -- 172.21.15.88:0/3128875427 >> 172.21.15.88:0/3128875427 conn(0x7f14700b0d30 msgr2=0x7f14700702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f1475abb640 1 -- 172.21.15.88:0/3128875427 shutdown_connections 2023-11-20T07:02:14.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.173+0000 7f1475abb640 1 -- 172.21.15.88:0/3128875427 wait complete. 2023-11-20T07:02:14.194 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-20T07:02:14.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.333+0000 7f17c76c9640 1 Processor -- start 2023-11-20T07:02:14.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.333+0000 7f17c76c9640 1 -- start start 2023-11-20T07:02:14.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.333+0000 7f17c76c9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17c006def0 0x7f17c0167c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:14.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.333+0000 7f17c76c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c00ccbd0 con 0x7f17c015cb30 2023-11-20T07:02:14.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.333+0000 7f17c76c9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c0161710 con 0x7f17c0065a80 2023-11-20T07:02:14.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.333+0000 7f17c76c9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c006b180 con 0x7f17c006def0 2023-11-20T07:02:14.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.337+0000 7f17c5c66640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17c006def0 0x7f17c0167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:14.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.337+0000 7f17c5465640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f17c015cb30 0x7f17c01608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48832/0 (socket says 172.21.15.88:48832) 2023-11-20T07:02:14.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.337+0000 7f17c5465640 1 -- 172.21.15.88:0/4254350090 learned_addr learned my addr 172.21.15.88:0/4254350090 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:14.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.337+0000 7f17c5c66640 1 -- 172.21.15.88:0/4254350090 >> v1:172.21.15.175:6789/0 conn(0x7f17c0065a80 legacy=0x7f17c0161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:14.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.337+0000 7f17c5c66640 1 -- 172.21.15.88:0/4254350090 >> v1:172.21.15.88:6789/0 conn(0x7f17c015cb30 legacy=0x7f17c01608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.337+0000 7f17b7fff640 1 -- 172.21.15.88:0/4254350090 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598126964 0 0) 0x7f17c00ccbd0 con 0x7f17c015cb30 2023-11-20T07:02:14.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.337+0000 7f17c5c66640 1 -- 172.21.15.88:0/4254350090 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c006b460 con 0x7f17c006def0 2023-11-20T07:02:14.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.337+0000 7f17c5c66640 1 --2- 172.21.15.88:0/4254350090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c006def0 0x7f17c0167c20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009d90 tx=0x7f17b801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6a9922972df071 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:14.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.337+0000 7f17b7fff640 1 -- 172.21.15.88:0/4254350090 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80a59e0 con 0x7f17c006def0 2023-11-20T07:02:14.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.337+0000 7f17b7fff640 1 -- 172.21.15.88:0/4254350090 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b80a5b40 con 0x7f17c006def0 2023-11-20T07:02:14.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.337+0000 7f17b7fff640 1 -- 172.21.15.88:0/4254350090 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80ad440 con 0x7f17c006def0 2023-11-20T07:02:14.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 -- 172.21.15.88:0/4254350090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c006def0 msgr2=0x7f17c0167c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 --2- 172.21.15.88:0/4254350090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c006def0 0x7f17c0167c20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009d90 tx=0x7f17b801c920 comp rx=0 tx=0).stop 2023-11-20T07:02:14.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 -- 172.21.15.88:0/4254350090 shutdown_connections 2023-11-20T07:02:14.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 --2- 172.21.15.88:0/4254350090 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c006def0 0x7f17c0167c20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 -- 172.21.15.88:0/4254350090 >> 172.21.15.88:0/4254350090 conn(0x7f17c00b0880 msgr2=0x7f17c00b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:14.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 -- 172.21.15.88:0/4254350090 shutdown_connections 2023-11-20T07:02:14.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 -- 172.21.15.88:0/4254350090 wait complete. 2023-11-20T07:02:14.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 Processor -- start 2023-11-20T07:02:14.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 -- start start 2023-11-20T07:02:14.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c0065a80 0x7f17c00af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:14.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17c006def0 0x7f17c00af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:14.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c015cb30 0x7f17c00c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:14.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00b3530 con 0x7f17c015cb30 2023-11-20T07:02:14.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00b28b0 con 0x7f17c006def0 2023-11-20T07:02:14.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c76c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00b2b90 con 0x7f17c0065a80 2023-11-20T07:02:14.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c5c66640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c015cb30 0x7f17c00c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:14.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c5c66640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c015cb30 0x7f17c00c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59262/0 (socket says 172.21.15.88:59262) 2023-11-20T07:02:14.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c5c66640 1 -- 172.21.15.88:0/468371869 learned_addr learned my addr 172.21.15.88:0/468371869 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:14.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c5465640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c0065a80 0x7f17c00af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:14.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c4c64640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17c006def0 0x7f17c00af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:14.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c5c66640 1 -- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c0065a80 msgr2=0x7f17c00af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c5c66640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c0065a80 0x7f17c00af160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c5c66640 1 -- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17c006def0 msgr2=0x7f17c00af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c5c66640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17c006def0 0x7f17c00af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c5c66640 1 -- 172.21.15.88:0/468371869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b8009a70 con 0x7f17c015cb30 2023-11-20T07:02:14.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c4c64640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17c006def0 0x7f17c00af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:14.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.341+0000 7f17c5c66640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c015cb30 0x7f17c00c5e60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f17b801a550 tx=0x7f17b80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:14.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.345+0000 7f17b5ffb640 1 -- 172.21.15.88:0/468371869 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80ade40 con 0x7f17c015cb30 2023-11-20T07:02:14.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.345+0000 7f17b5ffb640 1 -- 172.21.15.88:0/468371869 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b80b9450 con 0x7f17c015cb30 2023-11-20T07:02:14.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.345+0000 7f17b5ffb640 1 -- 172.21.15.88:0/468371869 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80b97e0 con 0x7f17c015cb30 2023-11-20T07:02:14.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.345+0000 7f17c76c9640 1 -- 172.21.15.88:0/468371869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c00b2e70 con 0x7f17c015cb30 2023-11-20T07:02:14.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.345+0000 7f17c76c9640 1 -- 172.21.15.88:0/468371869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c01541d0 con 0x7f17c015cb30 2023-11-20T07:02:14.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.345+0000 7f17c76c9640 1 -- 172.21.15.88:0/468371869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c00b3670 con 0x7f17c015cb30 2023-11-20T07:02:14.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.345+0000 7f17b5ffb640 1 -- 172.21.15.88:0/468371869 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f17b80b9940 con 0x7f17c015cb30 2023-11-20T07:02:14.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.345+0000 7f17b5ffb640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f17a40664a0 0x7f17a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:14.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.345+0000 7f17b5ffb640 1 -- 172.21.15.88:0/468371869 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f17b811f6e0 con 0x7f17c015cb30 2023-11-20T07:02:14.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.345+0000 7f17c5465640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f17a40664a0 0x7f17a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:14.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.349+0000 7f17c5465640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f17a40664a0 0x7f17a4068960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f17bc000f70 tx=0x7f17bc007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:14.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.349+0000 7f17b5ffb640 1 -- 172.21.15.88:0/468371869 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f17c00b3670 con 0x7f17c015cb30 2023-11-20T07:02:14.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.549+0000 7f17c76c9640 1 -- 172.21.15.88:0/468371869 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f17c00b3670 con 0x7f17c015cb30 2023-11-20T07:02:14.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17b5ffb640 1 -- 172.21.15.88:0/468371869 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f17c00b3670 con 0x7f17c015cb30 2023-11-20T07:02:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17c76c9640 1 -- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f17a40664a0 msgr2=0x7f17a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17c76c9640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f17a40664a0 0x7f17a4068960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f17bc000f70 tx=0x7f17bc007d30 comp rx=0 tx=0).stop 2023-11-20T07:02:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17c76c9640 1 -- 172.21.15.88:0/468371869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c015cb30 msgr2=0x7f17c00c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17c76c9640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c015cb30 0x7f17c00c5e60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f17b801a550 tx=0x7f17b80196c0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17c76c9640 1 -- 172.21.15.88:0/468371869 shutdown_connections 2023-11-20T07:02:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17c76c9640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f17a40664a0 0x7f17a4068960 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17c76c9640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17c015cb30 0x7f17c00c5e60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17c76c9640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17c006def0 0x7f17c00af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17c76c9640 1 --2- 172.21.15.88:0/468371869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c0065a80 0x7f17c00af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17c76c9640 1 -- 172.21.15.88:0/468371869 >> 172.21.15.88:0/468371869 conn(0x7f17c00b0880 msgr2=0x7f17c00c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:14.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17c76c9640 1 -- 172.21.15.88:0/468371869 shutdown_connections 2023-11-20T07:02:14.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.553+0000 7f17c76c9640 1 -- 172.21.15.88:0/468371869 wait complete. 2023-11-20T07:02:14.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-20T07:02:14.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f01274d6640 1 Processor -- start 2023-11-20T07:02:14.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f01274d6640 1 -- start start 2023-11-20T07:02:14.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f01274d6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f01200b2ad0 0x7f012006b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:14.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f01274d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012015cf90 0x7f012006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:14.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f01274d6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012015d4e0 con 0x7f01200ce310 2023-11-20T07:02:14.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f01274d6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0120160580 con 0x7f01200b2ad0 2023-11-20T07:02:14.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f01274d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012015d7c0 con 0x7f012015cf90 2023-11-20T07:02:14.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f0125272640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f01200b2ad0 0x7f012006b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:14.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f0125272640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f01200b2ad0 0x7f012006b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59274/0 (socket says 172.21.15.88:59274) 2023-11-20T07:02:14.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f0125272640 1 -- 172.21.15.88:0/2981082749 learned_addr learned my addr 172.21.15.88:0/2981082749 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:14.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f0124a71640 1 --2- 172.21.15.88:0/2981082749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012015cf90 0x7f012006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:14.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f0125272640 1 -- 172.21.15.88:0/2981082749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012015cf90 msgr2=0x7f012006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:14.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f0125272640 1 --2- 172.21.15.88:0/2981082749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012015cf90 0x7f012006c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f0125272640 1 -- 172.21.15.88:0/2981082749 >> v1:172.21.15.88:6789/0 conn(0x7f01200ce310 legacy=0x7f01201609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f0125272640 1 -- 172.21.15.88:0/2981082749 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012015daa0 con 0x7f01200b2ad0 2023-11-20T07:02:14.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.713+0000 7f0117fff640 1 -- 172.21.15.88:0/2981082749 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182549601 0 0) 0x7f012015d4e0 con 0x7f01200ce310 2023-11-20T07:02:14.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.717+0000 7f0125272640 1 --2- 172.21.15.88:0/2981082749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200b2ad0 0x7f012006b4b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f011c009870 tx=0x7f011c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a290445cd0b1cc2d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:14.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.717+0000 7f0117fff640 1 -- 172.21.15.88:0/2981082749 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0ab620 con 0x7f01200b2ad0 2023-11-20T07:02:14.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.717+0000 7f0117fff640 1 -- 172.21.15.88:0/2981082749 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c0ab780 con 0x7f01200b2ad0 2023-11-20T07:02:14.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.717+0000 7f0117fff640 1 -- 172.21.15.88:0/2981082749 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0abb10 con 0x7f01200b2ad0 2023-11-20T07:02:14.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.717+0000 7f01274d6640 1 -- 172.21.15.88:0/2981082749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200b2ad0 msgr2=0x7f012006b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.717+0000 7f01274d6640 1 --2- 172.21.15.88:0/2981082749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200b2ad0 0x7f012006b4b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f011c009870 tx=0x7f011c01c510 comp rx=0 tx=0).stop 2023-11-20T07:02:14.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.717+0000 7f01274d6640 1 -- 172.21.15.88:0/2981082749 shutdown_connections 2023-11-20T07:02:14.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.717+0000 7f01274d6640 1 --2- 172.21.15.88:0/2981082749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012015cf90 0x7f012006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.717+0000 7f01274d6640 1 --2- 172.21.15.88:0/2981082749 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200b2ad0 0x7f012006b4b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.717+0000 7f01274d6640 1 -- 172.21.15.88:0/2981082749 >> 172.21.15.88:0/2981082749 conn(0x7f01200cd1c0 msgr2=0x7f01200cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:14.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.717+0000 7f01274d6640 1 -- 172.21.15.88:0/2981082749 shutdown_connections 2023-11-20T07:02:14.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.717+0000 7f01274d6640 1 -- 172.21.15.88:0/2981082749 wait complete. 2023-11-20T07:02:14.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f01274d6640 1 Processor -- start 2023-11-20T07:02:14.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f01274d6640 1 -- start start 2023-11-20T07:02:14.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f01274d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200b2ad0 0x7f01200c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:14.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f01274d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01200ce310 0x7f01200c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:14.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f01274d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f012015cf90 0x7f012015b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:14.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f01274d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01200c6700 con 0x7f01200b2ad0 2023-11-20T07:02:14.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f01274d6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01200c69e0 con 0x7f012015cf90 2023-11-20T07:02:14.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f01274d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01200c6cc0 con 0x7f01200ce310 2023-11-20T07:02:14.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0125272640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200b2ad0 0x7f01200c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:14.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0125272640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200b2ad0 0x7f01200c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59290/0 (socket says 172.21.15.88:59290) 2023-11-20T07:02:14.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0125272640 1 -- 172.21.15.88:0/3204361597 learned_addr learned my addr 172.21.15.88:0/3204361597 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0124a71640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01200ce310 0x7f01200c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0125a73640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f012015cf90 0x7f012015b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0125272640 1 -- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01200ce310 msgr2=0x7f01200c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0125272640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01200ce310 0x7f01200c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0125272640 1 -- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f012015cf90 msgr2=0x7f012015b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0125272640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f012015cf90 0x7f012015b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0125272640 1 -- 172.21.15.88:0/3204361597 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c0094d0 con 0x7f01200b2ad0 2023-11-20T07:02:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0125a73640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f012015cf90 0x7f012015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0125272640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200b2ad0 0x7f01200c5b40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f011c0ad040 tx=0x7f011c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0115ffb640 1 -- 172.21.15.88:0/3204361597 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0be3f0 con 0x7f01200b2ad0 2023-11-20T07:02:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0115ffb640 1 -- 172.21.15.88:0/3204361597 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c0be550 con 0x7f01200b2ad0 2023-11-20T07:02:14.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f0115ffb640 1 -- 172.21.15.88:0/3204361597 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0be8e0 con 0x7f01200b2ad0 2023-11-20T07:02:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f01274d6640 1 -- 172.21.15.88:0/3204361597 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01200c6fa0 con 0x7f01200b2ad0 2023-11-20T07:02:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f01274d6640 1 -- 172.21.15.88:0/3204361597 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01200c4480 con 0x7f01200b2ad0 2023-11-20T07:02:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.721+0000 7f01274d6640 1 -- 172.21.15.88:0/3204361597 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0120074010 con 0x7f01200b2ad0 2023-11-20T07:02:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.725+0000 7f0115ffb640 1 -- 172.21.15.88:0/3204361597 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f011c0b43f0 con 0x7f01200b2ad0 2023-11-20T07:02:14.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.725+0000 7f0115ffb640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f01040664a0 0x7f0104068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:14.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.725+0000 7f0115ffb640 1 -- 172.21.15.88:0/3204361597 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f011c11dfe0 con 0x7f01200b2ad0 2023-11-20T07:02:14.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.725+0000 7f0124a71640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f01040664a0 0x7f0104068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:14.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.725+0000 7f0124a71640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f01040664a0 0x7f0104068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f012015cc40 tx=0x7f0110008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:14.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.729+0000 7f0115ffb640 1 -- 172.21.15.88:0/3204361597 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f011c0eb720 con 0x7f01200b2ad0 2023-11-20T07:02:14.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.929+0000 7f01274d6640 1 -- 172.21.15.88:0/3204361597 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f0120140010 con 0x7f01200b2ad0 2023-11-20T07:02:14.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f0115ffb640 1 -- 172.21.15.88:0/3204361597 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f011c0eed40 con 0x7f01200b2ad0 2023-11-20T07:02:14.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f01274d6640 1 -- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f01040664a0 msgr2=0x7f0104068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f01274d6640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f01040664a0 0x7f0104068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f012015cc40 tx=0x7f0110008040 comp rx=0 tx=0).stop 2023-11-20T07:02:14.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f01274d6640 1 -- 172.21.15.88:0/3204361597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200b2ad0 msgr2=0x7f01200c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:14.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f01274d6640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200b2ad0 0x7f01200c5b40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f011c0ad040 tx=0x7f011c01ad50 comp rx=0 tx=0).stop 2023-11-20T07:02:14.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f01274d6640 1 -- 172.21.15.88:0/3204361597 shutdown_connections 2023-11-20T07:02:14.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f01274d6640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f01040664a0 0x7f0104068960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f01274d6640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01200ce310 0x7f01200c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f01274d6640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f012015cf90 0x7f012015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f01274d6640 1 --2- 172.21.15.88:0/3204361597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01200b2ad0 0x7f01200c5b40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:14.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f01274d6640 1 -- 172.21.15.88:0/3204361597 >> 172.21.15.88:0/3204361597 conn(0x7f01200cd1c0 msgr2=0x7f01201609d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:14.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f01274d6640 1 -- 172.21.15.88:0/3204361597 shutdown_connections 2023-11-20T07:02:14.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:14.933+0000 7f01274d6640 1 -- 172.21.15.88:0/3204361597 wait complete. 2023-11-20T07:02:14.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-20T07:02:15.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb60bb640 1 Processor -- start 2023-11-20T07:02:15.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb60bb640 1 -- start start 2023-11-20T07:02:15.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb60bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2eb015c980 0x7f2eb006af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb60bb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2eb015cd60 0x7f2eb00b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb60bb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb00d3510 con 0x7f2eb00d0d80 2023-11-20T07:02:15.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb60bb640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb00cd2b0 con 0x7f2eb015c980 2023-11-20T07:02:15.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb60bb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb00d2f50 con 0x7f2eb015cd60 2023-11-20T07:02:15.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb50b9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2eb015c980 0x7f2eb006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb50b9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2eb015c980 0x7f2eb006af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59302/0 (socket says 172.21.15.88:59302) 2023-11-20T07:02:15.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb50b9640 1 -- 172.21.15.88:0/2629649889 learned_addr learned my addr 172.21.15.88:0/2629649889 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:15.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb50b9640 1 -- 172.21.15.88:0/2629649889 >> v2:172.21.15.175:3300/0 conn(0x7f2eb015cd60 msgr2=0x7f2eb00b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:15.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb50b9640 1 --2- 172.21.15.88:0/2629649889 >> v2:172.21.15.175:3300/0 conn(0x7f2eb015cd60 0x7f2eb00b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb50b9640 1 -- 172.21.15.88:0/2629649889 >> v1:172.21.15.175:6789/0 conn(0x7f2eb00d0d80 legacy=0x7f2eb00cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:15.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.093+0000 7f2eb50b9640 1 -- 172.21.15.88:0/2629649889 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb00d3230 con 0x7f2eb015c980 2023-11-20T07:02:15.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.097+0000 7f2eb50b9640 1 --2- 172.21.15.88:0/2629649889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2eb015c980 0x7f2eb006af90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00d1900 tx=0x7f2eac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f553e6b8d96658c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:15.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.097+0000 7f2ea7fff640 1 -- 172.21.15.88:0/2629649889 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0ad660 con 0x7f2eb015c980 2023-11-20T07:02:15.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.097+0000 7f2ea7fff640 1 -- 172.21.15.88:0/2629649889 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac0ad7c0 con 0x7f2eb015c980 2023-11-20T07:02:15.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.097+0000 7f2ea7fff640 1 -- 172.21.15.88:0/2629649889 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0adb50 con 0x7f2eb015c980 2023-11-20T07:02:15.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.097+0000 7f2eb60bb640 1 -- 172.21.15.88:0/2629649889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2eb015c980 msgr2=0x7f2eb006af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.097+0000 7f2eb60bb640 1 --2- 172.21.15.88:0/2629649889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2eb015c980 0x7f2eb006af90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00d1900 tx=0x7f2eac01c450 comp rx=0 tx=0).stop 2023-11-20T07:02:15.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.097+0000 7f2eb60bb640 1 -- 172.21.15.88:0/2629649889 shutdown_connections 2023-11-20T07:02:15.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.097+0000 7f2eb60bb640 1 --2- 172.21.15.88:0/2629649889 >> v2:172.21.15.175:3300/0 conn(0x7f2eb015cd60 0x7f2eb00b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.097+0000 7f2eb60bb640 1 --2- 172.21.15.88:0/2629649889 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2eb015c980 0x7f2eb006af90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.097+0000 7f2eb60bb640 1 -- 172.21.15.88:0/2629649889 >> 172.21.15.88:0/2629649889 conn(0x7f2eb009ba80 msgr2=0x7f2eb00d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:15.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.097+0000 7f2eb60bb640 1 -- 172.21.15.88:0/2629649889 shutdown_connections 2023-11-20T07:02:15.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.097+0000 7f2eb60bb640 1 -- 172.21.15.88:0/2629649889 wait complete. 2023-11-20T07:02:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb60bb640 1 Processor -- start 2023-11-20T07:02:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb60bb640 1 -- start start 2023-11-20T07:02:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb60bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2eb00d0d80 0x7f2eb00b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb60bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2eb015c980 0x7f2eb00cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb60bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb015cd60 0x7f2eb0154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb60bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00b5200 con 0x7f2eb00d0d80 2023-11-20T07:02:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb60bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00c9c10 con 0x7f2eb015c980 2023-11-20T07:02:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb60bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00c9ef0 con 0x7f2eb015cd60 2023-11-20T07:02:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb50b9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2eb00d0d80 0x7f2eb00b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb50b9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2eb00d0d80 0x7f2eb00b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59304/0 (socket says 172.21.15.88:59304) 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb50b9640 1 -- 172.21.15.88:0/3420251013 learned_addr learned my addr 172.21.15.88:0/3420251013 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb48b8640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2eb015c980 0x7f2eb00cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb50b9640 1 -- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb015cd60 msgr2=0x7f2eb0154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb58ba640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb015cd60 0x7f2eb0154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb50b9640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb015cd60 0x7f2eb0154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb50b9640 1 -- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2eb015c980 msgr2=0x7f2eb00cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb50b9640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2eb015c980 0x7f2eb00cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb50b9640 1 -- 172.21.15.88:0/3420251013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac009480 con 0x7f2eb00d0d80 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb48b8640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2eb015c980 0x7f2eb00cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb58ba640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb015cd60 0x7f2eb0154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb50b9640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2eb00d0d80 0x7f2eb00b4cc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2eac000c10 tx=0x7f2eac0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2ea5ffb640 1 -- 172.21.15.88:0/3420251013 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0add40 con 0x7f2eb00d0d80 2023-11-20T07:02:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2ea5ffb640 1 -- 172.21.15.88:0/3420251013 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac0ad5e0 con 0x7f2eb00d0d80 2023-11-20T07:02:15.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb60bb640 1 -- 172.21.15.88:0/3420251013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb00ca1d0 con 0x7f2eb00d0d80 2023-11-20T07:02:15.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2ea5ffb640 1 -- 172.21.15.88:0/3420251013 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0adea0 con 0x7f2eb00d0d80 2023-11-20T07:02:15.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.101+0000 7f2eb60bb640 1 -- 172.21.15.88:0/3420251013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb014a580 con 0x7f2eb00d0d80 2023-11-20T07:02:15.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.105+0000 7f2eb60bb640 1 -- 172.21.15.88:0/3420251013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb00ca6f0 con 0x7f2eb00d0d80 2023-11-20T07:02:15.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.105+0000 7f2ea5ffb640 1 -- 172.21.15.88:0/3420251013 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2eac003820 con 0x7f2eb00d0d80 2023-11-20T07:02:15.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.105+0000 7f2ea5ffb640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2e940664a0 0x7f2e94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.105+0000 7f2ea5ffb640 1 -- 172.21.15.88:0/3420251013 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2eac11e250 con 0x7f2eb00d0d80 2023-11-20T07:02:15.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.105+0000 7f2eb48b8640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2e940664a0 0x7f2e94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.105+0000 7f2eb48b8640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2e940664a0 0x7f2e94068960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2eb014c330 tx=0x7f2ea0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:15.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.109+0000 7f2ea5ffb640 1 -- 172.21.15.88:0/3420251013 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2eac0eb8d0 con 0x7f2eb00d0d80 2023-11-20T07:02:15.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.309+0000 7f2eb60bb640 1 -- 172.21.15.88:0/3420251013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f2eb004e9c0 con 0x7f2eb00d0d80 2023-11-20T07:02:15.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.313+0000 7f2ea5ffb640 1 -- 172.21.15.88:0/3420251013 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2eac0eeef0 con 0x7f2eb00d0d80 2023-11-20T07:02:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.317+0000 7f2eb60bb640 1 -- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2e940664a0 msgr2=0x7f2e94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.317+0000 7f2eb60bb640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2e940664a0 0x7f2e94068960 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2eb014c330 tx=0x7f2ea0008040 comp rx=0 tx=0).stop 2023-11-20T07:02:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.317+0000 7f2eb60bb640 1 -- 172.21.15.88:0/3420251013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2eb00d0d80 msgr2=0x7f2eb00b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.317+0000 7f2eb60bb640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2eb00d0d80 0x7f2eb00b4cc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2eac000c10 tx=0x7f2eac0191f0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.317+0000 7f2eb60bb640 1 -- 172.21.15.88:0/3420251013 shutdown_connections 2023-11-20T07:02:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.317+0000 7f2eb60bb640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2e940664a0 0x7f2e94068960 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.317+0000 7f2eb60bb640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb015cd60 0x7f2eb0154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.317+0000 7f2eb60bb640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2eb015c980 0x7f2eb00cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.317+0000 7f2eb60bb640 1 --2- 172.21.15.88:0/3420251013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2eb00d0d80 0x7f2eb00b4cc0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.317+0000 7f2eb60bb640 1 -- 172.21.15.88:0/3420251013 >> 172.21.15.88:0/3420251013 conn(0x7f2eb009ba80 msgr2=0x7f2eb006c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:15.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.317+0000 7f2eb60bb640 1 -- 172.21.15.88:0/3420251013 shutdown_connections 2023-11-20T07:02:15.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.317+0000 7f2eb60bb640 1 -- 172.21.15.88:0/3420251013 wait complete. 2023-11-20T07:02:15.335 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-20T07:02:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b30868640 1 Processor -- start 2023-11-20T07:02:15.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b30868640 1 -- start start 2023-11-20T07:02:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b30868640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8b2c1591e0 0x7f8b2c0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b30868640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b2c0b00e0 0x7f8b2c0b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b30868640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2c0b0a30 con 0x7f8b2c0ca430 2023-11-20T07:02:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b30868640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2c071020 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b30868640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2c0c8e50 con 0x7f8b2c1591e0 2023-11-20T07:02:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b2ad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b2c0b00e0 0x7f8b2c0b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b2ad9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b2c0b00e0 0x7f8b2c0b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59318/0 (socket says 172.21.15.88:59318) 2023-11-20T07:02:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b2ad9d640 1 -- 172.21.15.88:0/1179919726 learned_addr learned my addr 172.21.15.88:0/1179919726 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:15.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b2a59c640 1 --2- 172.21.15.88:0/1179919726 >> v2:172.21.15.175:3300/0 conn(0x7f8b2c1591e0 0x7f8b2c0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b2ad9d640 1 -- 172.21.15.88:0/1179919726 >> v2:172.21.15.175:3300/0 conn(0x7f8b2c1591e0 msgr2=0x7f8b2c0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b2ad9d640 1 --2- 172.21.15.88:0/1179919726 >> v2:172.21.15.175:3300/0 conn(0x7f8b2c1591e0 0x7f8b2c0c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b2ad9d640 1 -- 172.21.15.88:0/1179919726 >> v1:172.21.15.175:6789/0 conn(0x7f8b2c0ca430 legacy=0x7f8b2c071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:15.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.473+0000 7f8b2ad9d640 1 -- 172.21.15.88:0/1179919726 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0c9130 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.477+0000 7f8b2ad9d640 1 --2- 172.21.15.88:0/1179919726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b2c0b00e0 0x7f8b2c0b04f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c06d140 tx=0x7f8b2401dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1bb11c77a9ae4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:15.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.477+0000 7f8b29d9b640 1 -- 172.21.15.88:0/1179919726 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2400a2d0 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.477+0000 7f8b29d9b640 1 -- 172.21.15.88:0/1179919726 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b240a6800 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.477+0000 7f8b29d9b640 1 -- 172.21.15.88:0/1179919726 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240a6b90 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.477+0000 7f8b30868640 1 -- 172.21.15.88:0/1179919726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b2c0b00e0 msgr2=0x7f8b2c0b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.477+0000 7f8b30868640 1 --2- 172.21.15.88:0/1179919726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b2c0b00e0 0x7f8b2c0b04f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c06d140 tx=0x7f8b2401dad0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.477+0000 7f8b30868640 1 -- 172.21.15.88:0/1179919726 shutdown_connections 2023-11-20T07:02:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.477+0000 7f8b30868640 1 --2- 172.21.15.88:0/1179919726 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b2c0b00e0 0x7f8b2c0b04f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.477+0000 7f8b30868640 1 --2- 172.21.15.88:0/1179919726 >> v2:172.21.15.175:3300/0 conn(0x7f8b2c1591e0 0x7f8b2c0c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.477+0000 7f8b30868640 1 -- 172.21.15.88:0/1179919726 >> 172.21.15.88:0/1179919726 conn(0x7f8b2c06c190 msgr2=0x7f8b2c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:15.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.477+0000 7f8b30868640 1 -- 172.21.15.88:0/1179919726 shutdown_connections 2023-11-20T07:02:15.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.477+0000 7f8b30868640 1 -- 172.21.15.88:0/1179919726 wait complete. 2023-11-20T07:02:15.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b30868640 1 Processor -- start 2023-11-20T07:02:15.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b30868640 1 -- start start 2023-11-20T07:02:15.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b30868640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b2c0b00e0 0x7f8b2c14cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b30868640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b2c0ca430 0x7f8b2c1457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b30868640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2c1591e0 0x7f8b2c145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b30868640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c146260 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b30868640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c150010 con 0x7f8b2c0ca430 2023-11-20T07:02:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b30868640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c1502f0 con 0x7f8b2c1591e0 2023-11-20T07:02:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b2a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b2c0b00e0 0x7f8b2c14cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b2a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b2c0b00e0 0x7f8b2c14cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59322/0 (socket says 172.21.15.88:59322) 2023-11-20T07:02:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b2a59c640 1 -- 172.21.15.88:0/4236770503 learned_addr learned my addr 172.21.15.88:0/4236770503 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b2ad9d640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2c1591e0 0x7f8b2c145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b23fff640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b2c0ca430 0x7f8b2c1457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b2a59c640 1 -- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2c1591e0 msgr2=0x7f8b2c145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b2a59c640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2c1591e0 0x7f8b2c145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b2a59c640 1 -- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b2c0ca430 msgr2=0x7f8b2c1457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b2a59c640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b2c0ca430 0x7f8b2c1457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b2a59c640 1 -- 172.21.15.88:0/4236770503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2400ac40 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b23fff640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b2c0ca430 0x7f8b2c1457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:15.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b2a59c640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b2c0b00e0 0x7f8b2c14cd10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00d800 tx=0x7f8b1c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b22ffd640 1 -- 172.21.15.88:0/4236770503 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c00b6c0 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b22ffd640 1 -- 172.21.15.88:0/4236770503 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c00b820 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b30868640 1 -- 172.21.15.88:0/4236770503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2c1505d0 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b22ffd640 1 -- 172.21.15.88:0/4236770503 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c00bb90 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b30868640 1 -- 172.21.15.88:0/4236770503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2c150b90 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.481+0000 7f8b30868640 1 -- 172.21.15.88:0/4236770503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2c150d50 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.485+0000 7f8b22ffd640 1 -- 172.21.15.88:0/4236770503 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8b1c00bcf0 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.485+0000 7f8b22ffd640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8b0c0664d0 0x7f8b0c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.485+0000 7f8b22ffd640 1 -- 172.21.15.88:0/4236770503 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8b1c0840f0 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.485+0000 7f8b23fff640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8b0c0664d0 0x7f8b0c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.485+0000 7f8b23fff640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8b0c0664d0 0x7f8b0c068990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0ad5e0 tx=0x7f8b14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:15.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.489+0000 7f8b22ffd640 1 -- 172.21.15.88:0/4236770503 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8b1c051770 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.693+0000 7f8b30868640 1 -- 172.21.15.88:0/4236770503 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f8b2c074010 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b22ffd640 1 -- 172.21.15.88:0/4236770503 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8b1c054d90 con 0x7f8b2c0b00e0 2023-11-20T07:02:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b30868640 1 -- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8b0c0664d0 msgr2=0x7f8b0c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b30868640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8b0c0664d0 0x7f8b0c068990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0ad5e0 tx=0x7f8b14009040 comp rx=0 tx=0).stop 2023-11-20T07:02:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b30868640 1 -- 172.21.15.88:0/4236770503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b2c0b00e0 msgr2=0x7f8b2c14cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b30868640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b2c0b00e0 0x7f8b2c14cd10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00d800 tx=0x7f8b1c00dcc0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b30868640 1 -- 172.21.15.88:0/4236770503 shutdown_connections 2023-11-20T07:02:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b30868640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8b0c0664d0 0x7f8b0c068990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b30868640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b2c1591e0 0x7f8b2c145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b30868640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b2c0ca430 0x7f8b2c1457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b30868640 1 --2- 172.21.15.88:0/4236770503 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b2c0b00e0 0x7f8b2c14cd10 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b30868640 1 -- 172.21.15.88:0/4236770503 >> 172.21.15.88:0/4236770503 conn(0x7f8b2c06c190 msgr2=0x7f8b2c0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:15.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b30868640 1 -- 172.21.15.88:0/4236770503 shutdown_connections 2023-11-20T07:02:15.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.697+0000 7f8b30868640 1 -- 172.21.15.88:0/4236770503 wait complete. 2023-11-20T07:02:15.719 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:15.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.853+0000 7fd6d2fd3640 1 Processor -- start 2023-11-20T07:02:15.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.853+0000 7fd6d2fd3640 1 -- start start 2023-11-20T07:02:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.853+0000 7fd6d2fd3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6cc071c70 0x7fd6cc072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.853+0000 7fd6d2fd3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd6cc0b00e0 0x7fd6cc0b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6d2fd3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc0b0a30 con 0x7fd6cc1591e0 2023-11-20T07:02:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6d2fd3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc071020 con 0x7fd6cc071c70 2023-11-20T07:02:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6d2fd3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc0c8e50 con 0x7fd6cc0b00e0 2023-11-20T07:02:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6c3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6cc071c70 0x7fd6cc072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6c3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd6cc071c70 0x7fd6cc072100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59330/0 (socket says 172.21.15.88:59330) 2023-11-20T07:02:15.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6c3fff640 1 -- 172.21.15.88:0/1807383742 learned_addr learned my addr 172.21.15.88:0/1807383742 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:15.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6d1570640 1 --2- 172.21.15.88:0/1807383742 >> v2:172.21.15.175:3300/0 conn(0x7fd6cc0b00e0 0x7fd6cc0b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6c3fff640 1 -- 172.21.15.88:0/1807383742 >> v2:172.21.15.175:3300/0 conn(0x7fd6cc0b00e0 msgr2=0x7fd6cc0b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:15.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6c3fff640 1 --2- 172.21.15.88:0/1807383742 >> v2:172.21.15.175:3300/0 conn(0x7fd6cc0b00e0 0x7fd6cc0b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6c3fff640 1 -- 172.21.15.88:0/1807383742 >> v1:172.21.15.175:6789/0 conn(0x7fd6cc1591e0 legacy=0x7fd6cc0c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6c3fff640 1 -- 172.21.15.88:0/1807383742 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc0c9130 con 0x7fd6cc071c70 2023-11-20T07:02:15.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6d1570640 1 --2- 172.21.15.88:0/1807383742 >> v2:172.21.15.175:3300/0 conn(0x7fd6cc0b00e0 0x7fd6cc0b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:15.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6c3fff640 1 --2- 172.21.15.88:0/1807383742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6cc071c70 0x7fd6cc072100 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0ad5c0 tx=0x7fd6bc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7815b06dd057d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:15.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6c37fe640 1 -- 172.21.15.88:0/1807383742 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0ab600 con 0x7fd6cc071c70 2023-11-20T07:02:15.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6c37fe640 1 -- 172.21.15.88:0/1807383742 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc0a7050 con 0x7fd6cc071c70 2023-11-20T07:02:15.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.857+0000 7fd6c37fe640 1 -- 172.21.15.88:0/1807383742 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0ab980 con 0x7fd6cc071c70 2023-11-20T07:02:15.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/1807383742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6cc071c70 msgr2=0x7fd6cc072100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 --2- 172.21.15.88:0/1807383742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6cc071c70 0x7fd6cc072100 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0ad5c0 tx=0x7fd6bc01c500 comp rx=0 tx=0).stop 2023-11-20T07:02:15.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/1807383742 shutdown_connections 2023-11-20T07:02:15.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 --2- 172.21.15.88:0/1807383742 >> v2:172.21.15.175:3300/0 conn(0x7fd6cc0b00e0 0x7fd6cc0b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 --2- 172.21.15.88:0/1807383742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6cc071c70 0x7fd6cc072100 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/1807383742 >> 172.21.15.88:0/1807383742 conn(0x7fd6cc06c190 msgr2=0x7fd6cc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:15.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/1807383742 shutdown_connections 2023-11-20T07:02:15.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/1807383742 wait complete. 2023-11-20T07:02:15.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 Processor -- start 2023-11-20T07:02:15.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 -- start start 2023-11-20T07:02:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6cc071c70 0x7fd6cc0c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc0b00e0 0x7fd6cc0c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6cc1591e0 0x7fd6cc1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0c2e70 con 0x7fd6cc1591e0 2023-11-20T07:02:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0c3380 con 0x7fd6cc071c70 2023-11-20T07:02:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d2fd3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0c47a0 con 0x7fd6cc0b00e0 2023-11-20T07:02:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d1570640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6cc1591e0 0x7fd6cc1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d1570640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6cc1591e0 0x7fd6cc1533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59346/0 (socket says 172.21.15.88:59346) 2023-11-20T07:02:15.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d1570640 1 -- 172.21.15.88:0/938791468 learned_addr learned my addr 172.21.15.88:0/938791468 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:15.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6d0d6f640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6cc071c70 0x7fd6cc0c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.861+0000 7fd6c3fff640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc0b00e0 0x7fd6cc0c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6d1570640 1 -- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc0b00e0 msgr2=0x7fd6cc0c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6d1570640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc0b00e0 0x7fd6cc0c2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6d1570640 1 -- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6cc071c70 msgr2=0x7fd6cc0c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:15.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6d1570640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6cc071c70 0x7fd6cc0c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:15.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6d1570640 1 -- 172.21.15.88:0/938791468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc0094d0 con 0x7fd6cc1591e0 2023-11-20T07:02:15.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6d1570640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6cc1591e0 0x7fd6cc1533d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4007de0 tx=0x7fd6c400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:15.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6c17fa640 1 -- 172.21.15.88:0/938791468 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40039a0 con 0x7fd6cc1591e0 2023-11-20T07:02:15.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6c17fa640 1 -- 172.21.15.88:0/938791468 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c400f040 con 0x7fd6cc1591e0 2023-11-20T07:02:15.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6c17fa640 1 -- 172.21.15.88:0/938791468 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4003d40 con 0x7fd6cc1591e0 2023-11-20T07:02:15.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/938791468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc0c30a0 con 0x7fd6cc1591e0 2023-11-20T07:02:15.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/938791468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc0c4d20 con 0x7fd6cc1591e0 2023-11-20T07:02:15.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/938791468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6cc14ff20 con 0x7fd6cc1591e0 2023-11-20T07:02:15.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6c17fa640 1 -- 172.21.15.88:0/938791468 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd6c4004030 con 0x7fd6cc1591e0 2023-11-20T07:02:15.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6c17fa640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd6b80664a0 0x7fd6b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:15.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6c17fa640 1 -- 172.21.15.88:0/938791468 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd6c4083f00 con 0x7fd6cc1591e0 2023-11-20T07:02:15.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.865+0000 7fd6d0d6f640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd6b80664a0 0x7fd6b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:15.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.869+0000 7fd6d0d6f640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd6b80664a0 0x7fd6b8068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0b0040 tx=0x7fd6c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:15.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:15.869+0000 7fd6c17fa640 1 -- 172.21.15.88:0/938791468 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd6cc14ff20 con 0x7fd6cc1591e0 2023-11-20T07:02:16.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.021+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/938791468 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6cc14ff20 con 0x7fd6cc1591e0 2023-11-20T07:02:16.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.021+0000 7fd6c17fa640 1 -- 172.21.15.88:0/938791468 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+13026 (secure 0 0 0) 0x7fd6cc14ff20 con 0x7fd6cc1591e0 2023-11-20T07:02:16.024 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:16.024 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":34,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:02:13.024546+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:16.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.025+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd6b80664a0 msgr2=0x7fd6b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.025+0000 7fd6d2fd3640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd6b80664a0 0x7fd6b8068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0b0040 tx=0x7fd6c8009040 comp rx=0 tx=0).stop 2023-11-20T07:02:16.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.025+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/938791468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6cc1591e0 msgr2=0x7fd6cc1533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.025+0000 7fd6d2fd3640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6cc1591e0 0x7fd6cc1533d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4007de0 tx=0x7fd6c400d4a0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.025+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/938791468 shutdown_connections 2023-11-20T07:02:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.025+0000 7fd6d2fd3640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd6b80664a0 0x7fd6b8068960 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.025+0000 7fd6d2fd3640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6cc0b00e0 0x7fd6cc0c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.025+0000 7fd6d2fd3640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6cc1591e0 0x7fd6cc1533d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.025+0000 7fd6d2fd3640 1 --2- 172.21.15.88:0/938791468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6cc071c70 0x7fd6cc0c23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.025+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/938791468 >> 172.21.15.88:0/938791468 conn(0x7fd6cc06c190 msgr2=0x7fd6cc15c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.025+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/938791468 shutdown_connections 2023-11-20T07:02:16.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.025+0000 7fd6d2fd3640 1 -- 172.21.15.88:0/938791468 wait complete. 2023-11-20T07:02:16.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-20T07:02:16.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:02:16.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f0464891640 1 Processor -- start 2023-11-20T07:02:16.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f0464891640 1 -- start start 2023-11-20T07:02:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f0464891640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f046006df40 0x7f04600702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f0464891640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0460070830 0x7f04600cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f0464891640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0460070c60 con 0x7f04601590d0 2023-11-20T07:02:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f0464891640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04600c9600 con 0x7f0460070830 2023-11-20T07:02:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f0464891640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04600c98e0 con 0x7f046006df40 2023-11-20T07:02:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f045ed9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0460070830 0x7f04600cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f045ed9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0460070830 0x7f04600cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47682/0 (socket says 172.21.15.88:47682) 2023-11-20T07:02:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f045ed9d640 1 -- 172.21.15.88:0/4274839848 learned_addr learned my addr 172.21.15.88:0/4274839848 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f045dd9b640 1 --2- 172.21.15.88:0/4274839848 >> v2:172.21.15.175:3300/0 conn(0x7f046006df40 0x7f04600702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f045ed9d640 1 -- 172.21.15.88:0/4274839848 >> v2:172.21.15.175:3300/0 conn(0x7f046006df40 msgr2=0x7f04600702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:16.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f045ed9d640 1 --2- 172.21.15.88:0/4274839848 >> v2:172.21.15.175:3300/0 conn(0x7f046006df40 0x7f04600702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f045ed9d640 1 -- 172.21.15.88:0/4274839848 >> v1:172.21.15.175:6789/0 conn(0x7f04601590d0 legacy=0x7f04600c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:16.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.185+0000 7f045ed9d640 1 -- 172.21.15.88:0/4274839848 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04600c9bc0 con 0x7f0460070830 2023-11-20T07:02:16.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.189+0000 7f045ed9d640 1 --2- 172.21.15.88:0/4274839848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0460070830 0x7f04600cc350 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f04600caf70 tx=0x7f045801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebcb0ce510a7aa server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:16.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.189+0000 7f045d59a640 1 -- 172.21.15.88:0/4274839848 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04580a56f0 con 0x7f0460070830 2023-11-20T07:02:16.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.189+0000 7f045d59a640 1 -- 172.21.15.88:0/4274839848 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04580a5850 con 0x7f0460070830 2023-11-20T07:02:16.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.189+0000 7f045d59a640 1 -- 172.21.15.88:0/4274839848 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04580a5be0 con 0x7f0460070830 2023-11-20T07:02:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.189+0000 7f0464891640 1 -- 172.21.15.88:0/4274839848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0460070830 msgr2=0x7f04600cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.189+0000 7f0464891640 1 --2- 172.21.15.88:0/4274839848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0460070830 0x7f04600cc350 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f04600caf70 tx=0x7f045801c9a0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.189+0000 7f0464891640 1 -- 172.21.15.88:0/4274839848 shutdown_connections 2023-11-20T07:02:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.189+0000 7f0464891640 1 --2- 172.21.15.88:0/4274839848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0460070830 0x7f04600cc350 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.189+0000 7f0464891640 1 --2- 172.21.15.88:0/4274839848 >> v2:172.21.15.175:3300/0 conn(0x7f046006df40 0x7f04600702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.189+0000 7f0464891640 1 -- 172.21.15.88:0/4274839848 >> 172.21.15.88:0/4274839848 conn(0x7f04600b0da0 msgr2=0x7f04600ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.189+0000 7f0464891640 1 -- 172.21.15.88:0/4274839848 shutdown_connections 2023-11-20T07:02:16.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.189+0000 7f0464891640 1 -- 172.21.15.88:0/4274839848 wait complete. 2023-11-20T07:02:16.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f0464891640 1 Processor -- start 2023-11-20T07:02:16.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f0464891640 1 -- start start 2023-11-20T07:02:16.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f0464891640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046006df40 0x7f04600c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f0464891640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0460070830 0x7f0460145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f0464891640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04601590d0 0x7f04601598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f0464891640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04600b2470 con 0x7f046006df40 2023-11-20T07:02:16.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f0464891640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0460146150 con 0x7f0460070830 2023-11-20T07:02:16.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f0464891640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0460159de0 con 0x7f04601590d0 2023-11-20T07:02:16.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f045e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046006df40 0x7f04600c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f045e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046006df40 0x7f04600c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47688/0 (socket says 172.21.15.88:47688) 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f045e59c640 1 -- 172.21.15.88:0/1316285072 learned_addr learned my addr 172.21.15.88:0/1316285072 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f045dd9b640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0460070830 0x7f0460145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f045ed9d640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04601590d0 0x7f04601598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f045e59c640 1 -- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04601590d0 msgr2=0x7f04601598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f045e59c640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04601590d0 0x7f04601598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f045e59c640 1 -- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0460070830 msgr2=0x7f0460145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f045e59c640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0460070830 0x7f0460145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f045e59c640 1 -- 172.21.15.88:0/1316285072 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0458009b30 con 0x7f046006df40 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f045e59c640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046006df40 0x7f04600c3cd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f045000c500 tx=0x7f045000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f044effd640 1 -- 172.21.15.88:0/1316285072 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0450005220 con 0x7f046006df40 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f044effd640 1 -- 172.21.15.88:0/1316285072 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0450005380 con 0x7f046006df40 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f0464891640 1 -- 172.21.15.88:0/1316285072 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04600ca820 con 0x7f046006df40 2023-11-20T07:02:16.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f044effd640 1 -- 172.21.15.88:0/1316285072 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0450007270 con 0x7f046006df40 2023-11-20T07:02:16.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.193+0000 7f0464891640 1 -- 172.21.15.88:0/1316285072 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04600b2930 con 0x7f046006df40 2023-11-20T07:02:16.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.197+0000 7f0464891640 1 -- 172.21.15.88:0/1316285072 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046004e170 con 0x7f046006df40 2023-11-20T07:02:16.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.197+0000 7f044effd640 1 -- 172.21.15.88:0/1316285072 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f04500073d0 con 0x7f046006df40 2023-11-20T07:02:16.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.197+0000 7f044effd640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f04400664d0 0x7f0440068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.197+0000 7f044effd640 1 -- 172.21.15.88:0/1316285072 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f04500833d0 con 0x7f046006df40 2023-11-20T07:02:16.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.197+0000 7f045dd9b640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f04400664d0 0x7f0440068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.201+0000 7f045dd9b640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f04400664d0 0x7f0440068990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f04601f8770 tx=0x7f0454008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:16.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.201+0000 7f044effd640 1 -- 172.21.15.88:0/1316285072 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0450050b20 con 0x7f046006df40 2023-11-20T07:02:16.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.349+0000 7f0464891640 1 -- 172.21.15.88:0/1316285072 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0460071270 con 0x7f046006df40 2023-11-20T07:02:16.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.349+0000 7f044effd640 1 -- 172.21.15.88:0/1316285072 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0450054140 con 0x7f046006df40 2023-11-20T07:02:16.352 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:02:16.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.353+0000 7f0464891640 1 -- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f04400664d0 msgr2=0x7f0440068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.353+0000 7f0464891640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f04400664d0 0x7f0440068990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f04601f8770 tx=0x7f0454008040 comp rx=0 tx=0).stop 2023-11-20T07:02:16.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.353+0000 7f0464891640 1 -- 172.21.15.88:0/1316285072 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046006df40 msgr2=0x7f04600c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.353+0000 7f0464891640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046006df40 0x7f04600c3cd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f045000c500 tx=0x7f045000c9c0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.353+0000 7f0464891640 1 -- 172.21.15.88:0/1316285072 shutdown_connections 2023-11-20T07:02:16.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.353+0000 7f0464891640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f04400664d0 0x7f0440068990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.353+0000 7f0464891640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04601590d0 0x7f04601598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.353+0000 7f0464891640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0460070830 0x7f0460145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.353+0000 7f0464891640 1 --2- 172.21.15.88:0/1316285072 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f046006df40 0x7f04600c3cd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.353+0000 7f0464891640 1 -- 172.21.15.88:0/1316285072 >> 172.21.15.88:0/1316285072 conn(0x7f04600b0da0 msgr2=0x7f04600ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:16.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.353+0000 7f0464891640 1 -- 172.21.15.88:0/1316285072 shutdown_connections 2023-11-20T07:02:16.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.353+0000 7f0464891640 1 -- 172.21.15.88:0/1316285072 wait complete. 2023-11-20T07:02:16.372 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-20T07:02:16.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba3cc9640 1 Processor -- start 2023-11-20T07:02:16.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba3cc9640 1 -- start start 2023-11-20T07:02:16.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba3cc9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0b9c15cb90 0x7f0b9c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba3cc9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0b9c0d15d0 0x7f0b9c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba3cc9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c0ce770 con 0x7f0b9c0d3010 2023-11-20T07:02:16.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba3cc9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9c0d0600 con 0x7f0b9c0d15d0 2023-11-20T07:02:16.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba3cc9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9c0c6450 con 0x7f0b9c15cb90 2023-11-20T07:02:16.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba2266640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0b9c0d15d0 0x7f0b9c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba2266640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0b9c0d15d0 0x7f0b9c0c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47704/0 (socket says 172.21.15.88:47704) 2023-11-20T07:02:16.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba2266640 1 -- 172.21.15.88:0/2156820360 learned_addr learned my addr 172.21.15.88:0/2156820360 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:16.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba1264640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0b9c0d3010 0x7f0b9c0d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58636/0 (socket says 172.21.15.88:58636) 2023-11-20T07:02:16.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba1a65640 1 --2- 172.21.15.88:0/2156820360 >> v2:172.21.15.175:3300/0 conn(0x7f0b9c15cb90 0x7f0b9c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba2266640 1 -- 172.21.15.88:0/2156820360 >> v2:172.21.15.175:3300/0 conn(0x7f0b9c15cb90 msgr2=0x7f0b9c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:16.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba2266640 1 --2- 172.21.15.88:0/2156820360 >> v2:172.21.15.175:3300/0 conn(0x7f0b9c15cb90 0x7f0b9c0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba2266640 1 -- 172.21.15.88:0/2156820360 >> v1:172.21.15.88:6789/0 conn(0x7f0b9c0d3010 legacy=0x7f0b9c0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.509+0000 7f0ba2266640 1 -- 172.21.15.88:0/2156820360 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c0d08a0 con 0x7f0b9c0d15d0 2023-11-20T07:02:16.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.513+0000 7f0ba2266640 1 --2- 172.21.15.88:0/2156820360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b9c0d15d0 0x7f0b9c0c6c10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c08ba70 tx=0x7f0b9401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9788924cb125f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:16.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.513+0000 7f0ba0a63640 1 -- 172.21.15.88:0/2156820360 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940a57d0 con 0x7f0b9c0d15d0 2023-11-20T07:02:16.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.513+0000 7f0ba0a63640 1 -- 172.21.15.88:0/2156820360 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b940a5930 con 0x7f0b9c0d15d0 2023-11-20T07:02:16.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.513+0000 7f0ba0a63640 1 -- 172.21.15.88:0/2156820360 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940a5cc0 con 0x7f0b9c0d15d0 2023-11-20T07:02:16.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.513+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/2156820360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b9c0d15d0 msgr2=0x7f0b9c0c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.513+0000 7f0ba3cc9640 1 --2- 172.21.15.88:0/2156820360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b9c0d15d0 0x7f0b9c0c6c10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c08ba70 tx=0x7f0b9401c910 comp rx=0 tx=0).stop 2023-11-20T07:02:16.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.513+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/2156820360 shutdown_connections 2023-11-20T07:02:16.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.513+0000 7f0ba3cc9640 1 --2- 172.21.15.88:0/2156820360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b9c0d15d0 0x7f0b9c0c6c10 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.513+0000 7f0ba3cc9640 1 --2- 172.21.15.88:0/2156820360 >> v2:172.21.15.175:3300/0 conn(0x7f0b9c15cb90 0x7f0b9c0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.513+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/2156820360 >> 172.21.15.88:0/2156820360 conn(0x7f0b9c09bc50 msgr2=0x7f0b9c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:16.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.513+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/2156820360 shutdown_connections 2023-11-20T07:02:16.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.513+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/2156820360 wait complete. 2023-11-20T07:02:16.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba3cc9640 1 Processor -- start 2023-11-20T07:02:16.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba3cc9640 1 -- start start 2023-11-20T07:02:16.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba3cc9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b9c0d15d0 0x7f0b9c14d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba3cc9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b9c0d3010 0x7f0b9c14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba3cc9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b9c15cb90 0x7f0b9c15b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba3cc9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c159b70 con 0x7f0b9c0d3010 2023-11-20T07:02:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba3cc9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c153b30 con 0x7f0b9c0d15d0 2023-11-20T07:02:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba3cc9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c1540f0 con 0x7f0b9c15cb90 2023-11-20T07:02:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba1264640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b9c0d3010 0x7f0b9c14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba1264640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b9c0d3010 0x7f0b9c14dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47716/0 (socket says 172.21.15.88:47716) 2023-11-20T07:02:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba1264640 1 -- 172.21.15.88:0/979538257 learned_addr learned my addr 172.21.15.88:0/979538257 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba1a65640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b9c0d15d0 0x7f0b9c14d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba2266640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b9c15cb90 0x7f0b9c15b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba1264640 1 -- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b9c15cb90 msgr2=0x7f0b9c15b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba1264640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b9c15cb90 0x7f0b9c15b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba1264640 1 -- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b9c0d15d0 msgr2=0x7f0b9c14d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba1264640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b9c0d15d0 0x7f0b9c14d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba1264640 1 -- 172.21.15.88:0/979538257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b94009b30 con 0x7f0b9c0d3010 2023-11-20T07:02:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba2266640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b9c15cb90 0x7f0b9c15b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba1a65640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b9c0d15d0 0x7f0b9c14d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba1264640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b9c0d3010 0x7f0b9c14dba0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00c460 tx=0x7f0b8c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0b927fc640 1 -- 172.21.15.88:0/979538257 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c007480 con 0x7f0b9c0d3010 2023-11-20T07:02:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0b927fc640 1 -- 172.21.15.88:0/979538257 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c007600 con 0x7f0b9c0d3010 2023-11-20T07:02:16.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0b927fc640 1 -- 172.21.15.88:0/979538257 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c004a30 con 0x7f0b9c0d3010 2023-11-20T07:02:16.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/979538257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9c0cdc80 con 0x7f0b9c0d3010 2023-11-20T07:02:16.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.517+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/979538257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9c153d80 con 0x7f0b9c0d3010 2023-11-20T07:02:16.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.521+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/979538257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9c074010 con 0x7f0b9c0d3010 2023-11-20T07:02:16.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.521+0000 7f0b927fc640 1 -- 172.21.15.88:0/979538257 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0b8c004b90 con 0x7f0b9c0d3010 2023-11-20T07:02:16.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.521+0000 7f0b927fc640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0b800664a0 0x7f0b80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.521+0000 7f0b927fc640 1 -- 172.21.15.88:0/979538257 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0b8c082f30 con 0x7f0b9c0d3010 2023-11-20T07:02:16.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.521+0000 7f0ba1a65640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0b800664a0 0x7f0b80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.521+0000 7f0ba1a65640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0b800664a0 0x7f0b80068960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0b98006fd0 tx=0x7f0b98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:16.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.525+0000 7f0b927fc640 1 -- 172.21.15.88:0/979538257 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0b8c050490 con 0x7f0b9c0d3010 2023-11-20T07:02:16.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/979538257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0b9c154260 con 0x7f0b9c0d3010 2023-11-20T07:02:16.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0b927fc640 1 -- 172.21.15.88:0/979538257 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0b8c018070 con 0x7f0b9c0d3010 2023-11-20T07:02:16.678 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:16.678 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-11-20T07:02:16.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-11-20T07:02:16.678 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-11-20T07:02:16.679 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-11-20T07:02:16.679 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:16.679 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-11-20T07:02:16.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0b800664a0 msgr2=0x7f0b80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0b800664a0 0x7f0b80068960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0b98006fd0 tx=0x7f0b98008040 comp rx=0 tx=0).stop 2023-11-20T07:02:16.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/979538257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b9c0d3010 msgr2=0x7f0b9c14dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b9c0d3010 0x7f0b9c14dba0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00c460 tx=0x7f0b8c00c920 comp rx=0 tx=0).stop 2023-11-20T07:02:16.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/979538257 shutdown_connections 2023-11-20T07:02:16.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0b800664a0 0x7f0b80068960 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b9c15cb90 0x7f0b9c15b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b9c0d3010 0x7f0b9c14dba0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 --2- 172.21.15.88:0/979538257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b9c0d15d0 0x7f0b9c14d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/979538257 >> 172.21.15.88:0/979538257 conn(0x7f0b9c09bc50 msgr2=0x7f0b9c0c7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:16.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/979538257 shutdown_connections 2023-11-20T07:02:16.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.677+0000 7f0ba3cc9640 1 -- 172.21.15.88:0/979538257 wait complete. 2023-11-20T07:02:16.699 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-20T07:02:16.699 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-20T07:02:16.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.837+0000 7fc766d3e640 1 Processor -- start 2023-11-20T07:02:16.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc766d3e640 1 -- start start 2023-11-20T07:02:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc766d3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7601600e0 0x7fc7600cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc766d3e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7600caf20 con 0x7fc7600cfd50 2023-11-20T07:02:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc766d3e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7600b3720 con 0x7fc7600cd9c0 2023-11-20T07:02:16.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc766d3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7600d02a0 con 0x7fc7601600e0 2023-11-20T07:02:16.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc7600cfd50 0x7fc7600cd2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58638/0 (socket says 172.21.15.88:58638) 2023-11-20T07:02:16.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75ffff640 1 -- 172.21.15.88:0/3947699798 learned_addr learned my addr 172.21.15.88:0/3947699798 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc764ada640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7601600e0 0x7fc7600cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794636409 0 0) 0x7fc7600caf20 con 0x7fc7600cfd50 2023-11-20T07:02:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc750003530 con 0x7fc7600cfd50 2023-11-20T07:02:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1370091267 0 0) 0x7fc750003530 con 0x7fc7600cfd50 2023-11-20T07:02:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7601600e0 msgr2=0x7fc7600cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7601600e0 0x7fc7600cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 >> v1:172.21.15.175:6789/0 conn(0x7fc7600cd9c0 legacy=0x7fc7600cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7600cb170 con 0x7fc7600cfd50 2023-11-20T07:02:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fc74c001680 con 0x7fc7600cfd50 2023-11-20T07:02:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 >> v1:172.21.15.88:6789/0 conn(0x7fc7600cfd50 legacy=0x7fc7600cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7601600e0 0x7fc7500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc750003ef0 0x7fc7500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc750004d10 0x7fc750005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7600d02a0 con 0x7fc750003ef0 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75000baa0 con 0x7fc750004d10 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75000bc60 con 0x7fc7601600e0 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75ffff640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc750003ef0 0x7fc7500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc764ada640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7601600e0 0x7fc7500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc7652db640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc750004d10 0x7fc750005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75ffff640 1 -- 172.21.15.88:0/3947699798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7601600e0 msgr2=0x7fc7500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75ffff640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7601600e0 0x7fc7500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75ffff640 1 -- 172.21.15.88:0/3947699798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc750004d10 msgr2=0x7fc750005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75ffff640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc750004d10 0x7fc750005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc75ffff640 1 -- 172.21.15.88:0/3947699798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc750003530 con 0x7fc750003ef0 2023-11-20T07:02:16.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.841+0000 7fc7652db640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc750004d10 0x7fc750005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:16.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.845+0000 7fc75ffff640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc750003ef0 0x7fc7500047d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00c190 tx=0x7fc74c01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad0014490c9cbd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:16.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.845+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c005ae0 con 0x7fc750003ef0 2023-11-20T07:02:16.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.845+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c005c60 con 0x7fc750003ef0 2023-11-20T07:02:16.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.845+0000 7fc75f7fe640 1 -- 172.21.15.88:0/3947699798 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0a5b00 con 0x7fc750003ef0 2023-11-20T07:02:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.845+0000 7fc766d3e640 1 -- 172.21.15.88:0/3947699798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc750003ef0 msgr2=0x7fc7500047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.845+0000 7fc766d3e640 1 --2- 172.21.15.88:0/3947699798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc750003ef0 0x7fc7500047d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00c190 tx=0x7fc74c01cbc0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.845+0000 7fc7652db640 1 -- 172.21.15.88:0/3947699798 reap_dead start 2023-11-20T07:02:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.845+0000 7fc766d3e640 1 -- 172.21.15.88:0/3947699798 shutdown_connections 2023-11-20T07:02:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.845+0000 7fc766d3e640 1 -- 172.21.15.88:0/3947699798 >> 172.21.15.88:0/3947699798 conn(0x7fc7600d08d0 msgr2=0x7fc7600d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.845+0000 7fc766d3e640 1 -- 172.21.15.88:0/3947699798 shutdown_connections 2023-11-20T07:02:16.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.845+0000 7fc766d3e640 1 -- 172.21.15.88:0/3947699798 wait complete. 2023-11-20T07:02:16.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc766d3e640 1 Processor -- start 2023-11-20T07:02:16.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc766d3e640 1 -- start start 2023-11-20T07:02:16.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc766d3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc750003ef0 0x7fc76015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc766d3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7600c72f0 0x7fc76014ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc766d3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc76014f830 0x7fc7600b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc766d3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76014f380 con 0x7fc76014f830 2023-11-20T07:02:16.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc766d3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc760152710 con 0x7fc7600c72f0 2023-11-20T07:02:16.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc766d3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7600c7770 con 0x7fc750003ef0 2023-11-20T07:02:16.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc7652db640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc76014f830 0x7fc7600b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc7652db640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc76014f830 0x7fc7600b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47734/0 (socket says 172.21.15.88:47734) 2023-11-20T07:02:16.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc7652db640 1 -- 172.21.15.88:0/3286168865 learned_addr learned my addr 172.21.15.88:0/3286168865 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc764ada640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc750003ef0 0x7fc76015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc75ffff640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7600c72f0 0x7fc76014ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc7652db640 1 -- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc750003ef0 msgr2=0x7fc76015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc7652db640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc750003ef0 0x7fc76015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc7652db640 1 -- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7600c72f0 msgr2=0x7fc76014ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc7652db640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7600c72f0 0x7fc76014ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc7652db640 1 -- 172.21.15.88:0/3286168865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7600c52e0 con 0x7fc76014f830 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc7652db640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc76014f830 0x7fc7600b4bc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc7600b3490 tx=0x7fc758010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc75d7fa640 1 -- 172.21.15.88:0/3286168865 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc758003d90 con 0x7fc76014f830 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc75d7fa640 1 -- 172.21.15.88:0/3286168865 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75800d070 con 0x7fc76014f830 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc766d3e640 1 -- 172.21.15.88:0/3286168865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7600c55c0 con 0x7fc76014f830 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc75d7fa640 1 -- 172.21.15.88:0/3286168865 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75800e9d0 con 0x7fc76014f830 2023-11-20T07:02:16.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc766d3e640 1 -- 172.21.15.88:0/3286168865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7600c5b80 con 0x7fc76014f830 2023-11-20T07:02:16.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.849+0000 7fc766d3e640 1 -- 172.21.15.88:0/3286168865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7600c5d40 con 0x7fc76014f830 2023-11-20T07:02:16.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.853+0000 7fc75d7fa640 1 -- 172.21.15.88:0/3286168865 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc75800eb30 con 0x7fc76014f830 2023-11-20T07:02:16.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.853+0000 7fc75d7fa640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc7440664d0 0x7fc744068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:16.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.853+0000 7fc75d7fa640 1 -- 172.21.15.88:0/3286168865 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc758086d70 con 0x7fc76014f830 2023-11-20T07:02:16.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.853+0000 7fc764ada640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc7440664d0 0x7fc744068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:16.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.853+0000 7fc764ada640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc7440664d0 0x7fc744068990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc754009b60 tx=0x7fc754009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:16.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:16.857+0000 7fc75d7fa640 1 -- 172.21.15.88:0/3286168865 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc758054360 con 0x7fc76014f830 2023-11-20T07:02:17.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.005+0000 7fc766d3e640 1 -- 172.21.15.88:0/3286168865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc76004e170 con 0x7fc76014f830 2023-11-20T07:02:17.226 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:02:17.230 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:02:17.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.317+0000 7fc75d7fa640 1 -- 172.21.15.88:0/3286168865 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc758057980 con 0x7fc76014f830 2023-11-20T07:02:17.319 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2023-11-20T07:02:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.321+0000 7fc766d3e640 1 -- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc7440664d0 msgr2=0x7fc744068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.321+0000 7fc766d3e640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc7440664d0 0x7fc744068990 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc754009b60 tx=0x7fc754009190 comp rx=0 tx=0).stop 2023-11-20T07:02:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.321+0000 7fc766d3e640 1 -- 172.21.15.88:0/3286168865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc76014f830 msgr2=0x7fc7600b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.321+0000 7fc766d3e640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc76014f830 0x7fc7600b4bc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc7600b3490 tx=0x7fc758010e80 comp rx=0 tx=0).stop 2023-11-20T07:02:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.321+0000 7fc766d3e640 1 -- 172.21.15.88:0/3286168865 shutdown_connections 2023-11-20T07:02:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.321+0000 7fc766d3e640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc7440664d0 0x7fc744068990 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.321+0000 7fc766d3e640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc76014f830 0x7fc7600b4bc0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.321+0000 7fc766d3e640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7600c72f0 0x7fc76014ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:17.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.321+0000 7fc766d3e640 1 --2- 172.21.15.88:0/3286168865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc750003ef0 0x7fc76015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:17.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.321+0000 7fc766d3e640 1 -- 172.21.15.88:0/3286168865 >> 172.21.15.88:0/3286168865 conn(0x7fc7600d08d0 msgr2=0x7fc7600d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:17.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.321+0000 7fc766d3e640 1 -- 172.21.15.88:0/3286168865 shutdown_connections 2023-11-20T07:02:17.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.321+0000 7fc766d3e640 1 -- 172.21.15.88:0/3286168865 wait complete. 2023-11-20T07:02:17.345 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-20T07:02:17.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.489+0000 7f586706b640 1 Processor -- start 2023-11-20T07:02:17.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.489+0000 7f586706b640 1 -- start start 2023-11-20T07:02:17.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.489+0000 7f586706b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f586006a5a0 0x7f5860167ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:17.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.489+0000 7f586706b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5860160c40 con 0x7f586015c9f0 2023-11-20T07:02:17.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.489+0000 7f586706b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5860160f20 con 0x7f586015cdd0 2023-11-20T07:02:17.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.489+0000 7f586706b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58600ccb50 con 0x7f586006a5a0 2023-11-20T07:02:17.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.489+0000 7f5865608640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f586006a5a0 0x7f5860167ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:17.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.489+0000 7f5865608640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f586006a5a0 0x7f5860167ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47742/0 (socket says 172.21.15.88:47742) 2023-11-20T07:02:17.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.489+0000 7f5865608640 1 -- 172.21.15.88:0/431263545 learned_addr learned my addr 172.21.15.88:0/431263545 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:17.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.489+0000 7f5865608640 1 -- 172.21.15.88:0/431263545 >> v1:172.21.15.175:6789/0 conn(0x7f586015cdd0 legacy=0x7f5860069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.489+0000 7f5865608640 1 -- 172.21.15.88:0/431263545 >> v1:172.21.15.88:6789/0 conn(0x7f586015c9f0 legacy=0x7f58600cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.489+0000 7f5865608640 1 -- 172.21.15.88:0/431263545 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5860161200 con 0x7f586006a5a0 2023-11-20T07:02:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.493+0000 7f5865608640 1 --2- 172.21.15.88:0/431263545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f586006a5a0 0x7f5860167ad0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5858009e50 tx=0x7f585801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3a176fecc9d87a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.493+0000 7f58577fe640 1 -- 172.21.15.88:0/431263545 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58580a5840 con 0x7f586006a5a0 2023-11-20T07:02:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.493+0000 7f58577fe640 1 -- 172.21.15.88:0/431263545 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58580a59a0 con 0x7f586006a5a0 2023-11-20T07:02:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.493+0000 7f58577fe640 1 -- 172.21.15.88:0/431263545 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58580a5d30 con 0x7f586006a5a0 2023-11-20T07:02:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.493+0000 7f586706b640 1 -- 172.21.15.88:0/431263545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f586006a5a0 msgr2=0x7f5860167ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.493+0000 7f586706b640 1 --2- 172.21.15.88:0/431263545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f586006a5a0 0x7f5860167ad0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5858009e50 tx=0x7f585801c9a0 comp rx=0 tx=0).stop 2023-11-20T07:02:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.493+0000 7f586706b640 1 -- 172.21.15.88:0/431263545 shutdown_connections 2023-11-20T07:02:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.493+0000 7f586706b640 1 --2- 172.21.15.88:0/431263545 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f586006a5a0 0x7f5860167ad0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:17.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.493+0000 7f586706b640 1 -- 172.21.15.88:0/431263545 >> 172.21.15.88:0/431263545 conn(0x7f58600b0d10 msgr2=0x7f58600ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:17.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.493+0000 7f586706b640 1 -- 172.21.15.88:0/431263545 shutdown_connections 2023-11-20T07:02:17.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.493+0000 7f586706b640 1 -- 172.21.15.88:0/431263545 wait complete. 2023-11-20T07:02:17.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f586706b640 1 Processor -- start 2023-11-20T07:02:17.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f586706b640 1 -- start start 2023-11-20T07:02:17.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f586706b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f586006a5a0 0x7f586013f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:17.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f586706b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f586015c9f0 0x7f586015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:17.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f586706b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f586015f880 0x7f586015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:17.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f586706b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58600ab860 con 0x7f586015c9f0 2023-11-20T07:02:17.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f586706b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586015fe20 con 0x7f586006a5a0 2023-11-20T07:02:17.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f586706b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58600abab0 con 0x7f586015f880 2023-11-20T07:02:17.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f5857fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f586015c9f0 0x7f586015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:17.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f5857fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f586015c9f0 0x7f586015f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47758/0 (socket says 172.21.15.88:47758) 2023-11-20T07:02:17.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f5857fff640 1 -- 172.21.15.88:0/627543472 learned_addr learned my addr 172.21.15.88:0/627543472 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:17.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f5864e07640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f586006a5a0 0x7f586013f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:17.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f5865608640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f586015f880 0x7f586015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:17.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f5857fff640 1 -- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f586015f880 msgr2=0x7f586015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:17.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f5857fff640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f586015f880 0x7f586015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:17.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f5857fff640 1 -- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f586006a5a0 msgr2=0x7f586013f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:17.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f5857fff640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f586006a5a0 0x7f586013f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:17.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f5857fff640 1 -- 172.21.15.88:0/627543472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858009b30 con 0x7f586015c9f0 2023-11-20T07:02:17.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f5857fff640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f586015c9f0 0x7f586015f340 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f585000b3e0 tx=0x7f585000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:17.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f58557fa640 1 -- 172.21.15.88:0/627543472 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850011830 con 0x7f586015c9f0 2023-11-20T07:02:17.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f58557fa640 1 -- 172.21.15.88:0/627543472 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58500119b0 con 0x7f586015c9f0 2023-11-20T07:02:17.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f586706b640 1 -- 172.21.15.88:0/627543472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58600abd90 con 0x7f586015c9f0 2023-11-20T07:02:17.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f58557fa640 1 -- 172.21.15.88:0/627543472 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850011d60 con 0x7f586015c9f0 2023-11-20T07:02:17.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f586706b640 1 -- 172.21.15.88:0/627543472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586013f5d0 con 0x7f586015c9f0 2023-11-20T07:02:17.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.497+0000 7f586706b640 1 -- 172.21.15.88:0/627543472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58600ac2b0 con 0x7f586015c9f0 2023-11-20T07:02:17.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.501+0000 7f58557fa640 1 -- 172.21.15.88:0/627543472 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f585001a400 con 0x7f586015c9f0 2023-11-20T07:02:17.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.501+0000 7f58557fa640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f584c0664a0 0x7f584c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:17.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.501+0000 7f58557fa640 1 -- 172.21.15.88:0/627543472 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f58500843f0 con 0x7f586015c9f0 2023-11-20T07:02:17.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.501+0000 7f5864e07640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f584c0664a0 0x7f584c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:17.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.501+0000 7f5864e07640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f584c0664a0 0x7f584c068960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5860158e70 tx=0x7f585c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:17.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.505+0000 7f58557fa640 1 -- 172.21.15.88:0/627543472 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f58500519a0 con 0x7f586015c9f0 2023-11-20T07:02:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:17.657+0000 7f586706b640 1 -- 172.21.15.88:0/627543472 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f58600ac2b0 con 0x7f586015c9f0 2023-11-20T07:02:18.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.325+0000 7f58557fa640 1 -- 172.21.15.88:0/627543472 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7f58600ac2b0 con 0x7f586015c9f0 2023-11-20T07:02:18.328 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2023-11-20T07:02:18.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.329+0000 7f586706b640 1 -- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f584c0664a0 msgr2=0x7f584c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:18.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.329+0000 7f586706b640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f584c0664a0 0x7f584c068960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5860158e70 tx=0x7f585c009040 comp rx=0 tx=0).stop 2023-11-20T07:02:18.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.329+0000 7f586706b640 1 -- 172.21.15.88:0/627543472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f586015c9f0 msgr2=0x7f586015f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:18.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.329+0000 7f586706b640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f586015c9f0 0x7f586015f340 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f585000b3e0 tx=0x7f585000b8a0 comp rx=0 tx=0).stop 2023-11-20T07:02:18.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.329+0000 7f586706b640 1 -- 172.21.15.88:0/627543472 shutdown_connections 2023-11-20T07:02:18.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.329+0000 7f586706b640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f584c0664a0 0x7f584c068960 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:18.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.329+0000 7f586706b640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f586015f880 0x7f586015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:18.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.329+0000 7f586706b640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f586015c9f0 0x7f586015f340 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:18.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.329+0000 7f586706b640 1 --2- 172.21.15.88:0/627543472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f586006a5a0 0x7f586013f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:18.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.329+0000 7f586706b640 1 -- 172.21.15.88:0/627543472 >> 172.21.15.88:0/627543472 conn(0x7f58600b0d10 msgr2=0x7f586006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:18.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.329+0000 7f586706b640 1 -- 172.21.15.88:0/627543472 shutdown_connections 2023-11-20T07:02:18.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.329+0000 7f586706b640 1 -- 172.21.15.88:0/627543472 wait complete. 2023-11-20T07:02:18.364 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-20T07:02:18.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b4165640 1 Processor -- start 2023-11-20T07:02:18.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b4165640 1 -- start start 2023-11-20T07:02:18.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b4165640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8ac159900 0x7fb8ac06e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:18.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b4165640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8ac06a5a0 0x7fb8ac0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:18.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b4165640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ac0b4390 con 0x7fb8ac0b3f00 2023-11-20T07:02:18.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b4165640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac0cd740 con 0x7fb8ac159900 2023-11-20T07:02:18.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b4165640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac0b4600 con 0x7fb8ac06a5a0 2023-11-20T07:02:18.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b1f01640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8ac159900 0x7fb8ac06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:18.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b1f01640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8ac159900 0x7fb8ac06e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47762/0 (socket says 172.21.15.88:47762) 2023-11-20T07:02:18.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b1f01640 1 -- 172.21.15.88:0/3727050855 learned_addr learned my addr 172.21.15.88:0/3727050855 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:18.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b2702640 1 --2- 172.21.15.88:0/3727050855 >> v2:172.21.15.175:3300/0 conn(0x7fb8ac06a5a0 0x7fb8ac0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:18.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b1f01640 1 -- 172.21.15.88:0/3727050855 >> v2:172.21.15.175:3300/0 conn(0x7fb8ac06a5a0 msgr2=0x7fb8ac0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:18.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b1f01640 1 --2- 172.21.15.88:0/3727050855 >> v2:172.21.15.175:3300/0 conn(0x7fb8ac06a5a0 0x7fb8ac0c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:18.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b1f01640 1 -- 172.21.15.88:0/3727050855 >> v1:172.21.15.175:6789/0 conn(0x7fb8ac0b3f00 legacy=0x7fb8ac069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:18.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.505+0000 7fb8b1f01640 1 -- 172.21.15.88:0/3727050855 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0c8dd0 con 0x7fb8ac159900 2023-11-20T07:02:18.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.509+0000 7fb8b1f01640 1 --2- 172.21.15.88:0/3727050855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8ac159900 0x7fb8ac06e260 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0b4910 tx=0x7fb8a801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9c16d4b0cf0c86 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:18.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.509+0000 7fb8b0eff640 1 -- 172.21.15.88:0/3727050855 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80a7c30 con 0x7fb8ac159900 2023-11-20T07:02:18.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.509+0000 7fb8b0eff640 1 -- 172.21.15.88:0/3727050855 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a80a7d90 con 0x7fb8ac159900 2023-11-20T07:02:18.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.509+0000 7fb8b0eff640 1 -- 172.21.15.88:0/3727050855 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80af660 con 0x7fb8ac159900 2023-11-20T07:02:18.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.509+0000 7fb8b4165640 1 -- 172.21.15.88:0/3727050855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8ac159900 msgr2=0x7fb8ac06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:18.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.509+0000 7fb8b4165640 1 --2- 172.21.15.88:0/3727050855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8ac159900 0x7fb8ac06e260 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0b4910 tx=0x7fb8a801eb60 comp rx=0 tx=0).stop 2023-11-20T07:02:18.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.509+0000 7fb8b4165640 1 -- 172.21.15.88:0/3727050855 shutdown_connections 2023-11-20T07:02:18.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.509+0000 7fb8b4165640 1 --2- 172.21.15.88:0/3727050855 >> v2:172.21.15.175:3300/0 conn(0x7fb8ac06a5a0 0x7fb8ac0c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:18.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.509+0000 7fb8b4165640 1 --2- 172.21.15.88:0/3727050855 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8ac159900 0x7fb8ac06e260 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:18.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.509+0000 7fb8b4165640 1 -- 172.21.15.88:0/3727050855 >> 172.21.15.88:0/3727050855 conn(0x7fb8ac0b0da0 msgr2=0x7fb8ac0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:18.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.509+0000 7fb8b4165640 1 -- 172.21.15.88:0/3727050855 shutdown_connections 2023-11-20T07:02:18.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.509+0000 7fb8b4165640 1 -- 172.21.15.88:0/3727050855 wait complete. 2023-11-20T07:02:18.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b4165640 1 Processor -- start 2023-11-20T07:02:18.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b4165640 1 -- start start 2023-11-20T07:02:18.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b4165640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8ac06a5a0 0x7fb8ac152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:18.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b4165640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ac0b3f00 0x7fb8ac0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:18.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b4165640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8ac159900 0x7fb8ac15c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:18.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b4165640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac150c30 con 0x7fb8ac06a5a0 2023-11-20T07:02:18.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b4165640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0b1420 con 0x7fb8ac159900 2023-11-20T07:02:18.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b4165640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0b1700 con 0x7fb8ac0b3f00 2023-11-20T07:02:18.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b1f01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8ac06a5a0 0x7fb8ac152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:18.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b1f01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8ac06a5a0 0x7fb8ac152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47766/0 (socket says 172.21.15.88:47766) 2023-11-20T07:02:18.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b1f01640 1 -- 172.21.15.88:0/2281240102 learned_addr learned my addr 172.21.15.88:0/2281240102 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:18.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b1700640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ac0b3f00 0x7fb8ac0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:18.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b1f01640 1 -- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ac0b3f00 msgr2=0x7fb8ac0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:18.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b1f01640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ac0b3f00 0x7fb8ac0cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:18.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b1f01640 1 -- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8ac159900 msgr2=0x7fb8ac15c540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-20T07:02:18.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b1f01640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8ac159900 0x7fb8ac15c540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:18.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b1f01640 1 -- 172.21.15.88:0/2281240102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a800b770 con 0x7fb8ac06a5a0 2023-11-20T07:02:18.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b1f01640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8ac06a5a0 0x7fb8ac152290 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800b2c0 tx=0x7fb8a801b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:18.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8a27fc640 1 -- 172.21.15.88:0/2281240102 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80afe20 con 0x7fb8ac06a5a0 2023-11-20T07:02:18.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8a27fc640 1 -- 172.21.15.88:0/2281240102 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a80ba440 con 0x7fb8ac06a5a0 2023-11-20T07:02:18.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8a27fc640 1 -- 172.21.15.88:0/2281240102 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80ba7f0 con 0x7fb8ac06a5a0 2023-11-20T07:02:18.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b4165640 1 -- 172.21.15.88:0/2281240102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac0b19e0 con 0x7fb8ac06a5a0 2023-11-20T07:02:18.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b4165640 1 -- 172.21.15.88:0/2281240102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac0b21e0 con 0x7fb8ac06a5a0 2023-11-20T07:02:18.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.513+0000 7fb8b4165640 1 -- 172.21.15.88:0/2281240102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac04e170 con 0x7fb8ac06a5a0 2023-11-20T07:02:18.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.517+0000 7fb8a27fc640 1 -- 172.21.15.88:0/2281240102 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb8a80b93e0 con 0x7fb8ac06a5a0 2023-11-20T07:02:18.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.517+0000 7fb8a27fc640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb8900664d0 0x7fb890068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:18.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.517+0000 7fb8a27fc640 1 -- 172.21.15.88:0/2281240102 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fb8a811e740 con 0x7fb8ac06a5a0 2023-11-20T07:02:18.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.517+0000 7fb8b1700640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb8900664d0 0x7fb890068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:18.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.517+0000 7fb8b1700640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb8900664d0 0x7fb890068990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac157900 tx=0x7fb89c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:18.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.521+0000 7fb8a27fc640 1 -- 172.21.15.88:0/2281240102 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb8a80eba40 con 0x7fb8ac06a5a0 2023-11-20T07:02:18.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:18.701+0000 7fb8b4165640 1 -- 172.21.15.88:0/2281240102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb8ac0b1e90 con 0x7fb8ac06a5a0 2023-11-20T07:02:19.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8a27fc640 1 -- 172.21.15.88:0/2281240102 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb8a80b40c0 con 0x7fb8ac06a5a0 2023-11-20T07:02:19.337 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 5 and data pool 6 2023-11-20T07:02:19.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8b4165640 1 -- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb8900664d0 msgr2=0x7fb890068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:19.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8b4165640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb8900664d0 0x7fb890068990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac157900 tx=0x7fb89c009040 comp rx=0 tx=0).stop 2023-11-20T07:02:19.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8b4165640 1 -- 172.21.15.88:0/2281240102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8ac06a5a0 msgr2=0x7fb8ac152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:19.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8b4165640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8ac06a5a0 0x7fb8ac152290 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800b2c0 tx=0x7fb8a801b900 comp rx=0 tx=0).stop 2023-11-20T07:02:19.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8b4165640 1 -- 172.21.15.88:0/2281240102 shutdown_connections 2023-11-20T07:02:19.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8b4165640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb8900664d0 0x7fb890068990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8b4165640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8ac0b3f00 0x7fb8ac0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8b4165640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8ac159900 0x7fb8ac15c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8b4165640 1 --2- 172.21.15.88:0/2281240102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8ac06a5a0 0x7fb8ac152290 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8b4165640 1 -- 172.21.15.88:0/2281240102 >> 172.21.15.88:0/2281240102 conn(0x7fb8ac0b0da0 msgr2=0x7fb8ac158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:19.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8b4165640 1 -- 172.21.15.88:0/2281240102 shutdown_connections 2023-11-20T07:02:19.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.337+0000 7fb8b4165640 1 -- 172.21.15.88:0/2281240102 wait complete. 2023-11-20T07:02:19.366 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:19.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.501+0000 7f385c609640 1 Processor -- start 2023-11-20T07:02:19.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.501+0000 7f385c609640 1 -- start start 2023-11-20T07:02:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385c609640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3854070c40 0x7f385415ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385c609640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f38540b4020 0x7f38540b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385c609640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38540b0620 0x7f385415c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385c609640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385415b3b0 con 0x7f3854070c40 2023-11-20T07:02:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385c609640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38540b0a70 con 0x7f38540b4020 2023-11-20T07:02:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385c609640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385415be60 con 0x7f38540b0620 2023-11-20T07:02:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385a3a5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3854070c40 0x7f385415ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385a3a5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3854070c40 0x7f385415ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47770/0 (socket says 172.21.15.88:47770) 2023-11-20T07:02:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385a3a5640 1 -- 172.21.15.88:0/2171696299 learned_addr learned my addr 172.21.15.88:0/2171696299 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:19.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385aba6640 1 --2- 172.21.15.88:0/2171696299 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38540b0620 0x7f385415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f3859ba4640 1 --2- 172.21.15.88:0/2171696299 >> v2:172.21.15.175:3300/0 conn(0x7f38540b4020 0x7f38540b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385a3a5640 1 -- 172.21.15.88:0/2171696299 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38540b0620 msgr2=0x7f385415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385a3a5640 1 --2- 172.21.15.88:0/2171696299 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38540b0620 0x7f385415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385a3a5640 1 -- 172.21.15.88:0/2171696299 >> v2:172.21.15.175:3300/0 conn(0x7f38540b4020 msgr2=0x7f38540b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385a3a5640 1 --2- 172.21.15.88:0/2171696299 >> v2:172.21.15.175:3300/0 conn(0x7f38540b4020 0x7f38540b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385a3a5640 1 -- 172.21.15.88:0/2171696299 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385415c1f0 con 0x7f3854070c40 2023-11-20T07:02:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f385aba6640 1 --2- 172.21.15.88:0/2171696299 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38540b0620 0x7f385415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:19.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.505+0000 7f3859ba4640 1 --2- 172.21.15.88:0/2171696299 >> v2:172.21.15.175:3300/0 conn(0x7f38540b4020 0x7f38540b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:19.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f385a3a5640 1 --2- 172.21.15.88:0/2171696299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3854070c40 0x7f385415ae70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f38540cc1e0 tx=0x7f385001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8d27de50373277 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f38593a3640 1 -- 172.21.15.88:0/2171696299 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38500a7070 con 0x7f3854070c40 2023-11-20T07:02:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f38593a3640 1 -- 172.21.15.88:0/2171696299 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38500ab430 con 0x7f3854070c40 2023-11-20T07:02:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f38593a3640 1 -- 172.21.15.88:0/2171696299 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38500ab7c0 con 0x7f3854070c40 2023-11-20T07:02:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f385c609640 1 -- 172.21.15.88:0/2171696299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3854070c40 msgr2=0x7f385415ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f385c609640 1 --2- 172.21.15.88:0/2171696299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3854070c40 0x7f385415ae70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f38540cc1e0 tx=0x7f385001c470 comp rx=0 tx=0).stop 2023-11-20T07:02:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f385c609640 1 -- 172.21.15.88:0/2171696299 shutdown_connections 2023-11-20T07:02:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f385c609640 1 --2- 172.21.15.88:0/2171696299 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38540b0620 0x7f385415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f385c609640 1 --2- 172.21.15.88:0/2171696299 >> v2:172.21.15.175:3300/0 conn(0x7f38540b4020 0x7f38540b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f385c609640 1 --2- 172.21.15.88:0/2171696299 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3854070c40 0x7f385415ae70 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f385c609640 1 -- 172.21.15.88:0/2171696299 >> 172.21.15.88:0/2171696299 conn(0x7f385406c190 msgr2=0x7f385406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f385c609640 1 -- 172.21.15.88:0/2171696299 shutdown_connections 2023-11-20T07:02:19.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f385c609640 1 -- 172.21.15.88:0/2171696299 wait complete. 2023-11-20T07:02:19.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f385c609640 1 Processor -- start 2023-11-20T07:02:19.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.509+0000 7f385c609640 1 -- start start 2023-11-20T07:02:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f385c609640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3854070c40 0x7f38541f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f385c609640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38540b0620 0x7f38540b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f385c609640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38540b4020 0x7f3854149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f385c609640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540b3460 con 0x7f38540b0620 2023-11-20T07:02:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f385c609640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3854155fd0 con 0x7f38540b4020 2023-11-20T07:02:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f385c609640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38541f6f80 con 0x7f3854070c40 2023-11-20T07:02:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f3859ba4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38540b0620 0x7f38540b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f3859ba4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38540b0620 0x7f38540b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47772/0 (socket says 172.21.15.88:47772) 2023-11-20T07:02:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f3859ba4640 1 -- 172.21.15.88:0/2966912695 learned_addr learned my addr 172.21.15.88:0/2966912695 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f385a3a5640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3854070c40 0x7f38541f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f385aba6640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38540b4020 0x7f3854149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f3859ba4640 1 -- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3854070c40 msgr2=0x7f38541f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f3859ba4640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3854070c40 0x7f38541f6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f3859ba4640 1 -- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38540b4020 msgr2=0x7f3854149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f3859ba4640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38540b4020 0x7f3854149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f3859ba4640 1 -- 172.21.15.88:0/2966912695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38500094d0 con 0x7f38540b0620 2023-11-20T07:02:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f385a3a5640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3854070c40 0x7f38541f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f3859ba4640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38540b0620 0x7f38540b2f20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f384400d800 tx=0x7f384400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f384affd640 1 -- 172.21.15.88:0/2966912695 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400b6c0 con 0x7f38540b0620 2023-11-20T07:02:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f384affd640 1 -- 172.21.15.88:0/2966912695 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384400b820 con 0x7f38540b0620 2023-11-20T07:02:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f384affd640 1 -- 172.21.15.88:0/2966912695 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400bbd0 con 0x7f38540b0620 2023-11-20T07:02:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f385c609640 1 -- 172.21.15.88:0/2966912695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38541f66e0 con 0x7f38540b0620 2023-11-20T07:02:19.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f385c609640 1 -- 172.21.15.88:0/2966912695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38541f6ca0 con 0x7f38540b0620 2023-11-20T07:02:19.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f385c609640 1 -- 172.21.15.88:0/2966912695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3854074010 con 0x7f38540b0620 2023-11-20T07:02:19.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.513+0000 7f384affd640 1 -- 172.21.15.88:0/2966912695 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f384400bd30 con 0x7f38540b0620 2023-11-20T07:02:19.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.517+0000 7f384affd640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f38380664a0 0x7f3838068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.517+0000 7f384affd640 1 -- 172.21.15.88:0/2966912695 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3844084420 con 0x7f38540b0620 2023-11-20T07:02:19.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.517+0000 7f385a3a5640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f38380664a0 0x7f3838068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.517+0000 7f385a3a5640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f38380664a0 0x7f3838068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f38500af000 tx=0x7f3850008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:19.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.521+0000 7f384affd640 1 -- 172.21.15.88:0/2966912695 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f38440517f0 con 0x7f38540b0620 2023-11-20T07:02:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.669+0000 7f385c609640 1 -- 172.21.15.88:0/2966912695 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38540ad8f0 con 0x7f38540b0620 2023-11-20T07:02:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f384affd640 1 -- 172.21.15.88:0/2966912695 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16751 (secure 0 0 0) 0x7f3844054e10 con 0x7f38540b0620 2023-11-20T07:02:19.673 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:19.674 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":37,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:02:18.706044+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:02:17.053314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T07:02:17.706068+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:19.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f385c609640 1 -- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f38380664a0 msgr2=0x7f3838068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:19.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f385c609640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f38380664a0 0x7f3838068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f38500af000 tx=0x7f3850008040 comp rx=0 tx=0).stop 2023-11-20T07:02:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f385c609640 1 -- 172.21.15.88:0/2966912695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38540b0620 msgr2=0x7f38540b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f385c609640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38540b0620 0x7f38540b2f20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f384400d800 tx=0x7f384400dcc0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f385c609640 1 -- 172.21.15.88:0/2966912695 shutdown_connections 2023-11-20T07:02:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f385c609640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f38380664a0 0x7f3838068960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f385c609640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38540b4020 0x7f3854149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f385c609640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f38540b0620 0x7f38540b2f20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f385c609640 1 --2- 172.21.15.88:0/2966912695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3854070c40 0x7f38541f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f385c609640 1 -- 172.21.15.88:0/2966912695 >> 172.21.15.88:0/2966912695 conn(0x7f385406c190 msgr2=0x7f3854151c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f385c609640 1 -- 172.21.15.88:0/2966912695 shutdown_connections 2023-11-20T07:02:19.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.673+0000 7f385c609640 1 -- 172.21.15.88:0/2966912695 wait complete. 2023-11-20T07:02:19.695 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:19.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99c1f72640 1 Processor -- start 2023-11-20T07:02:19.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99c1f72640 1 -- start start 2023-11-20T07:02:19.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99c1f72640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99bc15ca70 0x7f99bc0d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99c1f72640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99bc0cf7a0 0x7f99bc0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99c1f72640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0c65f0 con 0x7f99bc0d3550 2023-11-20T07:02:19.834 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99c1f72640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0ce820 con 0x7f99bc0cf7a0 2023-11-20T07:02:19.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99c1f72640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0cdf80 con 0x7f99bc15ca70 2023-11-20T07:02:19.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99bb7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99bc15ca70 0x7f99bc0d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99bbfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99bc0cf7a0 0x7f99bc0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99bb7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99bc15ca70 0x7f99bc0d3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:43610/0 (socket says 172.21.15.88:43610) 2023-11-20T07:02:19.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99bbfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99bc0cf7a0 0x7f99bc0c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:47510/0 (socket says 172.21.15.88:47510) 2023-11-20T07:02:19.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99bb7fe640 1 -- 172.21.15.88:0/441116732 learned_addr learned my addr 172.21.15.88:0/441116732 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:19.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99baffd640 1 --1- 172.21.15.88:0/441116732 >> v1:172.21.15.175:6789/0 conn(0x7f99bc0d3550 0x7f99bc0cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:56892/0 (socket says 172.21.15.88:56892) 2023-11-20T07:02:19.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99ba7fc640 1 -- 172.21.15.88:0/441116732 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045947034 0 0) 0x7f99bc0c65f0 con 0x7f99bc0d3550 2023-11-20T07:02:19.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99bb7fe640 1 -- 172.21.15.88:0/441116732 >> v2:172.21.15.175:3300/0 conn(0x7f99bc0cf7a0 msgr2=0x7f99bc0c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:19.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99bb7fe640 1 --2- 172.21.15.88:0/441116732 >> v2:172.21.15.175:3300/0 conn(0x7f99bc0cf7a0 0x7f99bc0c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99bb7fe640 1 -- 172.21.15.88:0/441116732 >> v1:172.21.15.175:6789/0 conn(0x7f99bc0d3550 legacy=0x7f99bc0cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:19.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.833+0000 7f99bb7fe640 1 -- 172.21.15.88:0/441116732 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0ce260 con 0x7f99bc15ca70 2023-11-20T07:02:19.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.837+0000 7f99bb7fe640 1 --2- 172.21.15.88:0/441116732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99bc15ca70 0x7f99bc0d3010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f99ac006fd0 tx=0x7f99ac01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ccab8ed2f3b6cc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:19.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.837+0000 7f99ba7fc640 1 -- 172.21.15.88:0/441116732 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0ab650 con 0x7f99bc15ca70 2023-11-20T07:02:19.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.837+0000 7f99ba7fc640 1 -- 172.21.15.88:0/441116732 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac0ab7b0 con 0x7f99bc15ca70 2023-11-20T07:02:19.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.837+0000 7f99ba7fc640 1 -- 172.21.15.88:0/441116732 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0abb40 con 0x7f99bc15ca70 2023-11-20T07:02:19.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.837+0000 7f99c1f72640 1 -- 172.21.15.88:0/441116732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99bc15ca70 msgr2=0x7f99bc0d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:19.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.837+0000 7f99c1f72640 1 --2- 172.21.15.88:0/441116732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99bc15ca70 0x7f99bc0d3010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f99ac006fd0 tx=0x7f99ac01c4f0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.837+0000 7f99c1f72640 1 -- 172.21.15.88:0/441116732 shutdown_connections 2023-11-20T07:02:19.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.837+0000 7f99c1f72640 1 --2- 172.21.15.88:0/441116732 >> v2:172.21.15.175:3300/0 conn(0x7f99bc0cf7a0 0x7f99bc0c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.837+0000 7f99c1f72640 1 --2- 172.21.15.88:0/441116732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99bc15ca70 0x7f99bc0d3010 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.837+0000 7f99c1f72640 1 -- 172.21.15.88:0/441116732 >> 172.21.15.88:0/441116732 conn(0x7f99bc09bc50 msgr2=0x7f99bc0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:19.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.837+0000 7f99c1f72640 1 -- 172.21.15.88:0/441116732 shutdown_connections 2023-11-20T07:02:19.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.837+0000 7f99c1f72640 1 -- 172.21.15.88:0/441116732 wait complete. 2023-11-20T07:02:19.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99c1f72640 1 Processor -- start 2023-11-20T07:02:19.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99c1f72640 1 -- start start 2023-11-20T07:02:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99c1f72640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99bc0cf7a0 0x7f99bc156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99c1f72640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99bc0d3550 0x7f99bc15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99c1f72640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99bc15ca70 0x7f99bc15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99c1f72640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0b66f0 con 0x7f99bc0d3550 2023-11-20T07:02:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99c1f72640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0c99d0 con 0x7f99bc15ca70 2023-11-20T07:02:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99c1f72640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0b5ee0 con 0x7f99bc0cf7a0 2023-11-20T07:02:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99baffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99bc0d3550 0x7f99bc15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99bb7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99bc0cf7a0 0x7f99bc156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99baffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99bc0d3550 0x7f99bc15ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47786/0 (socket says 172.21.15.88:47786) 2023-11-20T07:02:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99baffd640 1 -- 172.21.15.88:0/1402037966 learned_addr learned my addr 172.21.15.88:0/1402037966 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99bbfff640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99bc15ca70 0x7f99bc15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99baffd640 1 -- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99bc0cf7a0 msgr2=0x7f99bc156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99baffd640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99bc0cf7a0 0x7f99bc156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99baffd640 1 -- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99bc15ca70 msgr2=0x7f99bc15b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99baffd640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99bc15ca70 0x7f99bc15b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99baffd640 1 -- 172.21.15.88:0/1402037966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac009480 con 0x7f99bc0d3550 2023-11-20T07:02:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99baffd640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99bc0d3550 0x7f99bc15ab80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f99b000c520 tx=0x7f99b000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:19.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99a3fff640 1 -- 172.21.15.88:0/1402037966 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00074e0 con 0x7f99bc0d3550 2023-11-20T07:02:19.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99a3fff640 1 -- 172.21.15.88:0/1402037966 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b0007640 con 0x7f99bc0d3550 2023-11-20T07:02:19.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99a3fff640 1 -- 172.21.15.88:0/1402037966 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00049f0 con 0x7f99bc0d3550 2023-11-20T07:02:19.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99c1f72640 1 -- 172.21.15.88:0/1402037966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc0b59d0 con 0x7f99bc0d3550 2023-11-20T07:02:19.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.841+0000 7f99c1f72640 1 -- 172.21.15.88:0/1402037966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc0b6410 con 0x7f99bc0d3550 2023-11-20T07:02:19.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.845+0000 7f99c1f72640 1 -- 172.21.15.88:0/1402037966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc0c9b40 con 0x7f99bc0d3550 2023-11-20T07:02:19.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.845+0000 7f99a3fff640 1 -- 172.21.15.88:0/1402037966 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f99b0004b50 con 0x7f99bc0d3550 2023-11-20T07:02:19.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.845+0000 7f99a3fff640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99a80664a0 0x7f99a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:19.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.845+0000 7f99a3fff640 1 -- 172.21.15.88:0/1402037966 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f99b00831b0 con 0x7f99bc0d3550 2023-11-20T07:02:19.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.845+0000 7f99bb7fe640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99a80664a0 0x7f99a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:19.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.845+0000 7f99bb7fe640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99a80664a0 0x7f99a8068960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0af000 tx=0x7f99ac0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:19.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:19.849+0000 7f99a3fff640 1 -- 172.21.15.88:0/1402037966 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f99bc0c9b40 con 0x7f99bc0d3550 2023-11-20T07:02:20.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.001+0000 7f99c1f72640 1 -- 172.21.15.88:0/1402037966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99bc0c9b40 con 0x7f99bc0d3550 2023-11-20T07:02:20.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.001+0000 7f99a3fff640 1 -- 172.21.15.88:0/1402037966 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16751 (secure 0 0 0) 0x7f99bc0c9b40 con 0x7f99bc0d3550 2023-11-20T07:02:20.003 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:20.003 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":37,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:02:18.706044+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:02:17.053314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T07:02:17.706068+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:20.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.005+0000 7f99c1f72640 1 -- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99a80664a0 msgr2=0x7f99a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:20.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.005+0000 7f99c1f72640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99a80664a0 0x7f99a8068960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0af000 tx=0x7f99ac0a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:20.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.005+0000 7f99c1f72640 1 -- 172.21.15.88:0/1402037966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99bc0d3550 msgr2=0x7f99bc15ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:20.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.005+0000 7f99c1f72640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99bc0d3550 0x7f99bc15ab80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f99b000c520 tx=0x7f99b000c9e0 comp rx=0 tx=0).stop 2023-11-20T07:02:20.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.005+0000 7f99c1f72640 1 -- 172.21.15.88:0/1402037966 shutdown_connections 2023-11-20T07:02:20.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.005+0000 7f99c1f72640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f99a80664a0 0x7f99a8068960 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:20.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.005+0000 7f99c1f72640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99bc15ca70 0x7f99bc15b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:20.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.005+0000 7f99c1f72640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99bc0d3550 0x7f99bc15ab80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:20.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.005+0000 7f99c1f72640 1 --2- 172.21.15.88:0/1402037966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99bc0cf7a0 0x7f99bc156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:20.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.005+0000 7f99c1f72640 1 -- 172.21.15.88:0/1402037966 >> 172.21.15.88:0/1402037966 conn(0x7f99bc09bc50 msgr2=0x7f99bc06c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:20.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.005+0000 7f99c1f72640 1 -- 172.21.15.88:0/1402037966 shutdown_connections 2023-11-20T07:02:20.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.005+0000 7f99c1f72640 1 -- 172.21.15.88:0/1402037966 wait complete. 2023-11-20T07:02:20.024 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-20T07:02:20.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad2f32640 1 Processor -- start 2023-11-20T07:02:20.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad2f32640 1 -- start start 2023-11-20T07:02:20.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad2f32640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8acc0b3cb0 0x7f8acc0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:20.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad2f32640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc0d0880 con 0x7f8acc15cdc0 2023-11-20T07:02:20.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad2f32640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8acc0b1c00 con 0x7f8acc0cf210 2023-11-20T07:02:20.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad2f32640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0b1ee0 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad172f640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8acc15cdc0 0x7f8acc0cd4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58660/0 (socket says 172.21.15.88:58660) 2023-11-20T07:02:20.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad172f640 1 -- 172.21.15.88:0/1979267361 learned_addr learned my addr 172.21.15.88:0/1979267361 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:20.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad2731640 1 --2- 172.21.15.88:0/1979267361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8acc0b3cb0 0x7f8acc0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:20.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad0f2e640 1 -- 172.21.15.88:0/1979267361 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140826739 0 0) 0x7f8acc0d0880 con 0x7f8acc15cdc0 2023-11-20T07:02:20.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad0f2e640 1 -- 172.21.15.88:0/1979267361 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ab8003530 con 0x7f8acc15cdc0 2023-11-20T07:02:20.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad0f2e640 1 -- 172.21.15.88:0/1979267361 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380647521 0 0) 0x7f8acc0b1c00 con 0x7f8acc0cf210 2023-11-20T07:02:20.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad0f2e640 1 -- 172.21.15.88:0/1979267361 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8acc0d0880 con 0x7f8acc0cf210 2023-11-20T07:02:20.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad2731640 1 -- 172.21.15.88:0/1979267361 >> v1:172.21.15.175:6789/0 conn(0x7f8acc0cf210 legacy=0x7f8acc0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:20.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad2731640 1 -- 172.21.15.88:0/1979267361 >> v1:172.21.15.88:6789/0 conn(0x7f8acc15cdc0 legacy=0x7f8acc0cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:20.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.165+0000 7f8ad2731640 1 -- 172.21.15.88:0/1979267361 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8acc0b21c0 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.169+0000 7f8ad2731640 1 --2- 172.21.15.88:0/1979267361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8acc0b3cb0 0x7f8acc0cdbd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009dc0 tx=0x7f8ac401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=742ba4e5ea011be4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:20.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.169+0000 7f8ad0f2e640 1 -- 172.21.15.88:0/1979267361 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac40a5910 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.169+0000 7f8ad0f2e640 1 -- 172.21.15.88:0/1979267361 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac40a5a70 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.169+0000 7f8ad0f2e640 1 -- 172.21.15.88:0/1979267361 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac40a5e00 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.169+0000 7f8ad2f32640 1 -- 172.21.15.88:0/1979267361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8acc0b3cb0 msgr2=0x7f8acc0cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:20.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.169+0000 7f8ad2f32640 1 --2- 172.21.15.88:0/1979267361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8acc0b3cb0 0x7f8acc0cdbd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009dc0 tx=0x7f8ac401c940 comp rx=0 tx=0).stop 2023-11-20T07:02:20.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.169+0000 7f8ad2f32640 1 -- 172.21.15.88:0/1979267361 shutdown_connections 2023-11-20T07:02:20.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.169+0000 7f8ad2f32640 1 --2- 172.21.15.88:0/1979267361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8acc0b3cb0 0x7f8acc0cdbd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:20.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.169+0000 7f8ad2f32640 1 -- 172.21.15.88:0/1979267361 >> 172.21.15.88:0/1979267361 conn(0x7f8acc0d2800 msgr2=0x7f8acc0d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:20.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.169+0000 7f8ad2f32640 1 -- 172.21.15.88:0/1979267361 shutdown_connections 2023-11-20T07:02:20.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.169+0000 7f8ad2f32640 1 -- 172.21.15.88:0/1979267361 wait complete. 2023-11-20T07:02:20.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2f32640 1 Processor -- start 2023-11-20T07:02:20.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2f32640 1 -- start start 2023-11-20T07:02:20.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2f32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8acc0b3cb0 0x7f8acc0c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:20.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2f32640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8acc0cf210 0x7f8acc155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:20.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2f32640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8acc15cdc0 0x7f8acc155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2f32640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0b56f0 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2f32640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0c93f0 con 0x7f8acc15cdc0 2023-11-20T07:02:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2f32640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc0b8590 con 0x7f8acc0cf210 2023-11-20T07:02:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad1f30640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8acc0b3cb0 0x7f8acc0c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad1f30640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8acc0b3cb0 0x7f8acc0c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47788/0 (socket says 172.21.15.88:47788) 2023-11-20T07:02:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad1f30640 1 -- 172.21.15.88:0/2049794986 learned_addr learned my addr 172.21.15.88:0/2049794986 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2731640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8acc15cdc0 0x7f8acc155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad172f640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8acc0cf210 0x7f8acc155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad1f30640 1 -- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8acc0cf210 msgr2=0x7f8acc155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad1f30640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8acc0cf210 0x7f8acc155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad1f30640 1 -- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8acc15cdc0 msgr2=0x7f8acc155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:20.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad1f30640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8acc15cdc0 0x7f8acc155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad1f30640 1 -- 172.21.15.88:0/2049794986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac4009a70 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2731640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8acc15cdc0 0x7f8acc155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad172f640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8acc0cf210 0x7f8acc155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad1f30640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8acc0b3cb0 0x7f8acc0c8eb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800c500 tx=0x7f8ac800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ac27fc640 1 -- 172.21.15.88:0/2049794986 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80052d0 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ac27fc640 1 -- 172.21.15.88:0/2049794986 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac8005430 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2f32640 1 -- 172.21.15.88:0/2049794986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc0c9620 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ac27fc640 1 -- 172.21.15.88:0/2049794986 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8003850 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2f32640 1 -- 172.21.15.88:0/2049794986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc0b7f40 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.173+0000 7f8ad2f32640 1 -- 172.21.15.88:0/2049794986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8acc04e9c0 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.177+0000 7f8ac27fc640 1 -- 172.21.15.88:0/2049794986 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8ac80039b0 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.177+0000 7f8ac27fc640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8ab00664a0 0x7f8ab0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:20.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.177+0000 7f8ac27fc640 1 -- 172.21.15.88:0/2049794986 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8ac8083cb0 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.177+0000 7f8ad172f640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8ab00664a0 0x7f8ab0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:20.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.177+0000 7f8ad172f640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8ab00664a0 0x7f8ab0068960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8acc158b80 tx=0x7f8abc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:20.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.181+0000 7f8ac27fc640 1 -- 172.21.15.88:0/2049794986 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ac8050f60 con 0x7f8acc0b3cb0 2023-11-20T07:02:20.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:20.365+0000 7f8ad2f32640 1 -- 172.21.15.88:0/2049794986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8acc0d0bc0 con 0x7f8acc0b3cb0 2023-11-20T07:02:21.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.353+0000 7f8ac27fc640 1 -- 172.21.15.88:0/2049794986 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8ac8054580 con 0x7f8acc0b3cb0 2023-11-20T07:02:21.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.357+0000 7f8ad2f32640 1 -- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8ab00664a0 msgr2=0x7f8ab0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:21.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.357+0000 7f8ad2f32640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8ab00664a0 0x7f8ab0068960 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8acc158b80 tx=0x7f8abc009040 comp rx=0 tx=0).stop 2023-11-20T07:02:21.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.357+0000 7f8ad2f32640 1 -- 172.21.15.88:0/2049794986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8acc0b3cb0 msgr2=0x7f8acc0c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:21.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.357+0000 7f8ad2f32640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8acc0b3cb0 0x7f8acc0c8eb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800c500 tx=0x7f8ac800c9c0 comp rx=0 tx=0).stop 2023-11-20T07:02:21.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.357+0000 7f8ad2f32640 1 -- 172.21.15.88:0/2049794986 shutdown_connections 2023-11-20T07:02:21.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.357+0000 7f8ad2f32640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8ab00664a0 0x7f8ab0068960 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:21.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.357+0000 7f8ad2f32640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8acc0cf210 0x7f8acc155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:21.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.357+0000 7f8ad2f32640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8acc15cdc0 0x7f8acc155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:21.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.357+0000 7f8ad2f32640 1 --2- 172.21.15.88:0/2049794986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8acc0b3cb0 0x7f8acc0c8eb0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:21.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.357+0000 7f8ad2f32640 1 -- 172.21.15.88:0/2049794986 >> 172.21.15.88:0/2049794986 conn(0x7f8acc0d2800 msgr2=0x7f8acc0cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:21.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.357+0000 7f8ad2f32640 1 -- 172.21.15.88:0/2049794986 shutdown_connections 2023-11-20T07:02:21.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.357+0000 7f8ad2f32640 1 -- 172.21.15.88:0/2049794986 wait complete. 2023-11-20T07:02:21.379 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-20T07:02:21.379 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-20T07:02:21.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.521+0000 7fd300809640 1 Processor -- start 2023-11-20T07:02:21.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.521+0000 7fd300809640 1 -- start start 2023-11-20T07:02:21.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd300809640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2fc06d010 0x7fd2fc0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:21.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd300809640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd2fc0c26b0 0x7fd2fc0c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:21.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd300809640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc15ae30 con 0x7fd2fc069e90 2023-11-20T07:02:21.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd300809640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc0cb090 con 0x7fd2fc06d010 2023-11-20T07:02:21.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd300809640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc06d470 con 0x7fd2fc0c26b0 2023-11-20T07:02:21.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd2f9d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2fc06d010 0x7fd2fc0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:21.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd2f9d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2fc06d010 0x7fd2fc0c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47790/0 (socket says 172.21.15.88:47790) 2023-11-20T07:02:21.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd2f9d9b640 1 -- 172.21.15.88:0/3560686125 learned_addr learned my addr 172.21.15.88:0/3560686125 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:21.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd2fa59c640 1 --1- 172.21.15.88:0/3560686125 >> v1:172.21.15.88:6789/0 conn(0x7fd2fc069e90 0x7fd2fc06a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58674/0 (socket says 172.21.15.88:58674) 2023-11-20T07:02:21.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd2fad9d640 1 --2- 172.21.15.88:0/3560686125 >> v2:172.21.15.175:3300/0 conn(0x7fd2fc0c26b0 0x7fd2fc0c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:21.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd2f9d9b640 1 -- 172.21.15.88:0/3560686125 >> v2:172.21.15.175:3300/0 conn(0x7fd2fc0c26b0 msgr2=0x7fd2fc0c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:21.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd2f9d9b640 1 --2- 172.21.15.88:0/3560686125 >> v2:172.21.15.175:3300/0 conn(0x7fd2fc0c26b0 0x7fd2fc0c2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:21.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd2f9d9b640 1 -- 172.21.15.88:0/3560686125 >> v1:172.21.15.88:6789/0 conn(0x7fd2fc069e90 legacy=0x7fd2fc06a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:21.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd2f9d9b640 1 -- 172.21.15.88:0/3560686125 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc0ca510 con 0x7fd2fc06d010 2023-11-20T07:02:21.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd2f959a640 1 -- 172.21.15.88:0/3560686125 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392119286 0 0) 0x7fd2fc15ae30 con 0x7fd2fc069e90 2023-11-20T07:02:21.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd2fad9d640 1 --2- 172.21.15.88:0/3560686125 >> v2:172.21.15.175:3300/0 conn(0x7fd2fc0c26b0 0x7fd2fc0c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:21.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.525+0000 7fd2f9d9b640 1 --2- 172.21.15.88:0/3560686125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2fc06d010 0x7fd2fc0c9ce0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0b02e0 tx=0x7fd2f001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34ad35c5dcc129 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd2f959a640 1 -- 172.21.15.88:0/3560686125 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00a89f0 con 0x7fd2fc06d010 2023-11-20T07:02:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd2f959a640 1 -- 172.21.15.88:0/3560686125 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f00a8b50 con 0x7fd2fc06d010 2023-11-20T07:02:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd2f959a640 1 -- 172.21.15.88:0/3560686125 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f00b0440 con 0x7fd2fc06d010 2023-11-20T07:02:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 -- 172.21.15.88:0/3560686125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2fc06d010 msgr2=0x7fd2fc0c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 --2- 172.21.15.88:0/3560686125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2fc06d010 0x7fd2fc0c9ce0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0b02e0 tx=0x7fd2f001ecf0 comp rx=0 tx=0).stop 2023-11-20T07:02:21.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 -- 172.21.15.88:0/3560686125 shutdown_connections 2023-11-20T07:02:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 --2- 172.21.15.88:0/3560686125 >> v2:172.21.15.175:3300/0 conn(0x7fd2fc0c26b0 0x7fd2fc0c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 --2- 172.21.15.88:0/3560686125 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2fc06d010 0x7fd2fc0c9ce0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 -- 172.21.15.88:0/3560686125 >> 172.21.15.88:0/3560686125 conn(0x7fd2fc0b0da0 msgr2=0x7fd2fc0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 -- 172.21.15.88:0/3560686125 shutdown_connections 2023-11-20T07:02:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 -- 172.21.15.88:0/3560686125 wait complete. 2023-11-20T07:02:21.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 Processor -- start 2023-11-20T07:02:21.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 -- start start 2023-11-20T07:02:21.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2fc069e90 0x7fd2fc0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:21.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2fc06d010 0x7fd2fc15b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:21.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2fc0c26b0 0x7fd2fc14f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:21.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc152270 con 0x7fd2fc0c26b0 2023-11-20T07:02:21.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc15be70 con 0x7fd2fc06d010 2023-11-20T07:02:21.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.529+0000 7fd300809640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc15c150 con 0x7fd2fc069e90 2023-11-20T07:02:21.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2fad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2fc0c26b0 0x7fd2fc14f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:21.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2fad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2fc0c26b0 0x7fd2fc14f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47796/0 (socket says 172.21.15.88:47796) 2023-11-20T07:02:21.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2fad9d640 1 -- 172.21.15.88:0/1489469038 learned_addr learned my addr 172.21.15.88:0/1489469038 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:21.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2f9d9b640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2fc06d010 0x7fd2fc15b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:21.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2fa59c640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2fc069e90 0x7fd2fc0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:21.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2fad9d640 1 -- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2fc069e90 msgr2=0x7fd2fc0c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:21.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2fad9d640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2fc069e90 0x7fd2fc0c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:21.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2fad9d640 1 -- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2fc06d010 msgr2=0x7fd2fc15b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:21.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2fad9d640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2fc06d010 0x7fd2fc15b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:21.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2fad9d640 1 -- 172.21.15.88:0/1489469038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f00094d0 con 0x7fd2fc0c26b0 2023-11-20T07:02:21.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2fad9d640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2fc0c26b0 0x7fd2fc14f9b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400cd50 tx=0x7fd2f400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:21.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2eaffd640 1 -- 172.21.15.88:0/1489469038 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f400f680 con 0x7fd2fc0c26b0 2023-11-20T07:02:21.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2eaffd640 1 -- 172.21.15.88:0/1489469038 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f400f800 con 0x7fd2fc0c26b0 2023-11-20T07:02:21.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2eaffd640 1 -- 172.21.15.88:0/1489469038 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f400fbb0 con 0x7fd2fc0c26b0 2023-11-20T07:02:21.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd300809640 1 -- 172.21.15.88:0/1489469038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc15c430 con 0x7fd2fc0c26b0 2023-11-20T07:02:21.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd300809640 1 -- 172.21.15.88:0/1489469038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc15c9f0 con 0x7fd2fc0c26b0 2023-11-20T07:02:21.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd300809640 1 -- 172.21.15.88:0/1489469038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc15cc10 con 0x7fd2fc0c26b0 2023-11-20T07:02:21.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.533+0000 7fd2eaffd640 1 -- 172.21.15.88:0/1489469038 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd2f400b040 con 0x7fd2fc0c26b0 2023-11-20T07:02:21.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.537+0000 7fd2eaffd640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd2dc0664a0 0x7fd2dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:21.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.537+0000 7fd2eaffd640 1 -- 172.21.15.88:0/1489469038 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd2f4084940 con 0x7fd2fc0c26b0 2023-11-20T07:02:21.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.537+0000 7fd2fa59c640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd2dc0664a0 0x7fd2dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:21.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.537+0000 7fd2fa59c640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd2dc0664a0 0x7fd2dc068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec007fd0 tx=0x7fd2ec007d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:21.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.537+0000 7fd2eaffd640 1 -- 172.21.15.88:0/1489469038 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd2f4051c90 con 0x7fd2fc0c26b0 2023-11-20T07:02:21.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:21.721+0000 7fd300809640 1 -- 172.21.15.88:0/1489469038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd2fc04e170 con 0x7fd2fc0c26b0 2023-11-20T07:02:22.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.357+0000 7fd2eaffd640 1 -- 172.21.15.88:0/1489469038 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd2f401d020 con 0x7fd2fc0c26b0 2023-11-20T07:02:22.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.361+0000 7fd300809640 1 -- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd2dc0664a0 msgr2=0x7fd2dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.361+0000 7fd300809640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd2dc0664a0 0x7fd2dc068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec007fd0 tx=0x7fd2ec007d60 comp rx=0 tx=0).stop 2023-11-20T07:02:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.361+0000 7fd300809640 1 -- 172.21.15.88:0/1489469038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2fc0c26b0 msgr2=0x7fd2fc14f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.361+0000 7fd300809640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2fc0c26b0 0x7fd2fc14f9b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400cd50 tx=0x7fd2f400a650 comp rx=0 tx=0).stop 2023-11-20T07:02:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.361+0000 7fd300809640 1 -- 172.21.15.88:0/1489469038 shutdown_connections 2023-11-20T07:02:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.361+0000 7fd300809640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd2dc0664a0 0x7fd2dc068960 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.361+0000 7fd300809640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2fc0c26b0 0x7fd2fc14f9b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.361+0000 7fd300809640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2fc06d010 0x7fd2fc15b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.361+0000 7fd300809640 1 --2- 172.21.15.88:0/1489469038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd2fc069e90 0x7fd2fc0c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.361+0000 7fd300809640 1 -- 172.21.15.88:0/1489469038 >> 172.21.15.88:0/1489469038 conn(0x7fd2fc0b0da0 msgr2=0x7fd2fc0aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.361+0000 7fd300809640 1 -- 172.21.15.88:0/1489469038 shutdown_connections 2023-11-20T07:02:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.361+0000 7fd300809640 1 -- 172.21.15.88:0/1489469038 wait complete. 2023-11-20T07:02:22.495 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-20T07:02:22.496 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:02:22.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.637+0000 7f1627609640 1 Processor -- start 2023-11-20T07:02:22.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.637+0000 7f1627609640 1 -- start start 2023-11-20T07:02:22.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.637+0000 7f1627609640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f16200cf8e0 0x7f16200d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:22.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.637+0000 7f1627609640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16200d30b0 con 0x7f16200ce5e0 2023-11-20T07:02:22.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.637+0000 7f1627609640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16200d3390 con 0x7f1620160320 2023-11-20T07:02:22.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.637+0000 7f1627609640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16200d3670 con 0x7f16200cf8e0 2023-11-20T07:02:22.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.637+0000 7f1625ba6640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f16200ce5e0 0x7f16200d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58686/0 (socket says 172.21.15.88:58686) 2023-11-20T07:02:22.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.637+0000 7f1625ba6640 1 -- 172.21.15.88:0/144065766 learned_addr learned my addr 172.21.15.88:0/144065766 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:22.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1624ba4640 1 --2- 172.21.15.88:0/144065766 >> v2:172.21.15.175:3300/0 conn(0x7f16200cf8e0 0x7f16200d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:22.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78044041 0 0) 0x7f16200d30b0 con 0x7f16200ce5e0 2023-11-20T07:02:22.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f160c003530 con 0x7f16200ce5e0 2023-11-20T07:02:22.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2519248768 0 0) 0x7f160c003530 con 0x7f16200ce5e0 2023-11-20T07:02:22.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 >> v2:172.21.15.175:3300/0 conn(0x7f16200cf8e0 msgr2=0x7f16200d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:22.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 --2- 172.21.15.88:0/144065766 >> v2:172.21.15.175:3300/0 conn(0x7f16200cf8e0 0x7f16200d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 >> v1:172.21.15.175:6789/0 conn(0x7f1620160320 legacy=0x7f16200cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:22.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200ce0c0 con 0x7f16200ce5e0 2023-11-20T07:02:22.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f1618001a00 con 0x7f16200ce5e0 2023-11-20T07:02:22.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 >> v1:172.21.15.88:6789/0 conn(0x7f16200ce5e0 legacy=0x7f16200d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:22.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 --2- 172.21.15.88:0/144065766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 0x7f160c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:22.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 --2- 172.21.15.88:0/144065766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f160c004380 0x7f160c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:22.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 --2- 172.21.15.88:0/144065766 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f160c0050f0 0x7f160c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:22.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200d3670 con 0x7f160c003980 2023-11-20T07:02:22.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c00c030 con 0x7f160c004380 2023-11-20T07:02:22.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c00c1f0 con 0x7f160c0050f0 2023-11-20T07:02:22.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f16253a5640 1 --2- 172.21.15.88:0/144065766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 0x7f160c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:22.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1624ba4640 1 --2- 172.21.15.88:0/144065766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f160c004380 0x7f160c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:22.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1625ba6640 1 --2- 172.21.15.88:0/144065766 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f160c0050f0 0x7f160c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:22.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f16253a5640 1 -- 172.21.15.88:0/144065766 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f160c0050f0 msgr2=0x7f160c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:22.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f16253a5640 1 --2- 172.21.15.88:0/144065766 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f160c0050f0 0x7f160c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f16253a5640 1 -- 172.21.15.88:0/144065766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f160c004380 msgr2=0x7f160c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:22.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f16253a5640 1 --2- 172.21.15.88:0/144065766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f160c004380 0x7f160c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f16253a5640 1 -- 172.21.15.88:0/144065766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c003530 con 0x7f160c003980 2023-11-20T07:02:22.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.641+0000 7f1625ba6640 1 -- 172.21.15.88:0/144065766 reap_dead start 2023-11-20T07:02:22.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f16253a5640 1 --2- 172.21.15.88:0/144065766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 0x7f160c003d60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f161c001970 tx=0x7f161c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5370d422db2e214 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:22.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c006a30 con 0x7f160c003980 2023-11-20T07:02:22.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c006b90 con 0x7f160c003980 2023-11-20T07:02:22.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1617fff640 1 -- 172.21.15.88:0/144065766 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c007020 con 0x7f160c003980 2023-11-20T07:02:22.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1627609640 1 -- 172.21.15.88:0/144065766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 msgr2=0x7f160c003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:22.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1627609640 1 --2- 172.21.15.88:0/144065766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 0x7f160c003d60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f161c001970 tx=0x7f161c01c560 comp rx=0 tx=0).stop 2023-11-20T07:02:22.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1627609640 1 -- 172.21.15.88:0/144065766 shutdown_connections 2023-11-20T07:02:22.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1627609640 1 --2- 172.21.15.88:0/144065766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 0x7f160c003d60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1627609640 1 -- 172.21.15.88:0/144065766 >> 172.21.15.88:0/144065766 conn(0x7f162009bc50 msgr2=0x7f16200d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:22.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1627609640 1 -- 172.21.15.88:0/144065766 shutdown_connections 2023-11-20T07:02:22.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1627609640 1 -- 172.21.15.88:0/144065766 wait complete. 2023-11-20T07:02:22.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1627609640 1 Processor -- start 2023-11-20T07:02:22.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1627609640 1 -- start start 2023-11-20T07:02:22.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1627609640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 0x7f1620148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:22.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.645+0000 7f1627609640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16201f57d0 0x7f16200c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:22.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1627609640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1620146260 0x7f16200c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:22.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1627609640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200c9600 con 0x7f160c003980 2023-11-20T07:02:22.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1627609640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200cabc0 con 0x7f16201f57d0 2023-11-20T07:02:22.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1627609640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16200caea0 con 0x7f1620146260 2023-11-20T07:02:22.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f16253a5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 0x7f1620148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:22.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f16253a5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 0x7f1620148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47822/0 (socket says 172.21.15.88:47822) 2023-11-20T07:02:22.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f16253a5640 1 -- 172.21.15.88:0/1578951019 learned_addr learned my addr 172.21.15.88:0/1578951019 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:22.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1625ba6640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1620146260 0x7f16200c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:22.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1624ba4640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16201f57d0 0x7f16200c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:22.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f16253a5640 1 -- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1620146260 msgr2=0x7f16200c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:22.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f16253a5640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1620146260 0x7f16200c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f16253a5640 1 -- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16201f57d0 msgr2=0x7f16200c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:22.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f16253a5640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16201f57d0 0x7f16200c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f16253a5640 1 -- 172.21.15.88:0/1578951019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200cb180 con 0x7f160c003980 2023-11-20T07:02:22.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f16253a5640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 0x7f1620148e40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f161c01c390 tx=0x7f160c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:22.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1615ffb640 1 -- 172.21.15.88:0/1578951019 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c006a30 con 0x7f160c003980 2023-11-20T07:02:22.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1615ffb640 1 -- 172.21.15.88:0/1578951019 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c0a6050 con 0x7f160c003980 2023-11-20T07:02:22.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1627609640 1 -- 172.21.15.88:0/1578951019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16200cb460 con 0x7f160c003980 2023-11-20T07:02:22.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1615ffb640 1 -- 172.21.15.88:0/1578951019 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c007220 con 0x7f160c003980 2023-11-20T07:02:22.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1627609640 1 -- 172.21.15.88:0/1578951019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16201f5c50 con 0x7f160c003980 2023-11-20T07:02:22.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1627609640 1 -- 172.21.15.88:0/1578951019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1620074010 con 0x7f160c003980 2023-11-20T07:02:22.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.649+0000 7f1615ffb640 1 -- 172.21.15.88:0/1578951019 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f161c007380 con 0x7f160c003980 2023-11-20T07:02:22.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.653+0000 7f1615ffb640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f16040664d0 0x7f1604068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:22.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.653+0000 7f1615ffb640 1 -- 172.21.15.88:0/1578951019 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f161c11e3b0 con 0x7f160c003980 2023-11-20T07:02:22.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.653+0000 7f1624ba4640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f16040664d0 0x7f1604068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:22.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.653+0000 7f1624ba4640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f16040664d0 0x7f1604068990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16200cded0 tx=0x7f1610008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:22.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.657+0000 7f1615ffb640 1 -- 172.21.15.88:0/1578951019 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f161c0eb6f0 con 0x7f160c003980 2023-11-20T07:02:22.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 -- 172.21.15.88:0/1578951019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16200b8760 con 0x7f160c003980 2023-11-20T07:02:22.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1615ffb640 1 -- 172.21.15.88:0/1578951019 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f161c007630 con 0x7f160c003980 2023-11-20T07:02:22.838 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:22.838 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/4055175580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4055175580},{"type":"v1","addr":"172.21.15.175:6836","nonce":4055175580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3966879465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3966879465},{"type":"v1","addr":"172.21.15.175:6837","nonce":3966879465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/2725430928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2725430928},{"type":"v1","addr":"172.21.15.88:6834","nonce":2725430928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:02:18.706402+0000","modified":"2023-11-20T07:02:21.724727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2477383155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2477383155},{"type":"v1","addr":"172.21.15.88:6835","nonce":2477383155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-20T07:02:22.838 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 18 2023-11-20T07:02:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 -- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f16040664d0 msgr2=0x7f1604068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f16040664d0 0x7f1604068990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f16200cded0 tx=0x7f1610008040 comp rx=0 tx=0).stop 2023-11-20T07:02:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 -- 172.21.15.88:0/1578951019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 msgr2=0x7f1620148e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 0x7f1620148e40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f161c01c390 tx=0x7f160c005800 comp rx=0 tx=0).stop 2023-11-20T07:02:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 -- 172.21.15.88:0/1578951019 shutdown_connections 2023-11-20T07:02:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f16040664d0 0x7f1604068990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1620146260 0x7f16200c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16201f57d0 0x7f16200c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 --2- 172.21.15.88:0/1578951019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f160c003980 0x7f1620148e40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 -- 172.21.15.88:0/1578951019 >> 172.21.15.88:0/1578951019 conn(0x7f162009bc50 msgr2=0x7f162006c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:22.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 -- 172.21.15.88:0/1578951019 shutdown_connections 2023-11-20T07:02:22.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.837+0000 7f1627609640 1 -- 172.21.15.88:0/1578951019 wait complete. 2023-11-20T07:02:22.858 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:22.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f4401a9e640 1 Processor -- start 2023-11-20T07:02:22.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f4401a9e640 1 -- start start 2023-11-20T07:02:22.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f4401a9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc15a880 0x7f43fc15dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:22.999 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f4401a9e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f43fc0b00e0 0x7f43fc0b0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f4401a9e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43fc0b0a80 con 0x7f43fc160680 2023-11-20T07:02:23.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f4401a9e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43fc15e000 con 0x7f43fc0b00e0 2023-11-20T07:02:23.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f4401a9e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc0cb1d0 con 0x7f43fc15a880 2023-11-20T07:02:23.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f43fbfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f43fc160680 0x7f43fc160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58688/0 (socket says 172.21.15.88:58688) 2023-11-20T07:02:23.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f43fbfff640 1 -- 172.21.15.88:0/2821484475 learned_addr learned my addr 172.21.15.88:0/2821484475 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:23.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f43faffd640 1 --2- 172.21.15.88:0/2821484475 >> v2:172.21.15.175:3300/0 conn(0x7f43fc0b00e0 0x7f43fc0b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f43fb7fe640 1 --2- 172.21.15.88:0/2821484475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc15a880 0x7f43fc15dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f43fa7fc640 1 -- 172.21.15.88:0/2821484475 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642893473 0 0) 0x7f43fc0b0a80 con 0x7f43fc160680 2023-11-20T07:02:23.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:22.997+0000 7f43fa7fc640 1 -- 172.21.15.88:0/2821484475 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43e4003530 con 0x7f43fc160680 2023-11-20T07:02:23.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.001+0000 7f43faffd640 1 -- 172.21.15.88:0/2821484475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc15a880 msgr2=0x7f43fc15dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:23.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.001+0000 7f43faffd640 1 --2- 172.21.15.88:0/2821484475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc15a880 0x7f43fc15dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.001+0000 7f43faffd640 1 -- 172.21.15.88:0/2821484475 >> v1:172.21.15.88:6789/0 conn(0x7f43fc160680 legacy=0x7f43fc160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.001+0000 7f43faffd640 1 -- 172.21.15.88:0/2821484475 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc0cb4b0 con 0x7f43fc0b00e0 2023-11-20T07:02:23.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.001+0000 7f43fb7fe640 1 --2- 172.21.15.88:0/2821484475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc15a880 0x7f43fc15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:23.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.001+0000 7f43faffd640 1 --2- 172.21.15.88:0/2821484475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc0b00e0 0x7f43fc0b0540 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f43f00097c0 tx=0x7f43f001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef6ad70f60f2e0b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:23.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.001+0000 7f43fa7fc640 1 -- 172.21.15.88:0/2821484475 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f00ab600 con 0x7f43fc0b00e0 2023-11-20T07:02:23.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.001+0000 7f43fa7fc640 1 -- 172.21.15.88:0/2821484475 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f00a7050 con 0x7f43fc0b00e0 2023-11-20T07:02:23.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.001+0000 7f43fa7fc640 1 -- 172.21.15.88:0/2821484475 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f00ab960 con 0x7f43fc0b00e0 2023-11-20T07:02:23.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 -- 172.21.15.88:0/2821484475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc0b00e0 msgr2=0x7f43fc0b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 --2- 172.21.15.88:0/2821484475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc0b00e0 0x7f43fc0b0540 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f43f00097c0 tx=0x7f43f001c480 comp rx=0 tx=0).stop 2023-11-20T07:02:23.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 -- 172.21.15.88:0/2821484475 shutdown_connections 2023-11-20T07:02:23.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 --2- 172.21.15.88:0/2821484475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc0b00e0 0x7f43fc0b0540 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 --2- 172.21.15.88:0/2821484475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc15a880 0x7f43fc15dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 -- 172.21.15.88:0/2821484475 >> 172.21.15.88:0/2821484475 conn(0x7f43fc06c190 msgr2=0x7f43fc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:23.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 -- 172.21.15.88:0/2821484475 shutdown_connections 2023-11-20T07:02:23.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 -- 172.21.15.88:0/2821484475 wait complete. 2023-11-20T07:02:23.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 Processor -- start 2023-11-20T07:02:23.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 -- start start 2023-11-20T07:02:23.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0b00e0 0x7f43fc155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43fc15a880 0x7f43fc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc160680 0x7f43fc071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc1577f0 con 0x7f43fc15a880 2023-11-20T07:02:23.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc15c8a0 con 0x7f43fc160680 2023-11-20T07:02:23.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f4401a9e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc15cb80 con 0x7f43fc0b00e0 2023-11-20T07:02:23.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f43faffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43fc15a880 0x7f43fc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f43faffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43fc15a880 0x7f43fc071940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47834/0 (socket says 172.21.15.88:47834) 2023-11-20T07:02:23.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f43faffd640 1 -- 172.21.15.88:0/3722438081 learned_addr learned my addr 172.21.15.88:0/3722438081 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:23.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f43fb7fe640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0b00e0 0x7f43fc155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f43fbfff640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc160680 0x7f43fc071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f43faffd640 1 -- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0b00e0 msgr2=0x7f43fc155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f43faffd640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0b00e0 0x7f43fc155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f43faffd640 1 -- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc160680 msgr2=0x7f43fc071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f43faffd640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc160680 0x7f43fc071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f43faffd640 1 -- 172.21.15.88:0/3722438081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec009420 con 0x7f43fc15a880 2023-11-20T07:02:23.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.005+0000 7f43fbfff640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc160680 0x7f43fc071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:23.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.009+0000 7f43faffd640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43fc15a880 0x7f43fc071940 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f43f001ab30 tx=0x7f43f0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:23.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.009+0000 7f43e3fff640 1 -- 172.21.15.88:0/3722438081 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f00b9070 con 0x7f43fc15a880 2023-11-20T07:02:23.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.009+0000 7f43e3fff640 1 -- 172.21.15.88:0/3722438081 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f0006e20 con 0x7f43fc15a880 2023-11-20T07:02:23.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.009+0000 7f43e3fff640 1 -- 172.21.15.88:0/3722438081 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f00b4400 con 0x7f43fc15a880 2023-11-20T07:02:23.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.009+0000 7f4401a9e640 1 -- 172.21.15.88:0/3722438081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f0009420 con 0x7f43fc15a880 2023-11-20T07:02:23.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.009+0000 7f4401a9e640 1 -- 172.21.15.88:0/3722438081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43fc157d20 con 0x7f43fc15a880 2023-11-20T07:02:23.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.009+0000 7f4401a9e640 1 -- 172.21.15.88:0/3722438081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43fc157f40 con 0x7f43fc15a880 2023-11-20T07:02:23.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.009+0000 7f43e3fff640 1 -- 172.21.15.88:0/3722438081 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f43f00b2040 con 0x7f43fc15a880 2023-11-20T07:02:23.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.009+0000 7f43e3fff640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f43e80664d0 0x7f43e8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.009+0000 7f43e3fff640 1 -- 172.21.15.88:0/3722438081 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f43f011d550 con 0x7f43fc15a880 2023-11-20T07:02:23.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.009+0000 7f43fb7fe640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f43e80664d0 0x7f43e8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.013+0000 7f43fb7fe640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f43e80664d0 0x7f43e8068990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009cf0 tx=0x7f43ec009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:23.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.013+0000 7f43e3fff640 1 -- 172.21.15.88:0/3722438081 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f43f00ea920 con 0x7f43fc15a880 2023-11-20T07:02:23.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.165+0000 7f4401a9e640 1 -- 172.21.15.88:0/3722438081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43fc0cad80 con 0x7f43fc15a880 2023-11-20T07:02:23.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.165+0000 7f43e3fff640 1 -- 172.21.15.88:0/3722438081 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16738 (secure 0 0 0) 0x7f43f00edf40 con 0x7f43fc15a880 2023-11-20T07:02:23.167 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:23.167 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":38,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:02:20.307946+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:02:17.053314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T07:02:17.706068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:23.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.169+0000 7f4401a9e640 1 -- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f43e80664d0 msgr2=0x7f43e8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.169+0000 7f4401a9e640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f43e80664d0 0x7f43e8068990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009cf0 tx=0x7f43ec009190 comp rx=0 tx=0).stop 2023-11-20T07:02:23.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.169+0000 7f4401a9e640 1 -- 172.21.15.88:0/3722438081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43fc15a880 msgr2=0x7f43fc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.169+0000 7f4401a9e640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43fc15a880 0x7f43fc071940 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f43f001ab30 tx=0x7f43f0019220 comp rx=0 tx=0).stop 2023-11-20T07:02:23.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.169+0000 7f4401a9e640 1 -- 172.21.15.88:0/3722438081 shutdown_connections 2023-11-20T07:02:23.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.169+0000 7f4401a9e640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f43e80664d0 0x7f43e8068990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.169+0000 7f4401a9e640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc160680 0x7f43fc071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.169+0000 7f4401a9e640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43fc15a880 0x7f43fc071940 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.169+0000 7f4401a9e640 1 --2- 172.21.15.88:0/3722438081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0b00e0 0x7f43fc155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.169+0000 7f4401a9e640 1 -- 172.21.15.88:0/3722438081 >> 172.21.15.88:0/3722438081 conn(0x7f43fc06c190 msgr2=0x7f43fc0ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:23.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.169+0000 7f4401a9e640 1 -- 172.21.15.88:0/3722438081 shutdown_connections 2023-11-20T07:02:23.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.169+0000 7f4401a9e640 1 -- 172.21.15.88:0/3722438081 wait complete. 2023-11-20T07:02:23.188 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-20T07:02:23.188 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T07:02:23.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96f70f640 1 Processor -- start 2023-11-20T07:02:23.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96f70f640 1 -- start start 2023-11-20T07:02:23.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96f70f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc96815cb90 0x7fc9680cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96f70f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9680d3010 0x7fc9680d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96f70f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680d1850 con 0x7fc9680d1400 2023-11-20T07:02:23.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96f70f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680ce770 con 0x7fc96815cb90 2023-11-20T07:02:23.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96f70f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680d0600 con 0x7fc9680d3010 2023-11-20T07:02:23.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96d4ab640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc96815cb90 0x7fc9680cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96d4ab640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc96815cb90 0x7fc9680cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47844/0 (socket says 172.21.15.88:47844) 2023-11-20T07:02:23.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96d4ab640 1 -- 172.21.15.88:0/2657627618 learned_addr learned my addr 172.21.15.88:0/2657627618 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:23.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96ccaa640 1 --2- 172.21.15.88:0/2657627618 >> v2:172.21.15.175:3300/0 conn(0x7fc9680d3010 0x7fc9680d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96d4ab640 1 -- 172.21.15.88:0/2657627618 >> v2:172.21.15.175:3300/0 conn(0x7fc9680d3010 msgr2=0x7fc9680d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:23.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96d4ab640 1 --2- 172.21.15.88:0/2657627618 >> v2:172.21.15.175:3300/0 conn(0x7fc9680d3010 0x7fc9680d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96d4ab640 1 -- 172.21.15.88:0/2657627618 >> v1:172.21.15.88:6789/0 conn(0x7fc9680d1400 legacy=0x7fc9680cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc95ffff640 1 -- 172.21.15.88:0/2657627618 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596543799 0 0) 0x7fc9600014a0 con 0x7fc9680d1400 2023-11-20T07:02:23.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.325+0000 7fc96d4ab640 1 -- 172.21.15.88:0/2657627618 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680c6450 con 0x7fc96815cb90 2023-11-20T07:02:23.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.329+0000 7fc96d4ab640 1 --2- 172.21.15.88:0/2657627618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc96815cb90 0x7fc9680cfb10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc96808a880 tx=0x7fc96401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a24602f8be362e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:23.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.329+0000 7fc95ffff640 1 -- 172.21.15.88:0/2657627618 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640ab640 con 0x7fc96815cb90 2023-11-20T07:02:23.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.329+0000 7fc95ffff640 1 -- 172.21.15.88:0/2657627618 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9640a7070 con 0x7fc96815cb90 2023-11-20T07:02:23.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.329+0000 7fc95ffff640 1 -- 172.21.15.88:0/2657627618 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640ab9c0 con 0x7fc96815cb90 2023-11-20T07:02:23.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.329+0000 7fc96f70f640 1 -- 172.21.15.88:0/2657627618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc96815cb90 msgr2=0x7fc9680cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.329+0000 7fc96f70f640 1 --2- 172.21.15.88:0/2657627618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc96815cb90 0x7fc9680cfb10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc96808a880 tx=0x7fc96401c440 comp rx=0 tx=0).stop 2023-11-20T07:02:23.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.329+0000 7fc96f70f640 1 -- 172.21.15.88:0/2657627618 shutdown_connections 2023-11-20T07:02:23.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.329+0000 7fc96f70f640 1 --2- 172.21.15.88:0/2657627618 >> v2:172.21.15.175:3300/0 conn(0x7fc9680d3010 0x7fc9680d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.329+0000 7fc96f70f640 1 --2- 172.21.15.88:0/2657627618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc96815cb90 0x7fc9680cfb10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.329+0000 7fc96f70f640 1 -- 172.21.15.88:0/2657627618 >> 172.21.15.88:0/2657627618 conn(0x7fc96809bc50 msgr2=0x7fc9680d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:23.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.329+0000 7fc96f70f640 1 -- 172.21.15.88:0/2657627618 shutdown_connections 2023-11-20T07:02:23.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.329+0000 7fc96f70f640 1 -- 172.21.15.88:0/2657627618 wait complete. 2023-11-20T07:02:23.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96f70f640 1 Processor -- start 2023-11-20T07:02:23.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96f70f640 1 -- start start 2023-11-20T07:02:23.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96f70f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9680d1400 0x7fc9680b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96f70f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9680d3010 0x7fc9681508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96f70f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc96815cb90 0x7fc968150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96f70f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc968152600 con 0x7fc9680d3010 2023-11-20T07:02:23.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96f70f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9681519f0 con 0x7fc9680d1400 2023-11-20T07:02:23.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96f70f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc968151cd0 con 0x7fc96815cb90 2023-11-20T07:02:23.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96ccaa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9680d3010 0x7fc9681508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96ccaa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9680d3010 0x7fc9681508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47860/0 (socket says 172.21.15.88:47860) 2023-11-20T07:02:23.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96ccaa640 1 -- 172.21.15.88:0/561889405 learned_addr learned my addr 172.21.15.88:0/561889405 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:23.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96d4ab640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9680d1400 0x7fc9680b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96dcac640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc96815cb90 0x7fc968150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96ccaa640 1 -- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc96815cb90 msgr2=0x7fc968150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96ccaa640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc96815cb90 0x7fc968150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96ccaa640 1 -- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9680d1400 msgr2=0x7fc9680b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96ccaa640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9680d1400 0x7fc9680b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96ccaa640 1 -- 172.21.15.88:0/561889405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964009480 con 0x7fc9680d3010 2023-11-20T07:02:23.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96ccaa640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9680d3010 0x7fc9681508e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc95800d5f0 tx=0x7fc95800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:23.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc95dffb640 1 -- 172.21.15.88:0/561889405 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580125f0 con 0x7fc9680d3010 2023-11-20T07:02:23.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc95dffb640 1 -- 172.21.15.88:0/561889405 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958012750 con 0x7fc9680d3010 2023-11-20T07:02:23.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96f70f640 1 -- 172.21.15.88:0/561889405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc968151fb0 con 0x7fc9680d3010 2023-11-20T07:02:23.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc95dffb640 1 -- 172.21.15.88:0/561889405 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958012ae0 con 0x7fc9680d3010 2023-11-20T07:02:23.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.333+0000 7fc96f70f640 1 -- 172.21.15.88:0/561889405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9680b6310 con 0x7fc9680d3010 2023-11-20T07:02:23.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.337+0000 7fc96f70f640 1 -- 172.21.15.88:0/561889405 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc968152770 con 0x7fc9680d3010 2023-11-20T07:02:23.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.337+0000 7fc95dffb640 1 -- 172.21.15.88:0/561889405 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc958012c40 con 0x7fc9680d3010 2023-11-20T07:02:23.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.337+0000 7fc95dffb640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc94c0664a0 0x7fc94c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.337+0000 7fc95dffb640 1 -- 172.21.15.88:0/561889405 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc9580844d0 con 0x7fc9680d3010 2023-11-20T07:02:23.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.337+0000 7fc96d4ab640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc94c0664a0 0x7fc94c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.337+0000 7fc96d4ab640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc94c0664a0 0x7fc94c068960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc9640af000 tx=0x7fc9640a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:23.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.341+0000 7fc95dffb640 1 -- 172.21.15.88:0/561889405 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc958051800 con 0x7fc9680d3010 2023-11-20T07:02:23.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.489+0000 7fc96f70f640 1 -- 172.21.15.88:0/561889405 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc96815cf70 con 0x7fc94c0664a0 2023-11-20T07:02:23.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.497+0000 7fc95dffb640 1 -- 172.21.15.88:0/561889405 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274362 (secure 0 0 0) 0x7fc9640043e0 con 0x7fc94c0664a0 2023-11-20T07:02:23.502 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:23.504 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-20T07:02:23.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.501+0000 7fc96f70f640 1 -- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc94c0664a0 msgr2=0x7fc94c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.501+0000 7fc96f70f640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc94c0664a0 0x7fc94c068960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc9640af000 tx=0x7fc9640a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:23.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.501+0000 7fc96f70f640 1 -- 172.21.15.88:0/561889405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9680d3010 msgr2=0x7fc9681508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.501+0000 7fc96f70f640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9680d3010 0x7fc9681508e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc95800d5f0 tx=0x7fc95800dab0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.501+0000 7fc96f70f640 1 -- 172.21.15.88:0/561889405 shutdown_connections 2023-11-20T07:02:23.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.501+0000 7fc96f70f640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc94c0664a0 0x7fc94c068960 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.501+0000 7fc96f70f640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc96815cb90 0x7fc968150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.501+0000 7fc96f70f640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9680d3010 0x7fc9681508e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.501+0000 7fc96f70f640 1 --2- 172.21.15.88:0/561889405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9680d1400 0x7fc9680b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.501+0000 7fc96f70f640 1 -- 172.21.15.88:0/561889405 >> 172.21.15.88:0/561889405 conn(0x7fc96809bc50 msgr2=0x7fc96806b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:23.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.501+0000 7fc96f70f640 1 -- 172.21.15.88:0/561889405 shutdown_connections 2023-11-20T07:02:23.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.501+0000 7fc96f70f640 1 -- 172.21.15.88:0/561889405 wait complete. 2023-11-20T07:02:23.522 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-11-20T07:02:21.553656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220444,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754276,"statfs":{"total":773094113280,"available":772868378624,"internally_reserved":0,"allocated":4300800,"data_stored":2482504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.232980"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:18.322338+0000","last_change":"2023-11-20T07:02:18.322338+0000","last_active":"2023-11-20T07:02:18.322338+0000","last_peered":"2023-11-20T07:02:18.322338+0000","last_clean":"2023-11-20T07:02:18.322338+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:18.322338+0000","last_undegraded":"2023-11-20T07:02:18.322338+0000","last_fullsized":"2023-11-20T07:02:18.322338+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-20T07:02:17.318917+0000","last_change":"2023-11-20T07:02:17.318917+0000","last_active":"2023-11-20T07:02:17.318917+0000","last_peered":"2023-11-20T07:02:17.318917+0000","last_clean":"2023-11-20T07:02:17.318917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-20T07:02:17.318917+0000","last_undegraded":"2023-11-20T07:02:17.318917+0000","last_fullsized":"2023-11-20T07:02:17.318917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-20T07:02:12.477137+0000","last_change":"2023-11-20T07:00:43.158695+0000","last_active":"2023-11-20T07:02:12.477137+0000","last_peered":"2023-11-20T07:02:12.477137+0000","last_clean":"2023-11-20T07:02:12.477137+0000","last_became_active":"2023-11-20T07:00:43.157454+0000","last_became_peered":"2023-11-20T07:00:43.157454+0000","last_unstale":"2023-11-20T07:02:12.477137+0000","last_undegraded":"2023-11-20T07:02:12.477137+0000","last_fullsized":"2023-11-20T07:02:12.477137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_clean_scrub_stamp":"2023-11-20T07:00:42.001721+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:44:20.907460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":753089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79400000000000004}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69199999999999995}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.71699999999999997}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.73199999999999998}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.67500000000000004}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.62},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.71999999999999997}]},{"osd":1,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.751},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.57699999999999996}]},{"osd":3,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.4830000000000001,"5min":2.4830000000000001,"15min":2.4830000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.78200000000000003}]},{"osd":4,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.80200000000000005}]},{"osd":5,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":1.006},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.82599999999999996}]},{"osd":7,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.0449999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.70199999999999996}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.72299999999999998}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.80400000000000005}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.86199999999999999}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.874}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.84099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.68300000000000005}]},{"osd":1,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66600000000000004}]},{"osd":2,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.72499999999999998}]},{"osd":3,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.77400000000000002}]},{"osd":7,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.753}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.436}]},{"osd":4,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.70799999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.748}]},{"osd":7,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.443}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.40000000000000002}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.497}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.747}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.63800000000000001}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.621},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.80800000000000005}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.83899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":162721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.39500000000000002}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.442},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.501}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53200000000000003}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.76300000000000001}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.70199999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.85299999999999998}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.73499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":753089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.309}]},{"osd":2,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.42099999999999999}]},{"osd":3,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.51100000000000001}]},{"osd":4,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.53300000000000003}]},{"osd":5,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.64600000000000002}]},{"osd":6,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.63300000000000001}]},{"osd":7,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.71499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T07:02:23.527 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T07:02:23.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9ddaa9640 1 Processor -- start 2023-11-20T07:02:23.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9ddaa9640 1 -- start start 2023-11-20T07:02:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9ddaa9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9d80cf090 0x7fc9d80cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9ddaa9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d80c65f0 con 0x7fc9d815ca70 2023-11-20T07:02:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9ddaa9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d80cdf80 con 0x7fc9d80c6ad0 2023-11-20T07:02:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9ddaa9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d80cfa60 con 0x7fc9d80cf090 2023-11-20T07:02:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9d77fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc9d815ca70 0x7fc9d80d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58700/0 (socket says 172.21.15.88:58700) 2023-11-20T07:02:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9d77fe640 1 -- 172.21.15.88:0/1349880559 learned_addr learned my addr 172.21.15.88:0/1349880559 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:23.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9cffff640 1 --2- 172.21.15.88:0/1349880559 >> v2:172.21.15.88:3300/0 conn(0x7fc9d80cf090 0x7fc9d80cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9d6ffd640 1 -- 172.21.15.88:0/1349880559 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892613363 0 0) 0x7fc9d80c65f0 con 0x7fc9d815ca70 2023-11-20T07:02:23.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9cffff640 1 -- 172.21.15.88:0/1349880559 >> v1:172.21.15.175:6789/0 conn(0x7fc9d80c6ad0 legacy=0x7fc9d80c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:23.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9cffff640 1 -- 172.21.15.88:0/1349880559 >> v1:172.21.15.88:6789/0 conn(0x7fc9d815ca70 legacy=0x7fc9d80d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.701+0000 7fc9cffff640 1 -- 172.21.15.88:0/1349880559 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d80ce260 con 0x7fc9d80cf090 2023-11-20T07:02:23.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.705+0000 7fc9cffff640 1 --2- 172.21.15.88:0/1349880559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d80cf090 0x7fc9d80cf520 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00097c0 tx=0x7fc9c001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29d40a2798b910f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:23.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.705+0000 7fc9d6ffd640 1 -- 172.21.15.88:0/1349880559 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00ab600 con 0x7fc9d80cf090 2023-11-20T07:02:23.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.705+0000 7fc9d6ffd640 1 -- 172.21.15.88:0/1349880559 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c00a7050 con 0x7fc9d80cf090 2023-11-20T07:02:23.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.705+0000 7fc9d6ffd640 1 -- 172.21.15.88:0/1349880559 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00ab980 con 0x7fc9d80cf090 2023-11-20T07:02:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.705+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/1349880559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d80cf090 msgr2=0x7fc9d80cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.705+0000 7fc9ddaa9640 1 --2- 172.21.15.88:0/1349880559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d80cf090 0x7fc9d80cf520 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00097c0 tx=0x7fc9c001c440 comp rx=0 tx=0).stop 2023-11-20T07:02:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.705+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/1349880559 shutdown_connections 2023-11-20T07:02:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.705+0000 7fc9ddaa9640 1 --2- 172.21.15.88:0/1349880559 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d80cf090 0x7fc9d80cf520 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.705+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/1349880559 >> 172.21.15.88:0/1349880559 conn(0x7fc9d809bc50 msgr2=0x7fc9d80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:23.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.705+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/1349880559 shutdown_connections 2023-11-20T07:02:23.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.705+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/1349880559 wait complete. 2023-11-20T07:02:23.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9ddaa9640 1 Processor -- start 2023-11-20T07:02:23.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9ddaa9640 1 -- start start 2023-11-20T07:02:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9ddaa9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d80c6ad0 0x7fc9d8150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9ddaa9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9d80cf090 0x7fc9d80cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9ddaa9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9d815ca70 0x7fc9d806b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9ddaa9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d80b55b0 con 0x7fc9d80c6ad0 2023-11-20T07:02:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9ddaa9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d80cc160 con 0x7fc9d80cf090 2023-11-20T07:02:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9ddaa9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d80cc3c0 con 0x7fc9d815ca70 2023-11-20T07:02:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d80c6ad0 0x7fc9d8150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d80c6ad0 0x7fc9d8150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47868/0 (socket says 172.21.15.88:47868) 2023-11-20T07:02:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d77fe640 1 -- 172.21.15.88:0/326317323 learned_addr learned my addr 172.21.15.88:0/326317323 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9cffff640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9d80cf090 0x7fc9d80cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d7fff640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9d815ca70 0x7fc9d806b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d77fe640 1 -- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9d815ca70 msgr2=0x7fc9d806b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d77fe640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9d815ca70 0x7fc9d806b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d77fe640 1 -- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9d80cf090 msgr2=0x7fc9d80cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d77fe640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9d80cf090 0x7fc9d80cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d77fe640 1 -- 172.21.15.88:0/326317323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0009420 con 0x7fc9d80c6ad0 2023-11-20T07:02:23.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d7fff640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9d815ca70 0x7fc9d806b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:23.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d77fe640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d80c6ad0 0x7fc9d8150710 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80010f0 tx=0x7fc9c800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d4ff9640 1 -- 172.21.15.88:0/326317323 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8007270 con 0x7fc9d80c6ad0 2023-11-20T07:02:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d4ff9640 1 -- 172.21.15.88:0/326317323 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c80073d0 con 0x7fc9d80c6ad0 2023-11-20T07:02:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/326317323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d80d38a0 con 0x7fc9d80c6ad0 2023-11-20T07:02:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9d4ff9640 1 -- 172.21.15.88:0/326317323 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80057b0 con 0x7fc9d80c6ad0 2023-11-20T07:02:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.709+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/326317323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d80cc980 con 0x7fc9d80c6ad0 2023-11-20T07:02:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.713+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/326317323 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d8074010 con 0x7fc9d80c6ad0 2023-11-20T07:02:23.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.713+0000 7fc9d4ff9640 1 -- 172.21.15.88:0/326317323 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc9c8005910 con 0x7fc9d80c6ad0 2023-11-20T07:02:23.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.713+0000 7fc9d4ff9640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc9b80664a0 0x7fc9b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:23.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.713+0000 7fc9d4ff9640 1 -- 172.21.15.88:0/326317323 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc9c8083520 con 0x7fc9d80c6ad0 2023-11-20T07:02:23.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.713+0000 7fc9cffff640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc9b80664a0 0x7fc9b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:23.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.713+0000 7fc9cffff640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc9b80664a0 0x7fc9b8068960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00ad000 tx=0x7fc9c00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:23.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.717+0000 7fc9d4ff9640 1 -- 172.21.15.88:0/326317323 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc9c8050900 con 0x7fc9d80c6ad0 2023-11-20T07:02:23.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.869+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/326317323 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9d80d3720 con 0x7fc9b80664a0 2023-11-20T07:02:23.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.877+0000 7fc9d4ff9640 1 -- 172.21.15.88:0/326317323 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289128 (secure 0 0 0) 0x7fc9c00ab760 con 0x7fc9b80664a0 2023-11-20T07:02:23.880 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:23.881 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-20T07:02:23.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.881+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc9b80664a0 msgr2=0x7fc9b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.881+0000 7fc9ddaa9640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc9b80664a0 0x7fc9b8068960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00ad000 tx=0x7fc9c00a6000 comp rx=0 tx=0).stop 2023-11-20T07:02:23.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.881+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/326317323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d80c6ad0 msgr2=0x7fc9d8150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:23.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.881+0000 7fc9ddaa9640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d80c6ad0 0x7fc9d8150710 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80010f0 tx=0x7fc9c800cbe0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.881+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/326317323 shutdown_connections 2023-11-20T07:02:23.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.881+0000 7fc9ddaa9640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc9b80664a0 0x7fc9b8068960 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.881+0000 7fc9ddaa9640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9d815ca70 0x7fc9d806b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.881+0000 7fc9ddaa9640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9d80cf090 0x7fc9d80cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.881+0000 7fc9ddaa9640 1 --2- 172.21.15.88:0/326317323 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9d80c6ad0 0x7fc9d8150710 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:23.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.881+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/326317323 >> 172.21.15.88:0/326317323 conn(0x7fc9d809bc50 msgr2=0x7fc9d80d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:23.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.881+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/326317323 shutdown_connections 2023-11-20T07:02:23.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:23.881+0000 7fc9ddaa9640 1 -- 172.21.15.88:0/326317323 wait complete. 2023-11-20T07:02:23.900 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-11-20T07:02:23.554120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220832,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753888,"statfs":{"total":773094113280,"available":772867981312,"internally_reserved":0,"allocated":4759552,"data_stored":2698900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001275"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817927+0000","last_change":"2023-11-20T07:02:19.323609+0000","last_active":"2023-11-20T07:02:20.817927+0000","last_peered":"2023-11-20T07:02:20.817927+0000","last_clean":"2023-11-20T07:02:20.817927+0000","last_became_active":"2023-11-20T07:02:19.323233+0000","last_became_peered":"2023-11-20T07:02:19.323233+0000","last_unstale":"2023-11-20T07:02:20.817927+0000","last_undegraded":"2023-11-20T07:02:20.817927+0000","last_fullsized":"2023-11-20T07:02:20.817927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:42:18.487137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817710+0000","last_change":"2023-11-20T07:02:19.327405+0000","last_active":"2023-11-20T07:02:20.817710+0000","last_peered":"2023-11-20T07:02:20.817710+0000","last_clean":"2023-11-20T07:02:20.817710+0000","last_became_active":"2023-11-20T07:02:19.327170+0000","last_became_peered":"2023-11-20T07:02:19.327170+0000","last_unstale":"2023-11-20T07:02:20.817710+0000","last_undegraded":"2023-11-20T07:02:20.817710+0000","last_fullsized":"2023-11-20T07:02:20.817710+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:14:51.073999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818425+0000","last_change":"2023-11-20T07:02:19.339036+0000","last_active":"2023-11-20T07:02:20.818425+0000","last_peered":"2023-11-20T07:02:20.818425+0000","last_clean":"2023-11-20T07:02:20.818425+0000","last_became_active":"2023-11-20T07:02:19.338758+0000","last_became_peered":"2023-11-20T07:02:19.338758+0000","last_unstale":"2023-11-20T07:02:20.818425+0000","last_undegraded":"2023-11-20T07:02:20.818425+0000","last_fullsized":"2023-11-20T07:02:20.818425+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:28:20.770276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320279+0000","last_change":"2023-11-20T07:02:19.328002+0000","last_active":"2023-11-20T07:02:20.320279+0000","last_peered":"2023-11-20T07:02:20.320279+0000","last_clean":"2023-11-20T07:02:20.320279+0000","last_became_active":"2023-11-20T07:02:19.327581+0000","last_became_peered":"2023-11-20T07:02:19.327581+0000","last_unstale":"2023-11-20T07:02:20.320279+0000","last_undegraded":"2023-11-20T07:02:20.320279+0000","last_fullsized":"2023-11-20T07:02:20.320279+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:13:40.619441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320230+0000","last_change":"2023-11-20T07:02:19.325893+0000","last_active":"2023-11-20T07:02:20.320230+0000","last_peered":"2023-11-20T07:02:20.320230+0000","last_clean":"2023-11-20T07:02:20.320230+0000","last_became_active":"2023-11-20T07:02:19.325639+0000","last_became_peered":"2023-11-20T07:02:19.325639+0000","last_unstale":"2023-11-20T07:02:20.320230+0000","last_undegraded":"2023-11-20T07:02:20.320230+0000","last_fullsized":"2023-11-20T07:02:20.320230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:02:27.495616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817116+0000","last_change":"2023-11-20T07:02:19.330449+0000","last_active":"2023-11-20T07:02:20.817116+0000","last_peered":"2023-11-20T07:02:20.817116+0000","last_clean":"2023-11-20T07:02:20.817116+0000","last_became_active":"2023-11-20T07:02:19.329972+0000","last_became_peered":"2023-11-20T07:02:19.329972+0000","last_unstale":"2023-11-20T07:02:20.817116+0000","last_undegraded":"2023-11-20T07:02:20.817116+0000","last_fullsized":"2023-11-20T07:02:20.817116+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:40:53.794657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.816349+0000","last_change":"2023-11-20T07:02:19.335722+0000","last_active":"2023-11-20T07:02:20.816349+0000","last_peered":"2023-11-20T07:02:20.816349+0000","last_clean":"2023-11-20T07:02:20.816349+0000","last_became_active":"2023-11-20T07:02:19.335409+0000","last_became_peered":"2023-11-20T07:02:19.335409+0000","last_unstale":"2023-11-20T07:02:20.816349+0000","last_undegraded":"2023-11-20T07:02:20.816349+0000","last_fullsized":"2023-11-20T07:02:20.816349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:49:36.013233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818008+0000","last_change":"2023-11-20T07:02:19.335591+0000","last_active":"2023-11-20T07:02:20.818008+0000","last_peered":"2023-11-20T07:02:20.818008+0000","last_clean":"2023-11-20T07:02:20.818008+0000","last_became_active":"2023-11-20T07:02:19.335321+0000","last_became_peered":"2023-11-20T07:02:19.335321+0000","last_unstale":"2023-11-20T07:02:20.818008+0000","last_undegraded":"2023-11-20T07:02:20.818008+0000","last_fullsized":"2023-11-20T07:02:20.818008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:31:25.635962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818408+0000","last_change":"2023-11-20T07:02:19.338537+0000","last_active":"2023-11-20T07:02:20.818408+0000","last_peered":"2023-11-20T07:02:20.818408+0000","last_clean":"2023-11-20T07:02:20.818408+0000","last_became_active":"2023-11-20T07:02:19.338234+0000","last_became_peered":"2023-11-20T07:02:19.338234+0000","last_unstale":"2023-11-20T07:02:20.818408+0000","last_undegraded":"2023-11-20T07:02:20.818408+0000","last_fullsized":"2023-11-20T07:02:20.818408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:43:36.880638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.816903+0000","last_change":"2023-11-20T07:02:19.335338+0000","last_active":"2023-11-20T07:02:20.816903+0000","last_peered":"2023-11-20T07:02:20.816903+0000","last_clean":"2023-11-20T07:02:20.816903+0000","last_became_active":"2023-11-20T07:02:19.334798+0000","last_became_peered":"2023-11-20T07:02:19.334798+0000","last_unstale":"2023-11-20T07:02:20.816903+0000","last_undegraded":"2023-11-20T07:02:20.816903+0000","last_fullsized":"2023-11-20T07:02:20.816903+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:05:35.610384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.816993+0000","last_change":"2023-11-20T07:02:19.336259+0000","last_active":"2023-11-20T07:02:20.816993+0000","last_peered":"2023-11-20T07:02:20.816993+0000","last_clean":"2023-11-20T07:02:20.816993+0000","last_became_active":"2023-11-20T07:02:19.335869+0000","last_became_peered":"2023-11-20T07:02:19.335869+0000","last_unstale":"2023-11-20T07:02:20.816993+0000","last_undegraded":"2023-11-20T07:02:20.816993+0000","last_fullsized":"2023-11-20T07:02:20.816993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:55:50.169071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818404+0000","last_change":"2023-11-20T07:02:19.322715+0000","last_active":"2023-11-20T07:02:20.818404+0000","last_peered":"2023-11-20T07:02:20.818404+0000","last_clean":"2023-11-20T07:02:20.818404+0000","last_became_active":"2023-11-20T07:02:19.322456+0000","last_became_peered":"2023-11-20T07:02:19.322456+0000","last_unstale":"2023-11-20T07:02:20.818404+0000","last_undegraded":"2023-11-20T07:02:20.818404+0000","last_fullsized":"2023-11-20T07:02:20.818404+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:32:43.721194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.816627+0000","last_change":"2023-11-20T07:02:19.343878+0000","last_active":"2023-11-20T07:02:20.816627+0000","last_peered":"2023-11-20T07:02:20.816627+0000","last_clean":"2023-11-20T07:02:20.816627+0000","last_became_active":"2023-11-20T07:02:19.343561+0000","last_became_peered":"2023-11-20T07:02:19.343561+0000","last_unstale":"2023-11-20T07:02:20.816627+0000","last_undegraded":"2023-11-20T07:02:20.816627+0000","last_fullsized":"2023-11-20T07:02:20.816627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:31:25.635962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320698+0000","last_change":"2023-11-20T07:02:19.322632+0000","last_active":"2023-11-20T07:02:20.320698+0000","last_peered":"2023-11-20T07:02:20.320698+0000","last_clean":"2023-11-20T07:02:20.320698+0000","last_became_active":"2023-11-20T07:02:19.322350+0000","last_became_peered":"2023-11-20T07:02:19.322350+0000","last_unstale":"2023-11-20T07:02:20.320698+0000","last_undegraded":"2023-11-20T07:02:20.320698+0000","last_fullsized":"2023-11-20T07:02:20.320698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:46:42.995994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.816387+0000","last_change":"2023-11-20T07:02:19.333997+0000","last_active":"2023-11-20T07:02:20.816387+0000","last_peered":"2023-11-20T07:02:20.816387+0000","last_clean":"2023-11-20T07:02:20.816387+0000","last_became_active":"2023-11-20T07:02:19.333609+0000","last_became_peered":"2023-11-20T07:02:19.333609+0000","last_unstale":"2023-11-20T07:02:20.816387+0000","last_undegraded":"2023-11-20T07:02:20.816387+0000","last_fullsized":"2023-11-20T07:02:20.816387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:42:18.487137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815115+0000","last_change":"2023-11-20T07:02:19.338420+0000","last_active":"2023-11-20T07:02:20.815115+0000","last_peered":"2023-11-20T07:02:20.815115+0000","last_clean":"2023-11-20T07:02:20.815115+0000","last_became_active":"2023-11-20T07:02:19.338161+0000","last_became_peered":"2023-11-20T07:02:19.338161+0000","last_unstale":"2023-11-20T07:02:20.815115+0000","last_undegraded":"2023-11-20T07:02:20.815115+0000","last_fullsized":"2023-11-20T07:02:20.815115+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:43:36.880638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815683+0000","last_change":"2023-11-20T07:02:19.336801+0000","last_active":"2023-11-20T07:02:20.815683+0000","last_peered":"2023-11-20T07:02:20.815683+0000","last_clean":"2023-11-20T07:02:20.815683+0000","last_became_active":"2023-11-20T07:02:19.335346+0000","last_became_peered":"2023-11-20T07:02:19.335346+0000","last_unstale":"2023-11-20T07:02:20.815683+0000","last_undegraded":"2023-11-20T07:02:20.815683+0000","last_fullsized":"2023-11-20T07:02:20.815683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:42:18.487137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320384+0000","last_change":"2023-11-20T07:02:19.326439+0000","last_active":"2023-11-20T07:02:20.320384+0000","last_peered":"2023-11-20T07:02:20.320384+0000","last_clean":"2023-11-20T07:02:20.320384+0000","last_became_active":"2023-11-20T07:02:19.326126+0000","last_became_peered":"2023-11-20T07:02:19.326126+0000","last_unstale":"2023-11-20T07:02:20.320384+0000","last_undegraded":"2023-11-20T07:02:20.320384+0000","last_fullsized":"2023-11-20T07:02:20.320384+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:17:17.499496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320346+0000","last_change":"2023-11-20T07:02:19.322859+0000","last_active":"2023-11-20T07:02:20.320346+0000","last_peered":"2023-11-20T07:02:20.320346+0000","last_clean":"2023-11-20T07:02:20.320346+0000","last_became_active":"2023-11-20T07:02:19.321777+0000","last_became_peered":"2023-11-20T07:02:19.321777+0000","last_unstale":"2023-11-20T07:02:20.320346+0000","last_undegraded":"2023-11-20T07:02:20.320346+0000","last_fullsized":"2023-11-20T07:02:20.320346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:44:06.835413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.319944+0000","last_change":"2023-11-20T07:02:19.321152+0000","last_active":"2023-11-20T07:02:20.319944+0000","last_peered":"2023-11-20T07:02:20.319944+0000","last_clean":"2023-11-20T07:02:20.319944+0000","last_became_active":"2023-11-20T07:02:19.320636+0000","last_became_peered":"2023-11-20T07:02:19.320636+0000","last_unstale":"2023-11-20T07:02:20.319944+0000","last_undegraded":"2023-11-20T07:02:20.319944+0000","last_fullsized":"2023-11-20T07:02:20.319944+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:00:09.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.816637+0000","last_change":"2023-11-20T07:02:19.336276+0000","last_active":"2023-11-20T07:02:20.816637+0000","last_peered":"2023-11-20T07:02:20.816637+0000","last_clean":"2023-11-20T07:02:20.816637+0000","last_became_active":"2023-11-20T07:02:19.335963+0000","last_became_peered":"2023-11-20T07:02:19.335963+0000","last_unstale":"2023-11-20T07:02:20.816637+0000","last_undegraded":"2023-11-20T07:02:20.816637+0000","last_fullsized":"2023-11-20T07:02:20.816637+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:08:57.080946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.321082+0000","last_change":"2023-11-20T07:02:19.329335+0000","last_active":"2023-11-20T07:02:20.321082+0000","last_peered":"2023-11-20T07:02:20.321082+0000","last_clean":"2023-11-20T07:02:20.321082+0000","last_became_active":"2023-11-20T07:02:19.329012+0000","last_became_peered":"2023-11-20T07:02:19.329012+0000","last_unstale":"2023-11-20T07:02:20.321082+0000","last_undegraded":"2023-11-20T07:02:20.321082+0000","last_fullsized":"2023-11-20T07:02:20.321082+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:35:39.020003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815227+0000","last_change":"2023-11-20T07:02:19.333060+0000","last_active":"2023-11-20T07:02:20.815227+0000","last_peered":"2023-11-20T07:02:20.815227+0000","last_clean":"2023-11-20T07:02:20.815227+0000","last_became_active":"2023-11-20T07:02:19.332755+0000","last_became_peered":"2023-11-20T07:02:19.332755+0000","last_unstale":"2023-11-20T07:02:20.815227+0000","last_undegraded":"2023-11-20T07:02:20.815227+0000","last_fullsized":"2023-11-20T07:02:20.815227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:28:20.770276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320063+0000","last_change":"2023-11-20T07:02:19.332655+0000","last_active":"2023-11-20T07:02:20.320063+0000","last_peered":"2023-11-20T07:02:20.320063+0000","last_clean":"2023-11-20T07:02:20.320063+0000","last_became_active":"2023-11-20T07:02:19.332340+0000","last_became_peered":"2023-11-20T07:02:19.332340+0000","last_unstale":"2023-11-20T07:02:20.320063+0000","last_undegraded":"2023-11-20T07:02:20.320063+0000","last_fullsized":"2023-11-20T07:02:20.320063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:49:30.173116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320561+0000","last_change":"2023-11-20T07:02:19.322139+0000","last_active":"2023-11-20T07:02:20.320561+0000","last_peered":"2023-11-20T07:02:20.320561+0000","last_clean":"2023-11-20T07:02:20.320561+0000","last_became_active":"2023-11-20T07:02:19.319697+0000","last_became_peered":"2023-11-20T07:02:19.319697+0000","last_unstale":"2023-11-20T07:02:20.320561+0000","last_undegraded":"2023-11-20T07:02:20.320561+0000","last_fullsized":"2023-11-20T07:02:20.320561+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:29:12.426113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817961+0000","last_change":"2023-11-20T07:02:19.336044+0000","last_active":"2023-11-20T07:02:20.817961+0000","last_peered":"2023-11-20T07:02:20.817961+0000","last_clean":"2023-11-20T07:02:20.817961+0000","last_became_active":"2023-11-20T07:02:19.335769+0000","last_became_peered":"2023-11-20T07:02:19.335769+0000","last_unstale":"2023-11-20T07:02:20.817961+0000","last_undegraded":"2023-11-20T07:02:20.817961+0000","last_fullsized":"2023-11-20T07:02:20.817961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:28:20.770276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320299+0000","last_change":"2023-11-20T07:02:19.320845+0000","last_active":"2023-11-20T07:02:20.320299+0000","last_peered":"2023-11-20T07:02:20.320299+0000","last_clean":"2023-11-20T07:02:20.320299+0000","last_became_active":"2023-11-20T07:02:19.320527+0000","last_became_peered":"2023-11-20T07:02:19.320527+0000","last_unstale":"2023-11-20T07:02:20.320299+0000","last_undegraded":"2023-11-20T07:02:20.320299+0000","last_fullsized":"2023-11-20T07:02:20.320299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:50:09.425284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.816786+0000","last_change":"2023-11-20T07:02:19.340167+0000","last_active":"2023-11-20T07:02:20.816786+0000","last_peered":"2023-11-20T07:02:20.816786+0000","last_clean":"2023-11-20T07:02:20.816786+0000","last_became_active":"2023-11-20T07:02:19.339875+0000","last_became_peered":"2023-11-20T07:02:19.339875+0000","last_unstale":"2023-11-20T07:02:20.816786+0000","last_undegraded":"2023-11-20T07:02:20.816786+0000","last_fullsized":"2023-11-20T07:02:20.816786+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:23:26.520986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320040+0000","last_change":"2023-11-20T07:02:19.321503+0000","last_active":"2023-11-20T07:02:20.320040+0000","last_peered":"2023-11-20T07:02:20.320040+0000","last_clean":"2023-11-20T07:02:20.320040+0000","last_became_active":"2023-11-20T07:02:19.321241+0000","last_became_peered":"2023-11-20T07:02:19.321241+0000","last_unstale":"2023-11-20T07:02:20.320040+0000","last_undegraded":"2023-11-20T07:02:20.320040+0000","last_fullsized":"2023-11-20T07:02:20.320040+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:27.483582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320021+0000","last_change":"2023-11-20T07:02:19.322329+0000","last_active":"2023-11-20T07:02:20.320021+0000","last_peered":"2023-11-20T07:02:20.320021+0000","last_clean":"2023-11-20T07:02:20.320021+0000","last_became_active":"2023-11-20T07:02:19.322016+0000","last_became_peered":"2023-11-20T07:02:19.322016+0000","last_unstale":"2023-11-20T07:02:20.320021+0000","last_undegraded":"2023-11-20T07:02:20.320021+0000","last_fullsized":"2023-11-20T07:02:20.320021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:16:05.426828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815283+0000","last_change":"2023-11-20T07:02:19.338759+0000","last_active":"2023-11-20T07:02:20.815283+0000","last_peered":"2023-11-20T07:02:20.815283+0000","last_clean":"2023-11-20T07:02:20.815283+0000","last_became_active":"2023-11-20T07:02:19.337118+0000","last_became_peered":"2023-11-20T07:02:19.337118+0000","last_unstale":"2023-11-20T07:02:20.815283+0000","last_undegraded":"2023-11-20T07:02:20.815283+0000","last_fullsized":"2023-11-20T07:02:20.815283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:19:48.908724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817162+0000","last_change":"2023-11-20T07:02:19.328248+0000","last_active":"2023-11-20T07:02:20.817162+0000","last_peered":"2023-11-20T07:02:20.817162+0000","last_clean":"2023-11-20T07:02:20.817162+0000","last_became_active":"2023-11-20T07:02:19.327774+0000","last_became_peered":"2023-11-20T07:02:19.327774+0000","last_unstale":"2023-11-20T07:02:20.817162+0000","last_undegraded":"2023-11-20T07:02:20.817162+0000","last_fullsized":"2023-11-20T07:02:20.817162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:18:10.908751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815647+0000","last_change":"2023-11-20T07:02:19.337255+0000","last_active":"2023-11-20T07:02:20.815647+0000","last_peered":"2023-11-20T07:02:20.815647+0000","last_clean":"2023-11-20T07:02:20.815647+0000","last_became_active":"2023-11-20T07:02:19.336864+0000","last_became_peered":"2023-11-20T07:02:19.336864+0000","last_unstale":"2023-11-20T07:02:20.815647+0000","last_undegraded":"2023-11-20T07:02:20.815647+0000","last_fullsized":"2023-11-20T07:02:20.815647+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:49:36.013233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320654+0000","last_change":"2023-11-20T07:02:18.342642+0000","last_active":"2023-11-20T07:02:20.320654+0000","last_peered":"2023-11-20T07:02:20.320654+0000","last_clean":"2023-11-20T07:02:20.320654+0000","last_became_active":"2023-11-20T07:02:18.342358+0000","last_became_peered":"2023-11-20T07:02:18.342358+0000","last_unstale":"2023-11-20T07:02:20.320654+0000","last_undegraded":"2023-11-20T07:02:20.320654+0000","last_fullsized":"2023-11-20T07:02:20.320654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:44:05.831991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817381+0000","last_change":"2023-11-20T07:02:19.339115+0000","last_active":"2023-11-20T07:02:20.817381+0000","last_peered":"2023-11-20T07:02:20.817381+0000","last_clean":"2023-11-20T07:02:20.817381+0000","last_became_active":"2023-11-20T07:02:19.338849+0000","last_became_peered":"2023-11-20T07:02:19.338849+0000","last_unstale":"2023-11-20T07:02:20.817381+0000","last_undegraded":"2023-11-20T07:02:20.817381+0000","last_fullsized":"2023-11-20T07:02:20.817381+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:32:43.721194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818114+0000","last_change":"2023-11-20T07:02:18.351061+0000","last_active":"2023-11-20T07:02:20.818114+0000","last_peered":"2023-11-20T07:02:20.818114+0000","last_clean":"2023-11-20T07:02:20.818114+0000","last_became_active":"2023-11-20T07:02:18.350759+0000","last_became_peered":"2023-11-20T07:02:18.350759+0000","last_unstale":"2023-11-20T07:02:20.818114+0000","last_undegraded":"2023-11-20T07:02:20.818114+0000","last_fullsized":"2023-11-20T07:02:20.818114+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:13:39.616019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.321207+0000","last_change":"2023-11-20T07:02:19.322675+0000","last_active":"2023-11-20T07:02:20.321207+0000","last_peered":"2023-11-20T07:02:20.321207+0000","last_clean":"2023-11-20T07:02:20.321207+0000","last_became_active":"2023-11-20T07:02:19.322390+0000","last_became_peered":"2023-11-20T07:02:19.322390+0000","last_unstale":"2023-11-20T07:02:20.321207+0000","last_undegraded":"2023-11-20T07:02:20.321207+0000","last_fullsized":"2023-11-20T07:02:20.321207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:28:20.770276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817476+0000","last_change":"2023-11-20T07:02:18.351755+0000","last_active":"2023-11-20T07:02:20.817476+0000","last_peered":"2023-11-20T07:02:20.817476+0000","last_clean":"2023-11-20T07:02:20.817476+0000","last_became_active":"2023-11-20T07:02:18.351473+0000","last_became_peered":"2023-11-20T07:02:18.351473+0000","last_unstale":"2023-11-20T07:02:20.817476+0000","last_undegraded":"2023-11-20T07:02:20.817476+0000","last_fullsized":"2023-11-20T07:02:20.817476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:17:16.496074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818138+0000","last_change":"2023-11-20T07:02:19.325319+0000","last_active":"2023-11-20T07:02:20.818138+0000","last_peered":"2023-11-20T07:02:20.818138+0000","last_clean":"2023-11-20T07:02:20.818138+0000","last_became_active":"2023-11-20T07:02:19.325059+0000","last_became_peered":"2023-11-20T07:02:19.325059+0000","last_unstale":"2023-11-20T07:02:20.818138+0000","last_undegraded":"2023-11-20T07:02:20.818138+0000","last_fullsized":"2023-11-20T07:02:20.818138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:14:42.846244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320917+0000","last_change":"2023-11-20T07:02:18.348729+0000","last_active":"2023-11-20T07:02:20.320917+0000","last_peered":"2023-11-20T07:02:20.320917+0000","last_clean":"2023-11-20T07:02:20.320917+0000","last_became_active":"2023-11-20T07:02:18.348394+0000","last_became_peered":"2023-11-20T07:02:18.348394+0000","last_unstale":"2023-11-20T07:02:20.320917+0000","last_undegraded":"2023-11-20T07:02:20.320917+0000","last_fullsized":"2023-11-20T07:02:20.320917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:17:16.496074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817091+0000","last_change":"2023-11-20T07:02:19.325452+0000","last_active":"2023-11-20T07:02:20.817091+0000","last_peered":"2023-11-20T07:02:20.817091+0000","last_clean":"2023-11-20T07:02:20.817091+0000","last_became_active":"2023-11-20T07:02:19.325098+0000","last_became_peered":"2023-11-20T07:02:19.325098+0000","last_unstale":"2023-11-20T07:02:20.817091+0000","last_undegraded":"2023-11-20T07:02:20.817091+0000","last_fullsized":"2023-11-20T07:02:20.817091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T09:46:42.995994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.816723+0000","last_change":"2023-11-20T07:02:18.356907+0000","last_active":"2023-11-20T07:02:20.816723+0000","last_peered":"2023-11-20T07:02:20.816723+0000","last_clean":"2023-11-20T07:02:20.816723+0000","last_became_active":"2023-11-20T07:02:18.356587+0000","last_became_peered":"2023-11-20T07:02:18.356587+0000","last_unstale":"2023-11-20T07:02:20.816723+0000","last_undegraded":"2023-11-20T07:02:20.816723+0000","last_fullsized":"2023-11-20T07:02:20.816723+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:18:25.796032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.816528+0000","last_change":"2023-11-20T07:02:19.332944+0000","last_active":"2023-11-20T07:02:20.816528+0000","last_peered":"2023-11-20T07:02:20.816528+0000","last_clean":"2023-11-20T07:02:20.816528+0000","last_became_active":"2023-11-20T07:02:19.332702+0000","last_became_peered":"2023-11-20T07:02:19.332702+0000","last_unstale":"2023-11-20T07:02:20.816528+0000","last_undegraded":"2023-11-20T07:02:20.816528+0000","last_fullsized":"2023-11-20T07:02:20.816528+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:16:41.263088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815356+0000","last_change":"2023-11-20T07:02:18.355025+0000","last_active":"2023-11-20T07:02:20.815356+0000","last_peered":"2023-11-20T07:02:20.815356+0000","last_clean":"2023-11-20T07:02:20.815356+0000","last_became_active":"2023-11-20T07:02:18.354718+0000","last_became_peered":"2023-11-20T07:02:18.354718+0000","last_unstale":"2023-11-20T07:02:20.815356+0000","last_undegraded":"2023-11-20T07:02:20.815356+0000","last_fullsized":"2023-11-20T07:02:20.815356+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:00:08.639314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320933+0000","last_change":"2023-11-20T07:02:19.329534+0000","last_active":"2023-11-20T07:02:20.320933+0000","last_peered":"2023-11-20T07:02:20.320933+0000","last_clean":"2023-11-20T07:02:20.320933+0000","last_became_active":"2023-11-20T07:02:19.329131+0000","last_became_peered":"2023-11-20T07:02:19.329131+0000","last_unstale":"2023-11-20T07:02:20.320933+0000","last_undegraded":"2023-11-20T07:02:20.320933+0000","last_fullsized":"2023-11-20T07:02:20.320933+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:18:10.908751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817095+0000","last_change":"2023-11-20T07:02:18.354261+0000","last_active":"2023-11-20T07:02:20.817095+0000","last_peered":"2023-11-20T07:02:20.817095+0000","last_clean":"2023-11-20T07:02:20.817095+0000","last_became_active":"2023-11-20T07:02:18.353999+0000","last_became_peered":"2023-11-20T07:02:18.353999+0000","last_unstale":"2023-11-20T07:02:20.817095+0000","last_undegraded":"2023-11-20T07:02:20.817095+0000","last_fullsized":"2023-11-20T07:02:20.817095+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:00:08.639314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817790+0000","last_change":"2023-11-20T07:02:19.332782+0000","last_active":"2023-11-20T07:02:20.817790+0000","last_peered":"2023-11-20T07:02:20.817790+0000","last_clean":"2023-11-20T07:02:20.817790+0000","last_became_active":"2023-11-20T07:02:19.332362+0000","last_became_peered":"2023-11-20T07:02:19.332362+0000","last_unstale":"2023-11-20T07:02:20.817790+0000","last_undegraded":"2023-11-20T07:02:20.817790+0000","last_fullsized":"2023-11-20T07:02:20.817790+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:49:36.013233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.319834+0000","last_change":"2023-11-20T07:02:18.347247+0000","last_active":"2023-11-20T07:02:20.319834+0000","last_peered":"2023-11-20T07:02:20.319834+0000","last_clean":"2023-11-20T07:02:20.319834+0000","last_became_active":"2023-11-20T07:02:18.345024+0000","last_became_peered":"2023-11-20T07:02:18.345024+0000","last_unstale":"2023-11-20T07:02:20.319834+0000","last_undegraded":"2023-11-20T07:02:20.319834+0000","last_fullsized":"2023-11-20T07:02:20.319834+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:16:04.423406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320346+0000","last_change":"2023-11-20T07:02:19.327833+0000","last_active":"2023-11-20T07:02:20.320346+0000","last_peered":"2023-11-20T07:02:20.320346+0000","last_clean":"2023-11-20T07:02:20.320346+0000","last_became_active":"2023-11-20T07:02:19.327258+0000","last_became_peered":"2023-11-20T07:02:19.327258+0000","last_unstale":"2023-11-20T07:02:20.320346+0000","last_undegraded":"2023-11-20T07:02:20.320346+0000","last_fullsized":"2023-11-20T07:02:20.320346+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:00:09.642736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818015+0000","last_change":"2023-11-20T07:02:18.347743+0000","last_active":"2023-11-20T07:02:20.818015+0000","last_peered":"2023-11-20T07:02:20.818015+0000","last_clean":"2023-11-20T07:02:20.818015+0000","last_became_active":"2023-11-20T07:02:18.347508+0000","last_became_peered":"2023-11-20T07:02:18.347508+0000","last_unstale":"2023-11-20T07:02:20.818015+0000","last_undegraded":"2023-11-20T07:02:20.818015+0000","last_fullsized":"2023-11-20T07:02:20.818015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:19:47.905303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815459+0000","last_change":"2023-11-20T07:02:19.334234+0000","last_active":"2023-11-20T07:02:20.815459+0000","last_peered":"2023-11-20T07:02:20.815459+0000","last_clean":"2023-11-20T07:02:20.815459+0000","last_became_active":"2023-11-20T07:02:19.331717+0000","last_became_peered":"2023-11-20T07:02:19.331717+0000","last_unstale":"2023-11-20T07:02:20.815459+0000","last_undegraded":"2023-11-20T07:02:20.815459+0000","last_fullsized":"2023-11-20T07:02:20.815459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:33:30.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817053+0000","last_change":"2023-11-20T07:02:18.356433+0000","last_active":"2023-11-20T07:02:20.817053+0000","last_peered":"2023-11-20T07:02:20.817053+0000","last_clean":"2023-11-20T07:02:20.817053+0000","last_became_active":"2023-11-20T07:02:18.356143+0000","last_became_peered":"2023-11-20T07:02:18.356143+0000","last_unstale":"2023-11-20T07:02:20.817053+0000","last_undegraded":"2023-11-20T07:02:20.817053+0000","last_fullsized":"2023-11-20T07:02:20.817053+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:33:29.923102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818385+0000","last_change":"2023-11-20T07:02:19.326109+0000","last_active":"2023-11-20T07:02:20.818385+0000","last_peered":"2023-11-20T07:02:20.818385+0000","last_clean":"2023-11-20T07:02:20.818385+0000","last_became_active":"2023-11-20T07:02:19.325908+0000","last_became_peered":"2023-11-20T07:02:19.325908+0000","last_unstale":"2023-11-20T07:02:20.818385+0000","last_undegraded":"2023-11-20T07:02:20.818385+0000","last_fullsized":"2023-11-20T07:02:20.818385+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:35:39.020003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817091+0000","last_change":"2023-11-20T07:02:18.356777+0000","last_active":"2023-11-20T07:02:20.817091+0000","last_peered":"2023-11-20T07:02:20.817091+0000","last_clean":"2023-11-20T07:02:20.817091+0000","last_became_active":"2023-11-20T07:02:18.356406+0000","last_became_peered":"2023-11-20T07:02:18.356406+0000","last_unstale":"2023-11-20T07:02:20.817091+0000","last_undegraded":"2023-11-20T07:02:20.817091+0000","last_fullsized":"2023-11-20T07:02:20.817091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:18:58.064725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.321162+0000","last_change":"2023-11-20T07:02:19.329258+0000","last_active":"2023-11-20T07:02:20.321162+0000","last_peered":"2023-11-20T07:02:20.321162+0000","last_clean":"2023-11-20T07:02:20.321162+0000","last_became_active":"2023-11-20T07:02:19.328949+0000","last_became_peered":"2023-11-20T07:02:19.328949+0000","last_unstale":"2023-11-20T07:02:20.321162+0000","last_undegraded":"2023-11-20T07:02:20.321162+0000","last_fullsized":"2023-11-20T07:02:20.321162+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:43:36.880638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818020+0000","last_change":"2023-11-20T07:02:18.352203+0000","last_active":"2023-11-20T07:02:20.818020+0000","last_peered":"2023-11-20T07:02:20.818020+0000","last_clean":"2023-11-20T07:02:20.818020+0000","last_became_active":"2023-11-20T07:02:18.351926+0000","last_became_peered":"2023-11-20T07:02:18.351926+0000","last_unstale":"2023-11-20T07:02:20.818020+0000","last_undegraded":"2023-11-20T07:02:20.818020+0000","last_fullsized":"2023-11-20T07:02:20.818020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:18:25.796032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817244+0000","last_change":"2023-11-20T07:02:19.336698+0000","last_active":"2023-11-20T07:02:20.817244+0000","last_peered":"2023-11-20T07:02:20.817244+0000","last_clean":"2023-11-20T07:02:20.817244+0000","last_became_active":"2023-11-20T07:02:19.336284+0000","last_became_peered":"2023-11-20T07:02:19.336284+0000","last_unstale":"2023-11-20T07:02:20.817244+0000","last_undegraded":"2023-11-20T07:02:20.817244+0000","last_fullsized":"2023-11-20T07:02:20.817244+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:40:53.794657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818274+0000","last_change":"2023-11-20T07:02:18.355638+0000","last_active":"2023-11-20T07:02:20.818274+0000","last_peered":"2023-11-20T07:02:20.818274+0000","last_clean":"2023-11-20T07:02:20.818274+0000","last_became_active":"2023-11-20T07:02:18.355367+0000","last_became_peered":"2023-11-20T07:02:18.355367+0000","last_unstale":"2023-11-20T07:02:20.818274+0000","last_undegraded":"2023-11-20T07:02:20.818274+0000","last_fullsized":"2023-11-20T07:02:20.818274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:18:58.064725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817675+0000","last_change":"2023-11-20T07:02:19.324074+0000","last_active":"2023-11-20T07:02:20.817675+0000","last_peered":"2023-11-20T07:02:20.817675+0000","last_clean":"2023-11-20T07:02:20.817675+0000","last_became_active":"2023-11-20T07:02:19.323724+0000","last_became_peered":"2023-11-20T07:02:19.323724+0000","last_unstale":"2023-11-20T07:02:20.817675+0000","last_undegraded":"2023-11-20T07:02:20.817675+0000","last_fullsized":"2023-11-20T07:02:20.817675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:33:30.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818145+0000","last_change":"2023-11-20T07:02:18.360418+0000","last_active":"2023-11-20T07:02:20.818145+0000","last_peered":"2023-11-20T07:02:20.818145+0000","last_clean":"2023-11-20T07:02:20.818145+0000","last_became_active":"2023-11-20T07:02:18.360160+0000","last_became_peered":"2023-11-20T07:02:18.360160+0000","last_unstale":"2023-11-20T07:02:20.818145+0000","last_undegraded":"2023-11-20T07:02:20.818145+0000","last_fullsized":"2023-11-20T07:02:20.818145+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:26.480161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815269+0000","last_change":"2023-11-20T07:02:19.330131+0000","last_active":"2023-11-20T07:02:20.815269+0000","last_peered":"2023-11-20T07:02:20.815269+0000","last_clean":"2023-11-20T07:02:20.815269+0000","last_became_active":"2023-11-20T07:02:19.329855+0000","last_became_peered":"2023-11-20T07:02:19.329855+0000","last_unstale":"2023-11-20T07:02:20.815269+0000","last_undegraded":"2023-11-20T07:02:20.815269+0000","last_fullsized":"2023-11-20T07:02:20.815269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:18:59.068146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.319822+0000","last_change":"2023-11-20T07:02:18.345606+0000","last_active":"2023-11-20T07:02:20.319822+0000","last_peered":"2023-11-20T07:02:20.319822+0000","last_clean":"2023-11-20T07:02:20.319822+0000","last_became_active":"2023-11-20T07:02:18.345301+0000","last_became_peered":"2023-11-20T07:02:18.345301+0000","last_unstale":"2023-11-20T07:02:20.319822+0000","last_undegraded":"2023-11-20T07:02:20.319822+0000","last_fullsized":"2023-11-20T07:02:20.319822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:49:29.169695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818353+0000","last_change":"2023-11-20T07:02:19.328447+0000","last_active":"2023-11-20T07:02:20.818353+0000","last_peered":"2023-11-20T07:02:20.818353+0000","last_clean":"2023-11-20T07:02:20.818353+0000","last_became_active":"2023-11-20T07:02:19.327370+0000","last_became_peered":"2023-11-20T07:02:19.327370+0000","last_unstale":"2023-11-20T07:02:20.818353+0000","last_undegraded":"2023-11-20T07:02:20.818353+0000","last_fullsized":"2023-11-20T07:02:20.818353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:05:35.610384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815105+0000","last_change":"2023-11-20T07:02:18.355865+0000","last_active":"2023-11-20T07:02:20.815105+0000","last_peered":"2023-11-20T07:02:20.815105+0000","last_clean":"2023-11-20T07:02:20.815105+0000","last_became_active":"2023-11-20T07:02:18.354785+0000","last_became_peered":"2023-11-20T07:02:18.354785+0000","last_unstale":"2023-11-20T07:02:20.815105+0000","last_undegraded":"2023-11-20T07:02:20.815105+0000","last_fullsized":"2023-11-20T07:02:20.815105+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:44:05.831991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817935+0000","last_change":"2023-11-20T07:02:19.328027+0000","last_active":"2023-11-20T07:02:20.817935+0000","last_peered":"2023-11-20T07:02:20.817935+0000","last_clean":"2023-11-20T07:02:20.817935+0000","last_became_active":"2023-11-20T07:02:19.327708+0000","last_became_peered":"2023-11-20T07:02:19.327708+0000","last_unstale":"2023-11-20T07:02:20.817935+0000","last_undegraded":"2023-11-20T07:02:20.817935+0000","last_fullsized":"2023-11-20T07:02:20.817935+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:16:41.263088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817088+0000","last_change":"2023-11-20T07:02:18.353775+0000","last_active":"2023-11-20T07:02:20.817088+0000","last_peered":"2023-11-20T07:02:20.817088+0000","last_clean":"2023-11-20T07:02:20.817088+0000","last_became_active":"2023-11-20T07:02:18.353511+0000","last_became_peered":"2023-11-20T07:02:18.353511+0000","last_unstale":"2023-11-20T07:02:20.817088+0000","last_undegraded":"2023-11-20T07:02:20.817088+0000","last_fullsized":"2023-11-20T07:02:20.817088+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:19:47.905303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.816991+0000","last_change":"2023-11-20T07:02:19.336923+0000","last_active":"2023-11-20T07:02:20.816991+0000","last_peered":"2023-11-20T07:02:20.816991+0000","last_clean":"2023-11-20T07:02:20.816991+0000","last_became_active":"2023-11-20T07:02:19.336594+0000","last_became_peered":"2023-11-20T07:02:19.336594+0000","last_unstale":"2023-11-20T07:02:20.816991+0000","last_undegraded":"2023-11-20T07:02:20.816991+0000","last_fullsized":"2023-11-20T07:02:20.816991+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T16:10:38.371764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.321196+0000","last_change":"2023-11-20T07:02:18.357362+0000","last_active":"2023-11-20T07:02:20.321196+0000","last_peered":"2023-11-20T07:02:20.321196+0000","last_clean":"2023-11-20T07:02:20.321196+0000","last_became_active":"2023-11-20T07:02:18.357062+0000","last_became_peered":"2023-11-20T07:02:18.357062+0000","last_unstale":"2023-11-20T07:02:20.321196+0000","last_undegraded":"2023-11-20T07:02:20.321196+0000","last_fullsized":"2023-11-20T07:02:20.321196+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:50:08.421863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.321124+0000","last_change":"2023-11-20T07:02:19.322106+0000","last_active":"2023-11-20T07:02:20.321124+0000","last_peered":"2023-11-20T07:02:20.321124+0000","last_clean":"2023-11-20T07:02:20.321124+0000","last_became_active":"2023-11-20T07:02:19.321124+0000","last_became_peered":"2023-11-20T07:02:19.321124+0000","last_unstale":"2023-11-20T07:02:20.321124+0000","last_undegraded":"2023-11-20T07:02:20.321124+0000","last_fullsized":"2023-11-20T07:02:20.321124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:32:43.721194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320316+0000","last_change":"2023-11-20T07:02:18.353108+0000","last_active":"2023-11-20T07:02:20.320316+0000","last_peered":"2023-11-20T07:02:20.320316+0000","last_clean":"2023-11-20T07:02:20.320316+0000","last_became_active":"2023-11-20T07:02:18.352825+0000","last_became_peered":"2023-11-20T07:02:18.352825+0000","last_unstale":"2023-11-20T07:02:20.320316+0000","last_undegraded":"2023-11-20T07:02:20.320316+0000","last_fullsized":"2023-11-20T07:02:20.320316+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:54:33.136795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320551+0000","last_change":"2023-11-20T07:02:19.321872+0000","last_active":"2023-11-20T07:02:20.320551+0000","last_peered":"2023-11-20T07:02:20.320551+0000","last_clean":"2023-11-20T07:02:20.320551+0000","last_became_active":"2023-11-20T07:02:19.321583+0000","last_became_peered":"2023-11-20T07:02:19.321583+0000","last_unstale":"2023-11-20T07:02:20.320551+0000","last_undegraded":"2023-11-20T07:02:20.320551+0000","last_fullsized":"2023-11-20T07:02:20.320551+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T17:16:05.426828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817300+0000","last_change":"2023-11-20T07:02:18.356380+0000","last_active":"2023-11-20T07:02:20.817300+0000","last_peered":"2023-11-20T07:02:20.817300+0000","last_clean":"2023-11-20T07:02:20.817300+0000","last_became_active":"2023-11-20T07:02:18.356182+0000","last_became_peered":"2023-11-20T07:02:18.356182+0000","last_unstale":"2023-11-20T07:02:20.817300+0000","last_undegraded":"2023-11-20T07:02:20.817300+0000","last_fullsized":"2023-11-20T07:02:20.817300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:44:05.831991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815294+0000","last_change":"2023-11-20T07:02:19.331250+0000","last_active":"2023-11-20T07:02:20.815294+0000","last_peered":"2023-11-20T07:02:20.815294+0000","last_clean":"2023-11-20T07:02:20.815294+0000","last_became_active":"2023-11-20T07:02:19.330826+0000","last_became_peered":"2023-11-20T07:02:19.330826+0000","last_unstale":"2023-11-20T07:02:20.815294+0000","last_undegraded":"2023-11-20T07:02:20.815294+0000","last_fullsized":"2023-11-20T07:02:20.815294+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T13:18:26.799453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320190+0000","last_change":"2023-11-20T07:02:18.354614+0000","last_active":"2023-11-20T07:02:20.320190+0000","last_peered":"2023-11-20T07:02:20.320190+0000","last_clean":"2023-11-20T07:02:20.320190+0000","last_became_active":"2023-11-20T07:02:18.354375+0000","last_became_peered":"2023-11-20T07:02:18.354375+0000","last_unstale":"2023-11-20T07:02:20.320190+0000","last_undegraded":"2023-11-20T07:02:20.320190+0000","last_fullsized":"2023-11-20T07:02:20.320190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:57:19.484212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818393+0000","last_change":"2023-11-20T07:02:19.325646+0000","last_active":"2023-11-20T07:02:20.818393+0000","last_peered":"2023-11-20T07:02:20.818393+0000","last_clean":"2023-11-20T07:02:20.818393+0000","last_became_active":"2023-11-20T07:02:19.325247+0000","last_became_peered":"2023-11-20T07:02:19.325247+0000","last_unstale":"2023-11-20T07:02:20.818393+0000","last_undegraded":"2023-11-20T07:02:20.818393+0000","last_fullsized":"2023-11-20T07:02:20.818393+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T08:18:10.908751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320139+0000","last_change":"2023-11-20T07:02:18.342162+0000","last_active":"2023-11-20T07:02:20.320139+0000","last_peered":"2023-11-20T07:02:20.320139+0000","last_clean":"2023-11-20T07:02:20.320139+0000","last_became_active":"2023-11-20T07:02:18.341853+0000","last_became_peered":"2023-11-20T07:02:18.341853+0000","last_unstale":"2023-11-20T07:02:20.320139+0000","last_undegraded":"2023-11-20T07:02:20.320139+0000","last_fullsized":"2023-11-20T07:02:20.320139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:16:49.177294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.816622+0000","last_change":"2023-11-20T07:02:19.342478+0000","last_active":"2023-11-20T07:02:20.816622+0000","last_peered":"2023-11-20T07:02:20.816622+0000","last_clean":"2023-11-20T07:02:20.816622+0000","last_became_active":"2023-11-20T07:02:19.342164+0000","last_became_peered":"2023-11-20T07:02:19.342164+0000","last_unstale":"2023-11-20T07:02:20.816622+0000","last_undegraded":"2023-11-20T07:02:20.816622+0000","last_fullsized":"2023-11-20T07:02:20.816622+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:14:42.846244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815352+0000","last_change":"2023-11-20T07:02:18.359508+0000","last_active":"2023-11-20T07:02:20.815352+0000","last_peered":"2023-11-20T07:02:20.815352+0000","last_clean":"2023-11-20T07:02:20.815352+0000","last_became_active":"2023-11-20T07:02:18.359207+0000","last_became_peered":"2023-11-20T07:02:18.359207+0000","last_unstale":"2023-11-20T07:02:20.815352+0000","last_undegraded":"2023-11-20T07:02:20.815352+0000","last_fullsized":"2023-11-20T07:02:20.815352+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:40:52.791236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818227+0000","last_change":"2023-11-20T07:02:19.332608+0000","last_active":"2023-11-20T07:02:20.818227+0000","last_peered":"2023-11-20T07:02:20.818227+0000","last_clean":"2023-11-20T07:02:20.818227+0000","last_became_active":"2023-11-20T07:02:19.332033+0000","last_became_peered":"2023-11-20T07:02:19.332033+0000","last_unstale":"2023-11-20T07:02:20.818227+0000","last_undegraded":"2023-11-20T07:02:20.818227+0000","last_fullsized":"2023-11-20T07:02:20.818227+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:23:26.520986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320026+0000","last_change":"2023-11-20T07:02:18.350365+0000","last_active":"2023-11-20T07:02:20.320026+0000","last_peered":"2023-11-20T07:02:20.320026+0000","last_clean":"2023-11-20T07:02:20.320026+0000","last_became_active":"2023-11-20T07:02:18.350055+0000","last_became_peered":"2023-11-20T07:02:18.350055+0000","last_unstale":"2023-11-20T07:02:20.320026+0000","last_undegraded":"2023-11-20T07:02:20.320026+0000","last_fullsized":"2023-11-20T07:02:20.320026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:33:26.532696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817206+0000","last_change":"2023-11-20T07:02:19.339032+0000","last_active":"2023-11-20T07:02:20.817206+0000","last_peered":"2023-11-20T07:02:20.817206+0000","last_clean":"2023-11-20T07:02:20.817206+0000","last_became_active":"2023-11-20T07:02:19.337572+0000","last_became_peered":"2023-11-20T07:02:19.337572+0000","last_unstale":"2023-11-20T07:02:20.817206+0000","last_undegraded":"2023-11-20T07:02:20.817206+0000","last_fullsized":"2023-11-20T07:02:20.817206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:35:39.020003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817177+0000","last_change":"2023-11-20T07:02:18.358649+0000","last_active":"2023-11-20T07:02:20.817177+0000","last_peered":"2023-11-20T07:02:20.817177+0000","last_clean":"2023-11-20T07:02:20.817177+0000","last_became_active":"2023-11-20T07:02:18.356816+0000","last_became_peered":"2023-11-20T07:02:18.356816+0000","last_unstale":"2023-11-20T07:02:20.817177+0000","last_undegraded":"2023-11-20T07:02:20.817177+0000","last_fullsized":"2023-11-20T07:02:20.817177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:14:50.070578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815462+0000","last_change":"2023-11-20T07:02:19.334255+0000","last_active":"2023-11-20T07:02:20.815462+0000","last_peered":"2023-11-20T07:02:20.815462+0000","last_clean":"2023-11-20T07:02:20.815462+0000","last_became_active":"2023-11-20T07:02:19.331736+0000","last_became_peered":"2023-11-20T07:02:19.331736+0000","last_unstale":"2023-11-20T07:02:20.815462+0000","last_undegraded":"2023-11-20T07:02:20.815462+0000","last_fullsized":"2023-11-20T07:02:20.815462+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:14:51.073999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320447+0000","last_change":"2023-11-20T07:02:18.361179+0000","last_active":"2023-11-20T07:02:20.320447+0000","last_peered":"2023-11-20T07:02:20.320447+0000","last_clean":"2023-11-20T07:02:20.320447+0000","last_became_active":"2023-11-20T07:02:18.360903+0000","last_became_peered":"2023-11-20T07:02:18.360903+0000","last_unstale":"2023-11-20T07:02:20.320447+0000","last_undegraded":"2023-11-20T07:02:20.320447+0000","last_fullsized":"2023-11-20T07:02:20.320447+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:49:10.407061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818207+0000","last_change":"2023-11-20T07:02:19.333117+0000","last_active":"2023-11-20T07:02:20.818207+0000","last_peered":"2023-11-20T07:02:20.818207+0000","last_clean":"2023-11-20T07:02:20.818207+0000","last_became_active":"2023-11-20T07:02:19.331707+0000","last_became_peered":"2023-11-20T07:02:19.331707+0000","last_unstale":"2023-11-20T07:02:20.818207+0000","last_undegraded":"2023-11-20T07:02:20.818207+0000","last_fullsized":"2023-11-20T07:02:20.818207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:08:57.080946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818103+0000","last_change":"2023-11-20T07:02:18.356356+0000","last_active":"2023-11-20T07:02:20.818103+0000","last_peered":"2023-11-20T07:02:20.818103+0000","last_clean":"2023-11-20T07:02:20.818103+0000","last_became_active":"2023-11-20T07:02:18.354855+0000","last_became_peered":"2023-11-20T07:02:18.354855+0000","last_unstale":"2023-11-20T07:02:20.818103+0000","last_undegraded":"2023-11-20T07:02:20.818103+0000","last_fullsized":"2023-11-20T07:02:20.818103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:17:16.496074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.819180+0000","last_change":"2023-11-20T07:02:19.336231+0000","last_active":"2023-11-20T07:02:20.819180+0000","last_peered":"2023-11-20T07:02:20.819180+0000","last_clean":"2023-11-20T07:02:20.819180+0000","last_became_active":"2023-11-20T07:02:19.334654+0000","last_became_peered":"2023-11-20T07:02:19.334654+0000","last_unstale":"2023-11-20T07:02:20.819180+0000","last_undegraded":"2023-11-20T07:02:20.819180+0000","last_fullsized":"2023-11-20T07:02:20.819180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T14:18:59.068146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817659+0000","last_change":"2023-11-20T07:02:18.357723+0000","last_active":"2023-11-20T07:02:20.817659+0000","last_peered":"2023-11-20T07:02:20.817659+0000","last_clean":"2023-11-20T07:02:20.817659+0000","last_became_active":"2023-11-20T07:02:18.357419+0000","last_became_peered":"2023-11-20T07:02:18.357419+0000","last_unstale":"2023-11-20T07:02:20.817659+0000","last_undegraded":"2023-11-20T07:02:20.817659+0000","last_fullsized":"2023-11-20T07:02:20.817659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:26.480161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817407+0000","last_change":"2023-11-20T07:02:19.324752+0000","last_active":"2023-11-20T07:02:20.817407+0000","last_peered":"2023-11-20T07:02:20.817407+0000","last_clean":"2023-11-20T07:02:20.817407+0000","last_became_active":"2023-11-20T07:02:19.324475+0000","last_became_peered":"2023-11-20T07:02:19.324475+0000","last_unstale":"2023-11-20T07:02:20.817407+0000","last_undegraded":"2023-11-20T07:02:20.817407+0000","last_fullsized":"2023-11-20T07:02:20.817407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:43:36.880638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320114+0000","last_change":"2023-11-20T07:02:18.353418+0000","last_active":"2023-11-20T07:02:20.320114+0000","last_peered":"2023-11-20T07:02:20.320114+0000","last_clean":"2023-11-20T07:02:20.320114+0000","last_became_active":"2023-11-20T07:02:18.352731+0000","last_became_peered":"2023-11-20T07:02:18.352731+0000","last_unstale":"2023-11-20T07:02:20.320114+0000","last_undegraded":"2023-11-20T07:02:20.320114+0000","last_fullsized":"2023-11-20T07:02:20.320114+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T12:49:10.407061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320714+0000","last_change":"2023-11-20T07:02:19.331263+0000","last_active":"2023-11-20T07:02:20.320714+0000","last_peered":"2023-11-20T07:02:20.320714+0000","last_clean":"2023-11-20T07:02:20.320714+0000","last_became_active":"2023-11-20T07:02:19.330939+0000","last_became_peered":"2023-11-20T07:02:19.330939+0000","last_unstale":"2023-11-20T07:02:20.320714+0000","last_undegraded":"2023-11-20T07:02:20.320714+0000","last_fullsized":"2023-11-20T07:02:20.320714+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:40:53.794657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.320795+0000","last_change":"2023-11-20T07:02:18.349184+0000","last_active":"2023-11-20T07:02:20.320795+0000","last_peered":"2023-11-20T07:02:20.320795+0000","last_clean":"2023-11-20T07:02:20.320795+0000","last_became_active":"2023-11-20T07:02:18.348688+0000","last_became_peered":"2023-11-20T07:02:18.348688+0000","last_unstale":"2023-11-20T07:02:20.320795+0000","last_undegraded":"2023-11-20T07:02:20.320795+0000","last_fullsized":"2023-11-20T07:02:20.320795+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T11:12:26.480161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815757+0000","last_change":"2023-11-20T07:02:19.332491+0000","last_active":"2023-11-20T07:02:20.815757+0000","last_peered":"2023-11-20T07:02:20.815757+0000","last_clean":"2023-11-20T07:02:20.815757+0000","last_became_active":"2023-11-20T07:02:19.331820+0000","last_became_peered":"2023-11-20T07:02:19.331820+0000","last_unstale":"2023-11-20T07:02:20.815757+0000","last_undegraded":"2023-11-20T07:02:20.815757+0000","last_fullsized":"2023-11-20T07:02:20.815757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:16:41.263088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.818103+0000","last_change":"2023-11-20T07:02:18.347748+0000","last_active":"2023-11-20T07:02:20.818103+0000","last_peered":"2023-11-20T07:02:20.818103+0000","last_clean":"2023-11-20T07:02:20.818103+0000","last_became_active":"2023-11-20T07:02:18.347527+0000","last_became_peered":"2023-11-20T07:02:18.347527+0000","last_unstale":"2023-11-20T07:02:20.818103+0000","last_undegraded":"2023-11-20T07:02:20.818103+0000","last_fullsized":"2023-11-20T07:02:20.818103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:28:19.766855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.817028+0000","last_change":"2023-11-20T07:02:19.340044+0000","last_active":"2023-11-20T07:02:20.817028+0000","last_peered":"2023-11-20T07:02:20.817028+0000","last_clean":"2023-11-20T07:02:20.817028+0000","last_became_active":"2023-11-20T07:02:19.339785+0000","last_became_peered":"2023-11-20T07:02:19.339785+0000","last_unstale":"2023-11-20T07:02:20.817028+0000","last_undegraded":"2023-11-20T07:02:20.817028+0000","last_fullsized":"2023-11-20T07:02:20.817028+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:18.322338+0000","last_clean_scrub_stamp":"2023-11-20T07:02:18.322338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:05:44.783641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-11-20T07:02:20.815729+0000","last_change":"2023-11-20T07:02:18.357238+0000","last_active":"2023-11-20T07:02:20.815729+0000","last_peered":"2023-11-20T07:02:20.815729+0000","last_clean":"2023-11-20T07:02:20.815729+0000","last_became_active":"2023-11-20T07:02:18.356775+0000","last_became_peered":"2023-11-20T07:02:18.356775+0000","last_unstale":"2023-11-20T07:02:20.815729+0000","last_undegraded":"2023-11-20T07:02:20.815729+0000","last_fullsized":"2023-11-20T07:02:20.815729+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:02:17.318917+0000","last_clean_scrub_stamp":"2023-11-20T07:02:17.318917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T10:32:42.717772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-20T07:02:19.318008+0000","last_change":"2023-11-20T07:00:43.158695+0000","last_active":"2023-11-20T07:02:19.318008+0000","last_peered":"2023-11-20T07:02:19.318008+0000","last_clean":"2023-11-20T07:02:19.318008+0000","last_became_active":"2023-11-20T07:00:43.157454+0000","last_became_peered":"2023-11-20T07:00:43.157454+0000","last_unstale":"2023-11-20T07:02:19.318008+0000","last_undegraded":"2023-11-20T07:02:19.318008+0000","last_fullsized":"2023-11-20T07:02:19.318008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_clean_scrub_stamp":"2023-11-20T07:00:42.001721+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:44:20.907460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":781218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.79900000000000004}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.73299999999999998}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.68300000000000005}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.76300000000000001}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.53800000000000003}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.58899999999999997}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.749},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.94199999999999995}]},{"osd":1,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.98799999999999999}]},{"osd":2,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.85799999999999998}]},{"osd":3,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.4830000000000001,"5min":2.4830000000000001,"15min":2.4830000000000001},"last":1.026},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.96699999999999997}]},{"osd":4,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.74199999999999999}]},{"osd":5,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.71599999999999997}]},{"osd":7,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":189280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.55300000000000005}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.63600000000000001}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.752}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.73199999999999998}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.83399999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.80600000000000005}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.874},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.77600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":189772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.90500000000000003}]},{"osd":1,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.76400000000000001}]},{"osd":2,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.872},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.69999999999999996}]},{"osd":3,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.94299999999999995}]},{"osd":6,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.95799999999999996}]},{"osd":7,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.98799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.438}]},{"osd":1,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.46000000000000002}]},{"osd":2,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.498}]},{"osd":4,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.83599999999999997}]},{"osd":5,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.82199999999999995}]},{"osd":6,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.76500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":189238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":1.4350000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.35799999999999998}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55800000000000005}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.434},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48099999999999998}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.83699999999999997}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":1.5740000000000001}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.72399999999999998}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.87}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.28199999999999997}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.31},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.434}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40200000000000002}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.53600000000000003}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.68400000000000005}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.56399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":779570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.433},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.38}]},{"osd":2,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.34300000000000003}]},{"osd":3,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.48099999999999998}]},{"osd":4,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.70499999999999996}]},{"osd":5,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.58499999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.74399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T07:02:23.904 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-20T07:02:23.905 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-20T07:02:24.023 INFO:tasks.ceph.mds.c.smithi088.stderr:2023-11-20T07:02:24.021+0000 7f150dfb4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-20T07:02:24.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.089+0000 7fc3f8891640 1 Processor -- start 2023-11-20T07:02:24.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.089+0000 7fc3f8891640 1 -- start start 2023-11-20T07:02:24.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f8891640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc3f40ad6d0 0x7fc3f40b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f8891640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f4072560 con 0x7fc3f40b05d0 2023-11-20T07:02:24.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f8891640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f40ca1c0 con 0x7fc3f4159be0 2023-11-20T07:02:24.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f8891640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f4159fc0 con 0x7fc3f40ad6d0 2023-11-20T07:02:24.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f2d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc3f40b05d0 0x7fc3f40cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58704/0 (socket says 172.21.15.88:58704) 2023-11-20T07:02:24.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f2d9d640 1 -- 172.21.15.88:0/2638556141 learned_addr learned my addr 172.21.15.88:0/2638556141 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:24.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3ebfff640 1 --2- 172.21.15.88:0/2638556141 >> v2:172.21.15.175:3300/0 conn(0x7fc3f40ad6d0 0x7fc3f40b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067859414 0 0) 0x7fc3f4072560 con 0x7fc3f40b05d0 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3e0003530 con 0x7fc3f40b05d0 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380212197 0 0) 0x7fc3f40ca1c0 con 0x7fc3f4159be0 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3f4072560 con 0x7fc3f4159be0 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3894816679 0 0) 0x7fc3e0003530 con 0x7fc3f40b05d0 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 >> v2:172.21.15.175:3300/0 conn(0x7fc3f40ad6d0 msgr2=0x7fc3f40b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 --2- 172.21.15.88:0/2638556141 >> v2:172.21.15.175:3300/0 conn(0x7fc3f40ad6d0 0x7fc3f40b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 >> v1:172.21.15.175:6789/0 conn(0x7fc3f4159be0 legacy=0x7fc3f40ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f40b09b0 con 0x7fc3f40b05d0 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fc3ec001a00 con 0x7fc3f40b05d0 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 >> v1:172.21.15.88:6789/0 conn(0x7fc3f40b05d0 legacy=0x7fc3f40cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 --2- 172.21.15.88:0/2638556141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3e0003b10 0x7fc3e0003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 --2- 172.21.15.88:0/2638556141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3e00047d0 0x7fc3e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 --2- 172.21.15.88:0/2638556141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3e0005190 0x7fc3e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4159fc0 con 0x7fc3e00047d0 2023-11-20T07:02:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e000c0c0 con 0x7fc3e0003b10 2023-11-20T07:02:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e000c280 con 0x7fc3e0005190 2023-11-20T07:02:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3ebfff640 1 --2- 172.21.15.88:0/2638556141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3e00047d0 0x7fc3e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f259c640 1 --2- 172.21.15.88:0/2638556141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3e0003b10 0x7fc3e0003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f2d9d640 1 --2- 172.21.15.88:0/2638556141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3e0005190 0x7fc3e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3ebfff640 1 -- 172.21.15.88:0/2638556141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3e0005190 msgr2=0x7fc3e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3ebfff640 1 --2- 172.21.15.88:0/2638556141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3e0005190 0x7fc3e000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3ebfff640 1 -- 172.21.15.88:0/2638556141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3e0003b10 msgr2=0x7fc3e0003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3ebfff640 1 --2- 172.21.15.88:0/2638556141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3e0003b10 0x7fc3e0003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3ebfff640 1 -- 172.21.15.88:0/2638556141 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e0003530 con 0x7fc3e00047d0 2023-11-20T07:02:24.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.093+0000 7fc3f2d9d640 1 -- 172.21.15.88:0/2638556141 reap_dead start 2023-11-20T07:02:24.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.097+0000 7fc3ebfff640 1 --2- 172.21.15.88:0/2638556141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3e00047d0 0x7fc3e0004c50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009ae0 tx=0x7fc3dc01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4606a698252d3e5d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:24.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.097+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0a6510 con 0x7fc3e00047d0 2023-11-20T07:02:24.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.097+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc0a6670 con 0x7fc3e00047d0 2023-11-20T07:02:24.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.097+0000 7fc3f1d9b640 1 -- 172.21.15.88:0/2638556141 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0a6a20 con 0x7fc3e00047d0 2023-11-20T07:02:24.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.097+0000 7fc3f8891640 1 -- 172.21.15.88:0/2638556141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3e00047d0 msgr2=0x7fc3e0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:24.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.097+0000 7fc3f8891640 1 --2- 172.21.15.88:0/2638556141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3e00047d0 0x7fc3e0004c50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009ae0 tx=0x7fc3dc01ca20 comp rx=0 tx=0).stop 2023-11-20T07:02:24.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.097+0000 7fc3f8891640 1 -- 172.21.15.88:0/2638556141 shutdown_connections 2023-11-20T07:02:24.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.097+0000 7fc3f8891640 1 --2- 172.21.15.88:0/2638556141 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3e00047d0 0x7fc3e0004c50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.097+0000 7fc3f8891640 1 -- 172.21.15.88:0/2638556141 >> 172.21.15.88:0/2638556141 conn(0x7fc3f40cb090 msgr2=0x7fc3f40cb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:24.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.097+0000 7fc3f8891640 1 -- 172.21.15.88:0/2638556141 shutdown_connections 2023-11-20T07:02:24.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.097+0000 7fc3f8891640 1 -- 172.21.15.88:0/2638556141 wait complete. 2023-11-20T07:02:24.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f8891640 1 Processor -- start 2023-11-20T07:02:24.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f8891640 1 -- start start 2023-11-20T07:02:24.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f8891640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3e00047d0 0x7fc3f40c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f8891640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3f415a190 0x7fc3f4147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f8891640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f40c94c0 0x7fc3f40c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f8891640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40c9e80 con 0x7fc3f40c94c0 2023-11-20T07:02:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f8891640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40c5790 con 0x7fc3e00047d0 2023-11-20T07:02:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f8891640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f415c710 con 0x7fc3f415a190 2023-11-20T07:02:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f2d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f40c94c0 0x7fc3f40c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3e00047d0 0x7fc3f40c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f2d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f40c94c0 0x7fc3f40c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47884/0 (socket says 172.21.15.88:47884) 2023-11-20T07:02:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3ebfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3f415a190 0x7fc3f4147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f2d9d640 1 -- 172.21.15.88:0/12832268 learned_addr learned my addr 172.21.15.88:0/12832268 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f2d9d640 1 -- 172.21.15.88:0/12832268 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3f415a190 msgr2=0x7fc3f4147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f2d9d640 1 --2- 172.21.15.88:0/12832268 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3f415a190 0x7fc3f4147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f2d9d640 1 -- 172.21.15.88:0/12832268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3e00047d0 msgr2=0x7fc3f40c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:24.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f2d9d640 1 --2- 172.21.15.88:0/12832268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3e00047d0 0x7fc3f40c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f2d9d640 1 -- 172.21.15.88:0/12832268 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f415c980 con 0x7fc3f40c94c0 2023-11-20T07:02:24.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f2d9d640 1 --2- 172.21.15.88:0/12832268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f40c94c0 0x7fc3f40c9940 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec001360 tx=0x7fc3ec007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:24.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3eaffd640 1 -- 172.21.15.88:0/12832268 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00ea40 con 0x7fc3f40c94c0 2023-11-20T07:02:24.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3eaffd640 1 -- 172.21.15.88:0/12832268 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec00ebc0 con 0x7fc3f40c94c0 2023-11-20T07:02:24.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3eaffd640 1 -- 172.21.15.88:0/12832268 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec013420 con 0x7fc3f40c94c0 2023-11-20T07:02:24.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f8891640 1 -- 172.21.15.88:0/12832268 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f415cc60 con 0x7fc3f40c94c0 2023-11-20T07:02:24.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.101+0000 7fc3f8891640 1 -- 172.21.15.88:0/12832268 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f4147db0 con 0x7fc3f40c94c0 2023-11-20T07:02:24.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.105+0000 7fc3f8891640 1 -- 172.21.15.88:0/12832268 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f4073fa0 con 0x7fc3f40c94c0 2023-11-20T07:02:24.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.105+0000 7fc3eaffd640 1 -- 172.21.15.88:0/12832268 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc3ec013580 con 0x7fc3f40c94c0 2023-11-20T07:02:24.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.105+0000 7fc3eaffd640 1 --2- 172.21.15.88:0/12832268 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc3d40664a0 0x7fc3d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.105+0000 7fc3eaffd640 1 -- 172.21.15.88:0/12832268 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc3ec084140 con 0x7fc3f40c94c0 2023-11-20T07:02:24.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.105+0000 7fc3f259c640 1 --2- 172.21.15.88:0/12832268 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc3d40664a0 0x7fc3d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.105+0000 7fc3f259c640 1 --2- 172.21.15.88:0/12832268 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc3d40664a0 0x7fc3d4068960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4007fd0 tx=0x7fc3e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:24.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.109+0000 7fc3eaffd640 1 -- 172.21.15.88:0/12832268 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc3ec0515c0 con 0x7fc3f40c94c0 2023-11-20T07:02:24.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.313+0000 7fc3f8891640 1 -- 172.21.15.88:0/12832268 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc3f40cdba0 con 0x7fc3f40c94c0 2023-11-20T07:02:24.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3eaffd640 1 -- 172.21.15.88:0/12832268 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc3ec054be0 con 0x7fc3f40c94c0 2023-11-20T07:02:24.317 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-11-20T07:02:24.317 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDlA1tlJRZoFxAAjx3lxpd5CSyg4vcDb18mMQ== 2023-11-20T07:02:24.317 INFO:teuthology.orchestra.run.smithi088.stdout: caps mds = "allow" 2023-11-20T07:02:24.317 INFO:teuthology.orchestra.run.smithi088.stdout: caps mon = "allow r" 2023-11-20T07:02:24.317 INFO:teuthology.orchestra.run.smithi088.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-20T07:02:24.317 INFO:teuthology.orchestra.run.smithi088.stderr:updated caps for client.0 2023-11-20T07:02:24.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3f8891640 1 -- 172.21.15.88:0/12832268 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc3d40664a0 msgr2=0x7fc3d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:24.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3f8891640 1 --2- 172.21.15.88:0/12832268 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc3d40664a0 0x7fc3d4068960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4007fd0 tx=0x7fc3e4009040 comp rx=0 tx=0).stop 2023-11-20T07:02:24.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3f8891640 1 -- 172.21.15.88:0/12832268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f40c94c0 msgr2=0x7fc3f40c9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:24.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3f8891640 1 --2- 172.21.15.88:0/12832268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f40c94c0 0x7fc3f40c9940 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec001360 tx=0x7fc3ec007b50 comp rx=0 tx=0).stop 2023-11-20T07:02:24.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3f8891640 1 -- 172.21.15.88:0/12832268 shutdown_connections 2023-11-20T07:02:24.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3f8891640 1 --2- 172.21.15.88:0/12832268 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc3d40664a0 0x7fc3d4068960 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3f8891640 1 --2- 172.21.15.88:0/12832268 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3f415a190 0x7fc3f4147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3f8891640 1 --2- 172.21.15.88:0/12832268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3f40c94c0 0x7fc3f40c9940 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3f8891640 1 --2- 172.21.15.88:0/12832268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3e00047d0 0x7fc3f40c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3f8891640 1 -- 172.21.15.88:0/12832268 >> 172.21.15.88:0/12832268 conn(0x7fc3f40cb090 msgr2=0x7fc3f40aca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:24.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3f8891640 1 -- 172.21.15.88:0/12832268 shutdown_connections 2023-11-20T07:02:24.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.317+0000 7fc3f8891640 1 -- 172.21.15.88:0/12832268 wait complete. 2023-11-20T07:02:24.338 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:02:24.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.473+0000 7f0abf501640 1 Processor -- start 2023-11-20T07:02:24.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abf501640 1 -- start start 2023-11-20T07:02:24.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abf501640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ab8070c40 0x7f0ab815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abf501640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0ab80b4020 0x7f0ab80b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abf501640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab815be60 con 0x7f0ab80b0620 2023-11-20T07:02:24.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abf501640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab815b3b0 con 0x7f0ab8070c40 2023-11-20T07:02:24.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abf501640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab815c1f0 con 0x7f0ab80b4020 2023-11-20T07:02:24.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abd29d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ab8070c40 0x7f0ab815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abd29d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ab8070c40 0x7f0ab815ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47888/0 (socket says 172.21.15.88:47888) 2023-11-20T07:02:24.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abd29d640 1 -- 172.21.15.88:0/1841248812 learned_addr learned my addr 172.21.15.88:0/1841248812 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:24.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abca9c640 1 --2- 172.21.15.88:0/1841248812 >> v2:172.21.15.175:3300/0 conn(0x7f0ab80b4020 0x7f0ab80b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abd29d640 1 -- 172.21.15.88:0/1841248812 >> v2:172.21.15.175:3300/0 conn(0x7f0ab80b4020 msgr2=0x7f0ab80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:24.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abd29d640 1 --2- 172.21.15.88:0/1841248812 >> v2:172.21.15.175:3300/0 conn(0x7f0ab80b4020 0x7f0ab80b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abd29d640 1 -- 172.21.15.88:0/1841248812 >> v1:172.21.15.175:6789/0 conn(0x7f0ab80b0620 legacy=0x7f0ab815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:24.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abd29d640 1 -- 172.21.15.88:0/1841248812 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab80b0a30 con 0x7f0ab8070c40 2023-11-20T07:02:24.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.477+0000 7f0abca9c640 1 --2- 172.21.15.88:0/1841248812 >> v2:172.21.15.175:3300/0 conn(0x7f0ab80b4020 0x7f0ab80b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:24.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0abd29d640 1 --2- 172.21.15.88:0/1841248812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab8070c40 0x7f0ab815ae70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80cc1e0 tx=0x7f0ab401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afdf4c001a7bf4f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:24.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0aaffff640 1 -- 172.21.15.88:0/1841248812 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40a7070 con 0x7f0ab8070c40 2023-11-20T07:02:24.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0aaffff640 1 -- 172.21.15.88:0/1841248812 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab40ab430 con 0x7f0ab8070c40 2023-11-20T07:02:24.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0aaffff640 1 -- 172.21.15.88:0/1841248812 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40ab7c0 con 0x7f0ab8070c40 2023-11-20T07:02:24.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0abf501640 1 -- 172.21.15.88:0/1841248812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab8070c40 msgr2=0x7f0ab815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:24.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0abf501640 1 --2- 172.21.15.88:0/1841248812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab8070c40 0x7f0ab815ae70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80cc1e0 tx=0x7f0ab401c430 comp rx=0 tx=0).stop 2023-11-20T07:02:24.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0abf501640 1 -- 172.21.15.88:0/1841248812 shutdown_connections 2023-11-20T07:02:24.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0abf501640 1 --2- 172.21.15.88:0/1841248812 >> v2:172.21.15.175:3300/0 conn(0x7f0ab80b4020 0x7f0ab80b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0abf501640 1 --2- 172.21.15.88:0/1841248812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab8070c40 0x7f0ab815ae70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0abf501640 1 -- 172.21.15.88:0/1841248812 >> 172.21.15.88:0/1841248812 conn(0x7f0ab806c190 msgr2=0x7f0ab806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:24.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0abf501640 1 -- 172.21.15.88:0/1841248812 shutdown_connections 2023-11-20T07:02:24.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0abf501640 1 -- 172.21.15.88:0/1841248812 wait complete. 2023-11-20T07:02:24.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0abf501640 1 Processor -- start 2023-11-20T07:02:24.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.481+0000 7f0abf501640 1 -- start start 2023-11-20T07:02:24.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abf501640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab8070c40 0x7f0ab814cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abf501640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab80b0620 0x7f0ab81f8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abf501640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab80b4020 0x7f0ab81f8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abf501640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab81505a0 con 0x7f0ab8070c40 2023-11-20T07:02:24.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abf501640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab814ffe0 con 0x7f0ab80b4020 2023-11-20T07:02:24.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abf501640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab81502c0 con 0x7f0ab80b0620 2023-11-20T07:02:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abd29d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab8070c40 0x7f0ab814cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abd29d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab8070c40 0x7f0ab814cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47904/0 (socket says 172.21.15.88:47904) 2023-11-20T07:02:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abd29d640 1 -- 172.21.15.88:0/545477279 learned_addr learned my addr 172.21.15.88:0/545477279 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abda9e640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab80b4020 0x7f0ab81f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abca9c640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab80b0620 0x7f0ab81f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abd29d640 1 -- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab80b0620 msgr2=0x7f0ab81f8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abd29d640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab80b0620 0x7f0ab81f8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abd29d640 1 -- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab80b4020 msgr2=0x7f0ab81f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abd29d640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab80b4020 0x7f0ab81f8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abd29d640 1 -- 172.21.15.88:0/545477279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab40094d0 con 0x7f0ab8070c40 2023-11-20T07:02:24.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abd29d640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab8070c40 0x7f0ab814cc90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40ad040 tx=0x7f0ab40191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:24.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0aadffb640 1 -- 172.21.15.88:0/545477279 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40b4830 con 0x7f0ab8070c40 2023-11-20T07:02:24.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0aadffb640 1 -- 172.21.15.88:0/545477279 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab40b49b0 con 0x7f0ab8070c40 2023-11-20T07:02:24.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abf501640 1 -- 172.21.15.88:0/545477279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab81508b0 con 0x7f0ab8070c40 2023-11-20T07:02:24.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0aadffb640 1 -- 172.21.15.88:0/545477279 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40b4d60 con 0x7f0ab8070c40 2023-11-20T07:02:24.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abf501640 1 -- 172.21.15.88:0/545477279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab814f220 con 0x7f0ab8070c40 2023-11-20T07:02:24.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.485+0000 7f0abf501640 1 -- 172.21.15.88:0/545477279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab8074010 con 0x7f0ab8070c40 2023-11-20T07:02:24.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.489+0000 7f0aadffb640 1 -- 172.21.15.88:0/545477279 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0ab40c2460 con 0x7f0ab8070c40 2023-11-20T07:02:24.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.489+0000 7f0aadffb640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0a9c0664d0 0x7f0a9c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:24.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.489+0000 7f0aadffb640 1 -- 172.21.15.88:0/545477279 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0ab411e430 con 0x7f0ab8070c40 2023-11-20T07:02:24.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.489+0000 7f0abca9c640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0a9c0664d0 0x7f0a9c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.489+0000 7f0abca9c640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0a9c0664d0 0x7f0a9c068990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8006fd0 tx=0x7f0aa8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:24.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.493+0000 7f0aadffb640 1 -- 172.21.15.88:0/545477279 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0ab40eb7f0 con 0x7f0ab8070c40 2023-11-20T07:02:24.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 -- 172.21.15.88:0/545477279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ab8150d60 con 0x7f0ab8070c40 2023-11-20T07:02:24.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0aadffb640 1 -- 172.21.15.88:0/545477279 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f0ab40eee10 con 0x7f0ab8070c40 2023-11-20T07:02:24.673 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:24.673 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/4055175580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4055175580},{"type":"v1","addr":"172.21.15.175:6836","nonce":4055175580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3966879465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3966879465},{"type":"v1","addr":"172.21.15.175:6837","nonce":3966879465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/2725430928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2725430928},{"type":"v1","addr":"172.21.15.88:6834","nonce":2725430928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:02:18.706402+0000","modified":"2023-11-20T07:02:21.724727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2477383155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2477383155},{"type":"v1","addr":"172.21.15.88:6835","nonce":2477383155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-20T07:02:24.674 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 18 2023-11-20T07:02:24.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 -- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0a9c0664d0 msgr2=0x7f0a9c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:24.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0a9c0664d0 0x7f0a9c068990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8006fd0 tx=0x7f0aa8008040 comp rx=0 tx=0).stop 2023-11-20T07:02:24.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 -- 172.21.15.88:0/545477279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab8070c40 msgr2=0x7f0ab814cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:24.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab8070c40 0x7f0ab814cc90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40ad040 tx=0x7f0ab40191d0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 -- 172.21.15.88:0/545477279 shutdown_connections 2023-11-20T07:02:24.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f0a9c0664d0 0x7f0a9c068990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ab80b0620 0x7f0ab81f8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ab80b4020 0x7f0ab81f8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 --2- 172.21.15.88:0/545477279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab8070c40 0x7f0ab814cc90 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:24.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 -- 172.21.15.88:0/545477279 >> 172.21.15.88:0/545477279 conn(0x7f0ab806c190 msgr2=0x7f0ab8152d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:24.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 -- 172.21.15.88:0/545477279 shutdown_connections 2023-11-20T07:02:24.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:24.673+0000 7f0abf501640 1 -- 172.21.15.88:0/545477279 wait complete. 2023-11-20T07:02:25.096 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-20T07:02:18.706402+0000', 'modified': '2023-11-20T07:02:21.724727+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5472': {'gid': 5472, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6835/2477383155', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6833', 'nonce': 2477383155}, {'type': 'v1', 'addr': '172.21.15.88:6835', 'nonce': 2477383155}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-20T07:02:25.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-20T07:02:25.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-20T07:02:25.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.233+0000 7f7d3efaa640 1 Processor -- start 2023-11-20T07:02:25.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.233+0000 7f7d3efaa640 1 -- start start 2023-11-20T07:02:25.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d3efaa640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7d38065a80 0x7f7d38161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d3efaa640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d380ccbd0 con 0x7f7d3815cb30 2023-11-20T07:02:25.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d3efaa640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3806b180 con 0x7f7d3815cf10 2023-11-20T07:02:25.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d3efaa640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3806b460 con 0x7f7d38065a80 2023-11-20T07:02:25.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d3cd46640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7d3815cb30 0x7f7d381608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58716/0 (socket says 172.21.15.88:58716) 2023-11-20T07:02:25.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d3cd46640 1 -- 172.21.15.88:0/1391139317 learned_addr learned my addr 172.21.15.88:0/1391139317 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:25.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/1391139317 >> v2:172.21.15.175:3300/0 conn(0x7f7d38065a80 0x7f7d38161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d2f7fe640 1 -- 172.21.15.88:0/1391139317 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230982428 0 0) 0x7f7d380ccbd0 con 0x7f7d3815cb30 2023-11-20T07:02:25.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d2f7fe640 1 -- 172.21.15.88:0/1391139317 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d20003530 con 0x7f7d3815cb30 2023-11-20T07:02:25.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d2ffff640 1 -- 172.21.15.88:0/1391139317 >> v1:172.21.15.175:6789/0 conn(0x7f7d3815cf10 legacy=0x7f7d3806cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d2f7fe640 1 -- 172.21.15.88:0/1391139317 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2636195411 0 0) 0x7f7d20003530 con 0x7f7d3815cb30 2023-11-20T07:02:25.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d2ffff640 1 -- 172.21.15.88:0/1391139317 >> v1:172.21.15.88:6789/0 conn(0x7f7d3815cb30 legacy=0x7f7d381608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.237+0000 7f7d2ffff640 1 -- 172.21.15.88:0/1391139317 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3806c6e0 con 0x7f7d38065a80 2023-11-20T07:02:25.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/1391139317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d38065a80 0x7f7d38161000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7d280097c0 tx=0x7f7d2801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dbeae4bac50acba server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:25.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d2f7fe640 1 -- 172.21.15.88:0/1391139317 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34001680 con 0x7f7d38065a80 2023-11-20T07:02:25.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d2f7fe640 1 -- 172.21.15.88:0/1391139317 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d280a7050 con 0x7f7d38065a80 2023-11-20T07:02:25.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d2f7fe640 1 -- 172.21.15.88:0/1391139317 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280ab620 con 0x7f7d38065a80 2023-11-20T07:02:25.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d3efaa640 1 -- 172.21.15.88:0/1391139317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d38065a80 msgr2=0x7f7d38161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d3efaa640 1 --2- 172.21.15.88:0/1391139317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d38065a80 0x7f7d38161000 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7d280097c0 tx=0x7f7d2801c370 comp rx=0 tx=0).stop 2023-11-20T07:02:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d3efaa640 1 -- 172.21.15.88:0/1391139317 shutdown_connections 2023-11-20T07:02:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d3efaa640 1 --2- 172.21.15.88:0/1391139317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d38065a80 0x7f7d38161000 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d3efaa640 1 -- 172.21.15.88:0/1391139317 >> 172.21.15.88:0/1391139317 conn(0x7f7d380b0880 msgr2=0x7f7d380b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d3efaa640 1 -- 172.21.15.88:0/1391139317 shutdown_connections 2023-11-20T07:02:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d3efaa640 1 -- 172.21.15.88:0/1391139317 wait complete. 2023-11-20T07:02:25.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d3efaa640 1 Processor -- start 2023-11-20T07:02:25.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.241+0000 7f7d3efaa640 1 -- start start 2023-11-20T07:02:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d3efaa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d38065a80 0x7f7d38152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d3efaa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d3815cb30 0x7f7d38152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d3efaa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d3815cf10 0x7f7d380b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d3efaa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380b4710 con 0x7f7d3815cb30 2023-11-20T07:02:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d3efaa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380b2ba0 con 0x7f7d3815cf10 2023-11-20T07:02:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d3efaa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380c8170 con 0x7f7d38065a80 2023-11-20T07:02:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d2ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d3815cb30 0x7f7d38152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d2ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d3815cb30 0x7f7d38152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47908/0 (socket says 172.21.15.88:47908) 2023-11-20T07:02:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d2ffff640 1 -- 172.21.15.88:0/2709026901 learned_addr learned my addr 172.21.15.88:0/2709026901 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d2ffff640 1 -- 172.21.15.88:0/2709026901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d38065a80 msgr2=0x7f7d38152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/2709026901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d38065a80 0x7f7d38152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d2ffff640 1 -- 172.21.15.88:0/2709026901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d3815cf10 msgr2=0x7f7d380b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/2709026901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d3815cf10 0x7f7d380b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d2ffff640 1 -- 172.21.15.88:0/2709026901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28009420 con 0x7f7d3815cb30 2023-11-20T07:02:25.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/2709026901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d3815cb30 0x7f7d38152ff0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7d28019fa0 tx=0x7f7d28019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:25.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d2d7fa640 1 -- 172.21.15.88:0/2709026901 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280b4400 con 0x7f7d3815cb30 2023-11-20T07:02:25.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d2d7fa640 1 -- 172.21.15.88:0/2709026901 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d280b4560 con 0x7f7d3815cb30 2023-11-20T07:02:25.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d3efaa640 1 -- 172.21.15.88:0/2709026901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d380c8ef0 con 0x7f7d3815cb30 2023-11-20T07:02:25.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d2d7fa640 1 -- 172.21.15.88:0/2709026901 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280b48f0 con 0x7f7d3815cb30 2023-11-20T07:02:25.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.245+0000 7f7d3efaa640 1 -- 172.21.15.88:0/2709026901 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d380c86f0 con 0x7f7d3815cb30 2023-11-20T07:02:25.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d2d7fa640 1 -- 172.21.15.88:0/2709026901 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7d280b2040 con 0x7f7d3815cb30 2023-11-20T07:02:25.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d2d7fa640 1 --2- 172.21.15.88:0/2709026901 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7d240664a0 0x7f7d24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d2d7fa640 1 -- 172.21.15.88:0/2709026901 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7d2811dbb0 con 0x7f7d3815cb30 2023-11-20T07:02:25.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d3cd46640 1 --2- 172.21.15.88:0/2709026901 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7d240664a0 0x7f7d24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d4232f000 1 Processor -- start 2023-11-20T07:02:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d4232f000 1 -- start start 2023-11-20T07:02:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d3cd46640 1 --2- 172.21.15.88:0/2709026901 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7d240664a0 0x7f7d24068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7d340011f0 tx=0x7f7d34001a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d4232f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae971840 0x55b9ae971c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d4232f000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae972160 0x55b9ae9276b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d4232f000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae927bf0 0x55b9ae927fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d4232f000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ae71ccc0 con 0x55b9ae927bf0 2023-11-20T07:02:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d4232f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ae77f8e0 con 0x55b9ae971840 2023-11-20T07:02:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d4232f000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9ae77ce10 con 0x55b9ae972160 2023-11-20T07:02:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d3d547640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae927bf0 0x55b9ae927fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d3d547640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae927bf0 0x55b9ae927fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47918/0 (socket says 172.21.15.88:47918) 2023-11-20T07:02:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d3d547640 1 -- 172.21.15.88:0/3929126924 learned_addr learned my addr 172.21.15.88:0/3929126924 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d3d547640 1 -- 172.21.15.88:0/3929126924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae972160 msgr2=0x55b9ae9276b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:25.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d3d547640 1 --2- 172.21.15.88:0/3929126924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae972160 0x55b9ae9276b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d3d547640 1 -- 172.21.15.88:0/3929126924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae971840 msgr2=0x55b9ae971c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:25.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d3d547640 1 --2- 172.21.15.88:0/3929126924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae971840 0x55b9ae971c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d3d547640 1 -- 172.21.15.88:0/3929126924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9ae471890 con 0x55b9ae927bf0 2023-11-20T07:02:25.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d3d547640 1 --2- 172.21.15.88:0/3929126924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae927bf0 0x55b9ae927fd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7d30001bc0 tx=0x7f7d30002080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6244385d52fd60 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:25.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d1e7fc640 1 -- 172.21.15.88:0/3929126924 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30006d60 con 0x55b9ae927bf0 2023-11-20T07:02:25.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d1e7fc640 1 -- 172.21.15.88:0/3929126924 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3000c990 con 0x55b9ae927bf0 2023-11-20T07:02:25.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.249+0000 7f7d1e7fc640 1 -- 172.21.15.88:0/3929126924 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000cd80 con 0x55b9ae927bf0 2023-11-20T07:02:25.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 -- 172.21.15.88:0/3929126924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae927bf0 msgr2=0x55b9ae927fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 --2- 172.21.15.88:0/3929126924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae927bf0 0x55b9ae927fd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7d30001bc0 tx=0x7f7d30002080 comp rx=0 tx=0).stop 2023-11-20T07:02:25.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 -- 172.21.15.88:0/3929126924 shutdown_connections 2023-11-20T07:02:25.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 --2- 172.21.15.88:0/3929126924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae972160 0x55b9ae9276b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 --2- 172.21.15.88:0/3929126924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae927bf0 0x55b9ae927fd0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 --2- 172.21.15.88:0/3929126924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae971840 0x55b9ae971c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 -- 172.21.15.88:0/3929126924 >> 172.21.15.88:0/3929126924 conn(0x55b9ae91ef60 msgr2=0x55b9ae925f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:25.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 -- 172.21.15.88:0/3929126924 shutdown_connections 2023-11-20T07:02:25.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 -- 172.21.15.88:0/3929126924 wait complete. 2023-11-20T07:02:25.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 -- start start 2023-11-20T07:02:25.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 Processor -- start 2023-11-20T07:02:25.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae927bf0 0x55b9ae971290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae971840 0x55b9ae92cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae972160 0x55b9ae92d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ae778700 con 0x55b9ae971840 2023-11-20T07:02:25.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ae737d10 con 0x55b9ae972160 2023-11-20T07:02:25.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9ae7379b0 con 0x55b9ae927bf0 2023-11-20T07:02:25.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 10 client.0 _ll_register_callbacks cb 0x55b9ae913330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-20T07:02:25.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d2ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae971840 0x55b9ae92cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d2ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae971840 0x55b9ae92cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47932/0 (socket says 172.21.15.88:47932) 2023-11-20T07:02:25.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d2ffff640 1 -- 172.21.15.88:0/2335139076 learned_addr learned my addr 172.21.15.88:0/2335139076 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:25.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d3cd46640 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae927bf0 0x55b9ae971290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d3d547640 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae972160 0x55b9ae92d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d2ffff640 1 -- 172.21.15.88:0/2335139076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae927bf0 msgr2=0x55b9ae971290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:25.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae927bf0 0x55b9ae971290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d2ffff640 1 -- 172.21.15.88:0/2335139076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae972160 msgr2=0x55b9ae92d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:25.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae972160 0x55b9ae92d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d2ffff640 1 -- 172.21.15.88:0/2335139076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3806b180 con 0x55b9ae971840 2023-11-20T07:02:25.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d2ffff640 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae971840 0x55b9ae92cd00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7d2801c8e0 tx=0x7f7d280ef2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a0281f96d5756d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:25.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d177fe640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-11-20T07:02:25.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d177fe640 1 -- 172.21.15.88:0/2335139076 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d281063b0 con 0x55b9ae971840 2023-11-20T07:02:25.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d177fe640 1 -- 172.21.15.88:0/2335139076 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7d280efe40 con 0x55b9ae971840 2023-11-20T07:02:25.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 -- 172.21.15.88:0/2335139076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9ae72c370 con 0x55b9ae971840 2023-11-20T07:02:25.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d177fe640 1 -- 172.21.15.88:0/2335139076 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d280f6e10 con 0x55b9ae971840 2023-11-20T07:02:25.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 10 client.5646 fetch_fsmap learned FSMap version 18 2023-11-20T07:02:25.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 -- 172.21.15.88:0/2335139076 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55b9ae73a460 con 0x55b9ae971840 2023-11-20T07:02:25.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d177fe640 1 -- 172.21.15.88:0/2335139076 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b9ae72c370 con 0x55b9ae971840 2023-11-20T07:02:25.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d177fe640 1 -- 172.21.15.88:0/2335139076 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7d280ee000 con 0x55b9ae971840 2023-11-20T07:02:25.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 10 client.5646 fetch_fsmap finished waiting for FSMap version 18 2023-11-20T07:02:25.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 10 client.5646 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-20T07:02:25.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 20 client.5646 populate_metadata read hostname 'smithi088' 2023-11-20T07:02:25.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.88:6833/2477383155,v1:172.21.15.88:6835/2477383155] conn(0x55b9ae9340b0 0x55b9ae983b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 4 client.5646 mds_command: new command op to 5472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-20T07:02:25.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.253+0000 7f7d4232f000 1 -- 172.21.15.88:0/2335139076 --> [v2:172.21.15.88:6833/2477383155,v1:172.21.15.88:6835/2477383155] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9ae7122d0 con 0x55b9ae9340b0 2023-11-20T07:02:25.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d3cd46640 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.88:6833/2477383155,v1:172.21.15.88:6835/2477383155] conn(0x55b9ae9340b0 0x55b9ae983b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d3cd46640 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.88:6833/2477383155,v1:172.21.15.88:6835/2477383155] conn(0x55b9ae9340b0 0x55b9ae983b00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af07ea71a5449a09 server_cookie=65fbfdaaeda78549 in_seq=0 out_seq=0 2023-11-20T07:02:25.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d177fe640 10 client.5646 ms_handle_connect on v2:172.21.15.88:6833/2477383155 2023-11-20T07:02:25.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d177fe640 1 -- 172.21.15.88:0/2335139076 <== mds.0 v2:172.21.15.88:6833/2477383155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b9ae7122d0 con 0x55b9ae9340b0 2023-11-20T07:02:25.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d177fe640 10 client.5646 handle_command_reply: tid=0 2023-11-20T07:02:25.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d4232f000 1 client.5646 shutdown 2023-11-20T07:02:25.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d4232f000 1 -- 172.21.15.88:0/2335139076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae971840 msgr2=0x55b9ae92cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d4232f000 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae971840 0x55b9ae92cd00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7d2801c8e0 tx=0x7f7d280ef2d0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d4232f000 1 -- 172.21.15.88:0/2335139076 shutdown_connections 2023-11-20T07:02:25.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d4232f000 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.88:6833/2477383155,v1:172.21.15.88:6835/2477383155] conn(0x55b9ae9340b0 0x55b9ae983b00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d4232f000 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae972160 0x55b9ae92d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d4232f000 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae971840 0x55b9ae92cd00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d177fe640 0 client.5646 ms_handle_reset on v2:172.21.15.88:6833/2477383155 2023-11-20T07:02:25.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d4232f000 1 --2- 172.21.15.88:0/2335139076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae927bf0 0x55b9ae971290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d4232f000 1 -- 172.21.15.88:0/2335139076 >> 172.21.15.88:0/2335139076 conn(0x55b9ae91ef60 msgr2=0x55b9ae926690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:25.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d4232f000 1 -- 172.21.15.88:0/2335139076 shutdown_connections 2023-11-20T07:02:25.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d4232f000 1 -- 172.21.15.88:0/2335139076 wait complete. 2023-11-20T07:02:25.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.257+0000 7f7d4232f000 20 client.5646 trim_cache size 0 max 16384 2023-11-20T07:02:25.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 Processor -- start 2023-11-20T07:02:25.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 -- start start 2023-11-20T07:02:25.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae927bf0 0x55b9ae984b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae971840 0x55b9ae985050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 0x55b9ae96c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ae432940 con 0x55b9ae972160 2023-11-20T07:02:25.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ae77d870 con 0x55b9ae971840 2023-11-20T07:02:25.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9ae92b260 con 0x55b9ae927bf0 2023-11-20T07:02:25.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d3d547640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 0x55b9ae96c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d3d547640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 0x55b9ae96c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47934/0 (socket says 172.21.15.88:47934) 2023-11-20T07:02:25.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d3d547640 1 -- 172.21.15.88:0/1292688371 learned_addr learned my addr 172.21.15.88:0/1292688371 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:25.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d3d547640 1 -- 172.21.15.88:0/1292688371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae927bf0 msgr2=0x55b9ae984b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:25.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d3d547640 1 --2- 172.21.15.88:0/1292688371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae927bf0 0x55b9ae984b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d3d547640 1 -- 172.21.15.88:0/1292688371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae971840 msgr2=0x55b9ae985050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:25.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d3d547640 1 --2- 172.21.15.88:0/1292688371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae971840 0x55b9ae985050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d3d547640 1 -- 172.21.15.88:0/1292688371 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9ae720760 con 0x55b9ae972160 2023-11-20T07:02:25.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d3d547640 1 --2- 172.21.15.88:0/1292688371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 0x55b9ae96c650 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7d300020c0 tx=0x7f7d30009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63056a5864fd7340 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:25.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d1effd640 1 -- 172.21.15.88:0/1292688371 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30003980 con 0x55b9ae972160 2023-11-20T07:02:25.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d1effd640 1 -- 172.21.15.88:0/1292688371 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3000b070 con 0x55b9ae972160 2023-11-20T07:02:25.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d1effd640 1 -- 172.21.15.88:0/1292688371 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30003d20 con 0x55b9ae972160 2023-11-20T07:02:25.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 -- 172.21.15.88:0/1292688371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 msgr2=0x55b9ae96c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 --2- 172.21.15.88:0/1292688371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 0x55b9ae96c650 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7d300020c0 tx=0x7f7d30009030 comp rx=0 tx=0).stop 2023-11-20T07:02:25.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 -- 172.21.15.88:0/1292688371 shutdown_connections 2023-11-20T07:02:25.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 --2- 172.21.15.88:0/1292688371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 0x55b9ae96c650 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 --2- 172.21.15.88:0/1292688371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae971840 0x55b9ae985050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 --2- 172.21.15.88:0/1292688371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae927bf0 0x55b9ae984b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 -- 172.21.15.88:0/1292688371 >> 172.21.15.88:0/1292688371 conn(0x55b9ae91ef60 msgr2=0x55b9ae97ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:25.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 -- 172.21.15.88:0/1292688371 shutdown_connections 2023-11-20T07:02:25.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 -- 172.21.15.88:0/1292688371 wait complete. 2023-11-20T07:02:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.273+0000 7f7d4232f000 1 -- start start 2023-11-20T07:02:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 1 Processor -- start 2023-11-20T07:02:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae927bf0 0x55b9ae96f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae971840 0x55b9ae98cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 0x55b9ae98d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ae7b9b40 con 0x55b9ae972160 2023-11-20T07:02:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9ae7266c0 con 0x55b9ae927bf0 2023-11-20T07:02:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9ae775b00 con 0x55b9ae971840 2023-11-20T07:02:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 10 client.0 _ll_register_callbacks cb 0x7f7d300015c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-20T07:02:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d3d547640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 0x55b9ae98d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d2ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae971840 0x55b9ae98cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d3d547640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 0x55b9ae98d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47944/0 (socket says 172.21.15.88:47944) 2023-11-20T07:02:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d3d547640 1 -- 172.21.15.88:0/3245222369 learned_addr learned my addr 172.21.15.88:0/3245222369 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d3cd46640 1 --2- 172.21.15.88:0/3245222369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae927bf0 0x55b9ae96f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d3d547640 1 -- 172.21.15.88:0/3245222369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae971840 msgr2=0x55b9ae98cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d3d547640 1 --2- 172.21.15.88:0/3245222369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae971840 0x55b9ae98cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d3d547640 1 -- 172.21.15.88:0/3245222369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae927bf0 msgr2=0x55b9ae96f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d3d547640 1 --2- 172.21.15.88:0/3245222369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae927bf0 0x55b9ae96f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d3d547640 1 -- 172.21.15.88:0/3245222369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b9ae471890 con 0x55b9ae972160 2023-11-20T07:02:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d3d547640 1 --2- 172.21.15.88:0/3245222369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 0x55b9ae98d400 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7d30001b40 tx=0x7f7d30001520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3299a4773f93683f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:25.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d177fe640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-11-20T07:02:25.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d177fe640 1 -- 172.21.15.88:0/3245222369 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30004ee0 con 0x55b9ae972160 2023-11-20T07:02:25.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 1 -- 172.21.15.88:0/3245222369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9ae7106f0 con 0x55b9ae972160 2023-11-20T07:02:25.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d177fe640 1 -- 172.21.15.88:0/3245222369 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7d3000cb90 con 0x55b9ae972160 2023-11-20T07:02:25.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d177fe640 1 -- 172.21.15.88:0/3245222369 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d3000cd90 con 0x55b9ae972160 2023-11-20T07:02:25.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 10 client.5652 fetch_fsmap learned FSMap version 18 2023-11-20T07:02:25.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 1 -- 172.21.15.88:0/3245222369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55b9ae471cc0 con 0x55b9ae972160 2023-11-20T07:02:25.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d177fe640 1 -- 172.21.15.88:0/3245222369 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b9ae7106f0 con 0x55b9ae972160 2023-11-20T07:02:25.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d177fe640 1 -- 172.21.15.88:0/3245222369 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7d300050b0 con 0x55b9ae972160 2023-11-20T07:02:25.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 10 client.5652 fetch_fsmap finished waiting for FSMap version 18 2023-11-20T07:02:25.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 10 client.5652 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-20T07:02:25.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 20 client.5652 populate_metadata read hostname 'smithi088' 2023-11-20T07:02:25.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 1 --2- 172.21.15.88:0/3245222369 >> [v2:172.21.15.88:6833/2477383155,v1:172.21.15.88:6835/2477383155] conn(0x55b9ae9d0440 0x55b9ae9d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 4 client.5652 mds_command: new command op to 5472 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-20T07:02:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d4232f000 1 -- 172.21.15.88:0/3245222369 --> [v2:172.21.15.88:6833/2477383155,v1:172.21.15.88:6835/2477383155] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b9ae7716e0 con 0x55b9ae9d0440 2023-11-20T07:02:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.277+0000 7f7d3cd46640 1 --2- 172.21.15.88:0/3245222369 >> [v2:172.21.15.88:6833/2477383155,v1:172.21.15.88:6835/2477383155] conn(0x55b9ae9d0440 0x55b9ae9d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3cd46640 1 --2- 172.21.15.88:0/3245222369 >> [v2:172.21.15.88:6833/2477383155,v1:172.21.15.88:6835/2477383155] conn(0x55b9ae9d0440 0x55b9ae9d0820 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc06c56910fd7f2e server_cookie=7520704cf4d99da5 in_seq=0 out_seq=0 2023-11-20T07:02:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d177fe640 10 client.5652 ms_handle_connect on v2:172.21.15.88:6833/2477383155 2023-11-20T07:02:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d177fe640 1 -- 172.21.15.88:0/3245222369 <== mds.0 v2:172.21.15.88:6833/2477383155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b9ae7716e0 con 0x55b9ae9d0440 2023-11-20T07:02:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d177fe640 10 client.5652 handle_command_reply: tid=0 2023-11-20T07:02:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d4232f000 1 client.5652 shutdown 2023-11-20T07:02:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d4232f000 1 -- 172.21.15.88:0/3245222369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 msgr2=0x55b9ae98d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d4232f000 1 --2- 172.21.15.88:0/3245222369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 0x55b9ae98d400 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7d30001b40 tx=0x7f7d30001520 comp rx=0 tx=0).stop 2023-11-20T07:02:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d4232f000 1 -- 172.21.15.88:0/3245222369 shutdown_connections 2023-11-20T07:02:25.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d4232f000 1 --2- 172.21.15.88:0/3245222369 >> [v2:172.21.15.88:6833/2477383155,v1:172.21.15.88:6835/2477383155] conn(0x55b9ae9d0440 0x55b9ae9d0820 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d4232f000 1 --2- 172.21.15.88:0/3245222369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55b9ae971840 0x55b9ae98cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d4232f000 1 --2- 172.21.15.88:0/3245222369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55b9ae972160 0x55b9ae98d400 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d177fe640 0 client.5652 ms_handle_reset on v2:172.21.15.88:6833/2477383155 2023-11-20T07:02:25.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d4232f000 1 --2- 172.21.15.88:0/3245222369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b9ae927bf0 0x55b9ae96f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d4232f000 1 -- 172.21.15.88:0/3245222369 >> 172.21.15.88:0/3245222369 conn(0x55b9ae91ef60 msgr2=0x55b9ae983b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:25.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d4232f000 1 -- 172.21.15.88:0/3245222369 shutdown_connections 2023-11-20T07:02:25.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d4232f000 1 -- 172.21.15.88:0/3245222369 wait complete. 2023-11-20T07:02:25.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d4232f000 20 client.5652 trim_cache size 0 max 16384 2023-11-20T07:02:25.288 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:02:25.289 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "81254148-3aea-4f86-927e-f8c4e1bfa591", 2023-11-20T07:02:25.289 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-11-20T07:02:25.289 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 5472, 2023-11-20T07:02:25.289 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-11-20T07:02:25.289 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-11-20T07:02:25.289 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-11-20T07:02:25.289 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 5.9408823640000001, 2023-11-20T07:02:25.289 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 18, 2023-11-20T07:02:25.289 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 38, 2023-11-20T07:02:25.289 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 38, 2023-11-20T07:02:25.289 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 13.093575447999999 2023-11-20T07:02:25.289 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:02:25.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3efaa640 1 -- 172.21.15.88:0/2709026901 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7d240664a0 msgr2=0x7f7d24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3efaa640 1 --2- 172.21.15.88:0/2709026901 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7d240664a0 0x7f7d24068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7d340011f0 tx=0x7f7d34001a10 comp rx=0 tx=0).stop 2023-11-20T07:02:25.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3efaa640 1 -- 172.21.15.88:0/2709026901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d3815cb30 msgr2=0x7f7d38152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3efaa640 1 --2- 172.21.15.88:0/2709026901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d3815cb30 0x7f7d38152ff0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7d28019fa0 tx=0x7f7d28019110 comp rx=0 tx=0).stop 2023-11-20T07:02:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3efaa640 1 -- 172.21.15.88:0/2709026901 shutdown_connections 2023-11-20T07:02:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3efaa640 1 --2- 172.21.15.88:0/2709026901 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f7d240664a0 0x7f7d24068960 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3efaa640 1 --2- 172.21.15.88:0/2709026901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d3815cf10 0x7f7d380b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3efaa640 1 --2- 172.21.15.88:0/2709026901 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d3815cb30 0x7f7d38152ff0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3efaa640 1 --2- 172.21.15.88:0/2709026901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d38065a80 0x7f7d38152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3efaa640 1 -- 172.21.15.88:0/2709026901 >> 172.21.15.88:0/2709026901 conn(0x7f7d380b0880 msgr2=0x7f7d381567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3efaa640 1 -- 172.21.15.88:0/2709026901 shutdown_connections 2023-11-20T07:02:25.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.281+0000 7f7d3efaa640 1 -- 172.21.15.88:0/2709026901 wait complete. 2023-11-20T07:02:25.300 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-20T07:02:25.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.437+0000 7f6d89668640 1 Processor -- start 2023-11-20T07:02:25.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.437+0000 7f6d89668640 1 -- start start 2023-11-20T07:02:25.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.437+0000 7f6d89668640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8415cb90 0x7f6d840cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.437+0000 7f6d89668640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6d840d15d0 0x7f6d840c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.437+0000 7f6d89668640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d840ce770 con 0x7f6d840d3010 2023-11-20T07:02:25.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.437+0000 7f6d89668640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d840d0600 con 0x7f6d840d15d0 2023-11-20T07:02:25.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.437+0000 7f6d89668640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840c6450 con 0x7f6d8415cb90 2023-11-20T07:02:25.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.437+0000 7f6d7a7fc640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6d840d3010 0x7f6d840d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:56948/0 (socket says 172.21.15.88:56948) 2023-11-20T07:02:25.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.437+0000 7f6d82ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8415cb90 0x7f6d840cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.437+0000 7f6d7a7fc640 1 -- 172.21.15.88:0/1035106822 learned_addr learned my addr 172.21.15.88:0/1035106822 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:25.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.437+0000 7f6d837fe640 1 --2- 172.21.15.88:0/1035106822 >> v2:172.21.15.175:3300/0 conn(0x7f6d840d15d0 0x7f6d840c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.441+0000 7f6d827fc640 1 -- 172.21.15.88:0/1035106822 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812830571 0 0) 0x7f6d840ce770 con 0x7f6d840d3010 2023-11-20T07:02:25.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.441+0000 7f6d827fc640 1 -- 172.21.15.88:0/1035106822 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d70003530 con 0x7f6d840d3010 2023-11-20T07:02:25.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.441+0000 7f6d82ffd640 1 -- 172.21.15.88:0/1035106822 >> v2:172.21.15.175:3300/0 conn(0x7f6d840d15d0 msgr2=0x7f6d840c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:25.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.441+0000 7f6d82ffd640 1 --2- 172.21.15.88:0/1035106822 >> v2:172.21.15.175:3300/0 conn(0x7f6d840d15d0 0x7f6d840c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.441+0000 7f6d82ffd640 1 -- 172.21.15.88:0/1035106822 >> v1:172.21.15.175:6789/0 conn(0x7f6d840d3010 legacy=0x7f6d840d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.441+0000 7f6d82ffd640 1 -- 172.21.15.88:0/1035106822 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d840d08a0 con 0x7f6d8415cb90 2023-11-20T07:02:25.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.441+0000 7f6d837fe640 1 --2- 172.21.15.88:0/1035106822 >> v2:172.21.15.175:3300/0 conn(0x7f6d840d15d0 0x7f6d840c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:25.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.441+0000 7f6d82ffd640 1 --2- 172.21.15.88:0/1035106822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8415cb90 0x7f6d840cfb10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0097a0 tx=0x7f6d6c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1d00b4d5befb714 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:25.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.441+0000 7f6d827fc640 1 -- 172.21.15.88:0/1035106822 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0ac600 con 0x7f6d8415cb90 2023-11-20T07:02:25.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.441+0000 7f6d827fc640 1 -- 172.21.15.88:0/1035106822 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c0a8050 con 0x7f6d8415cb90 2023-11-20T07:02:25.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.441+0000 7f6d827fc640 1 -- 172.21.15.88:0/1035106822 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0ac980 con 0x7f6d8415cb90 2023-11-20T07:02:25.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 -- 172.21.15.88:0/1035106822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8415cb90 msgr2=0x7f6d840cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 --2- 172.21.15.88:0/1035106822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8415cb90 0x7f6d840cfb10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c0097a0 tx=0x7f6d6c01c3a0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 -- 172.21.15.88:0/1035106822 shutdown_connections 2023-11-20T07:02:25.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 --2- 172.21.15.88:0/1035106822 >> v2:172.21.15.175:3300/0 conn(0x7f6d840d15d0 0x7f6d840c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 --2- 172.21.15.88:0/1035106822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8415cb90 0x7f6d840cfb10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 -- 172.21.15.88:0/1035106822 >> 172.21.15.88:0/1035106822 conn(0x7f6d8409bc50 msgr2=0x7f6d840d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:25.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 -- 172.21.15.88:0/1035106822 shutdown_connections 2023-11-20T07:02:25.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 -- 172.21.15.88:0/1035106822 wait complete. 2023-11-20T07:02:25.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 Processor -- start 2023-11-20T07:02:25.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 -- start start 2023-11-20T07:02:25.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d840d15d0 0x7f6d841f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d840d3010 0x7f6d84158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8415cb90 0x7f6d840b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840b5fe0 con 0x7f6d840d15d0 2023-11-20T07:02:25.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840b62c0 con 0x7f6d840d3010 2023-11-20T07:02:25.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d89668640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d841f7bb0 con 0x7f6d8415cb90 2023-11-20T07:02:25.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d82ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d840d15d0 0x7f6d841f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d82ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d840d15d0 0x7f6d841f8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47946/0 (socket says 172.21.15.88:47946) 2023-11-20T07:02:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d82ffd640 1 -- 172.21.15.88:0/927559112 learned_addr learned my addr 172.21.15.88:0/927559112 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d7a7fc640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d840d3010 0x7f6d84158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.445+0000 7f6d837fe640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8415cb90 0x7f6d840b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d82ffd640 1 -- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8415cb90 msgr2=0x7f6d840b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d82ffd640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8415cb90 0x7f6d840b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d82ffd640 1 -- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d840d3010 msgr2=0x7f6d84158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d82ffd640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d840d3010 0x7f6d84158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d82ffd640 1 -- 172.21.15.88:0/927559112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c009a70 con 0x7f6d840d15d0 2023-11-20T07:02:25.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d82ffd640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d840d15d0 0x7f6d841f8690 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c019fd0 tx=0x7f6d6c01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:25.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d7bfff640 1 -- 172.21.15.88:0/927559112 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c006dc0 con 0x7f6d840d15d0 2023-11-20T07:02:25.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d7bfff640 1 -- 172.21.15.88:0/927559112 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c0b7420 con 0x7f6d840d15d0 2023-11-20T07:02:25.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d7bfff640 1 -- 172.21.15.88:0/927559112 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0b77b0 con 0x7f6d840d15d0 2023-11-20T07:02:25.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d89668640 1 -- 172.21.15.88:0/927559112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c0093b0 con 0x7f6d840d15d0 2023-11-20T07:02:25.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d89668640 1 -- 172.21.15.88:0/927559112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d841f8170 con 0x7f6d840d15d0 2023-11-20T07:02:25.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d89668640 1 -- 172.21.15.88:0/927559112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d84074010 con 0x7f6d840d15d0 2023-11-20T07:02:25.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d7bfff640 1 -- 172.21.15.88:0/927559112 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6d6c0b3040 con 0x7f6d840d15d0 2023-11-20T07:02:25.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d7bfff640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6d640664a0 0x7f6d64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:25.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d7bfff640 1 -- 172.21.15.88:0/927559112 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6d6c11e140 con 0x7f6d840d15d0 2023-11-20T07:02:25.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.449+0000 7f6d7a7fc640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6d640664a0 0x7f6d64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:25.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.453+0000 7f6d7a7fc640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6d640664a0 0x7f6d64068960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6d840c99f0 tx=0x7f6d74007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:25.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.453+0000 7f6d7bfff640 1 -- 172.21.15.88:0/927559112 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6d6c0eb5c0 con 0x7f6d840d15d0 2023-11-20T07:02:25.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.637+0000 7f6d89668640 1 -- 172.21.15.88:0/927559112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6d8406a050 con 0x7f6d840d15d0 2023-11-20T07:02:25.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.637+0000 7f6d7bfff640 1 -- 172.21.15.88:0/927559112 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6d6c0eebe0 con 0x7f6d840d15d0 2023-11-20T07:02:25.638 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-20T07:02:25.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.637+0000 7f6d89668640 1 -- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6d640664a0 msgr2=0x7f6d64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.637+0000 7f6d89668640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6d640664a0 0x7f6d64068960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6d840c99f0 tx=0x7f6d74007d40 comp rx=0 tx=0).stop 2023-11-20T07:02:25.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.637+0000 7f6d89668640 1 -- 172.21.15.88:0/927559112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d840d15d0 msgr2=0x7f6d841f8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:25.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.637+0000 7f6d89668640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d840d15d0 0x7f6d841f8690 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c019fd0 tx=0x7f6d6c01abe0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.637+0000 7f6d89668640 1 -- 172.21.15.88:0/927559112 shutdown_connections 2023-11-20T07:02:25.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.637+0000 7f6d89668640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6d640664a0 0x7f6d64068960 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.637+0000 7f6d89668640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d8415cb90 0x7f6d840b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.637+0000 7f6d89668640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d840d3010 0x7f6d84158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.637+0000 7f6d89668640 1 --2- 172.21.15.88:0/927559112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d840d15d0 0x7f6d841f8690 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:25.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.637+0000 7f6d89668640 1 -- 172.21.15.88:0/927559112 >> 172.21.15.88:0/927559112 conn(0x7f6d8409bc50 msgr2=0x7f6d840d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:25.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.641+0000 7f6d89668640 1 -- 172.21.15.88:0/927559112 shutdown_connections 2023-11-20T07:02:25.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:25.641+0000 7f6d89668640 1 -- 172.21.15.88:0/927559112 wait complete. 2023-11-20T07:02:25.659 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-20T07:02:25.659 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-20T07:02:25.659 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-11-20T07:02:25.659 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-20T07:02:25.659 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-20T07:02:25.660 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-20T07:02:25.660 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-20T07:02:25.660 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-20T07:02:25.660 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-20T07:02:25.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:25.660 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-11-20T07:02:25.670 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-20T07:02:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-20T07:02:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-11-20T07:02:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:02:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-11-20T07:02:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:02:25.671 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:02:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:02:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-11-20T07:02:25.671 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:02:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:02:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-11-20T07:02:25.672 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-20T07:02:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-11-20T07:02:25.672 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-20T07:02:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-11-20T07:02:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-20T07:02:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42327sec preferred_lft 42327sec 2023-11-20T07:02:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-11-20T07:02:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:02:25.672 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-20T07:02:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:1c:fd:c7:b2 brd ff:ff:ff:ff:ff:ff 2023-11-20T07:02:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-20T07:02:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:02:25.673 INFO:teuthology.orchestra.run.smithi088.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-20T07:02:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-20T07:02:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-20T07:02:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:02:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-20T07:02:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:02:25.673 INFO:teuthology.orchestra.run.smithi088.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-20T07:02:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:02:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-20T07:02:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:02:25.678 INFO:teuthology.orchestra.run.smithi088.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-20T07:02:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T07:02:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-20T07:02:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-11-20T07:02:25.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:25.679 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-20T07:02:25.735 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-11-20T07:02:25.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:25.737 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-11-20T07:02:25.791 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-11-20T07:02:25.791 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-20T07:02:25.791 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-20T07:02:25.791 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-20T07:02:25.791 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-20T07:02:25.791 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-20T07:02:25.791 INFO:teuthology.orchestra.run.smithi088.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:02:25.791 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:02:25.792 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-20T07:02:25.792 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-20T07:02:25.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:25.792 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-11-20T07:02:25.792 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-11-20T07:02:25.792 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-20T07:02:25.792 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-20T07:02:25.792 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-20T07:02:25.792 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-11-20T07:02:25.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:25.882 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-11-20T07:02:25.892 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-20T07:02:25.892 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-20T07:02:25.892 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-20T07:02:25.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:25.893 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-11-20T07:02:25.960 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-20T07:02:25.960 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T07:02:25.960 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-20T07:02:26.012 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-20T07:02:26.012 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-20T07:02:26.012 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-20T07:02:26.063 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-20T07:02:26.128 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:02:26.182 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-20T07:02:26.182 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-20T07:02:26.182 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-20T07:02:26.182 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-20T07:02:26.182 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-20T07:02:26.182 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-20T07:02:26.182 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-20T07:02:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-20T07:02:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2023-11-20T07:02:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-20T07:02:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-20T07:02:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-20T07:02:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:02:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-20T07:02:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-20T07:02:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-20T07:02:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-20T07:02:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2023-11-20T07:02:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-20T07:02:26.184 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-20T07:02:26.184 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:02:26.184 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2023-11-20T07:02:26.184 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-20T07:02:26.184 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-20T07:02:26.184 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T07:02:26.184 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T07:02:26.184 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T07:02:26.184 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T07:02:26.184 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-20T07:02:26.184 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:02:26.184 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:02:26.185 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T07:02:26.185 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T07:02:26.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:26.186 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-20T07:02:26.235 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-20T07:02:26.236 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-20T07:02:26.283 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-11-20T07:02:26.305 DEBUG:teuthology.orchestra.run.smithi088:> cat /proc/self/mounts | awk '{print $2}' 2023-11-20T07:02:26.358 INFO:teuthology.orchestra.run.smithi088.stdout:/sys 2023-11-20T07:02:26.359 INFO:teuthology.orchestra.run.smithi088.stdout:/proc 2023-11-20T07:02:26.359 INFO:teuthology.orchestra.run.smithi088.stdout:/dev 2023-11-20T07:02:26.359 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/pts 2023-11-20T07:02:26.359 INFO:teuthology.orchestra.run.smithi088.stdout:/run 2023-11-20T07:02:26.359 INFO:teuthology.orchestra.run.smithi088.stdout:/ 2023-11-20T07:02:26.360 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/security 2023-11-20T07:02:26.360 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/shm 2023-11-20T07:02:26.360 INFO:teuthology.orchestra.run.smithi088.stdout:/run/lock 2023-11-20T07:02:26.360 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/cgroup 2023-11-20T07:02:26.360 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/pstore 2023-11-20T07:02:26.360 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/bpf 2023-11-20T07:02:26.360 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/sys/fs/binfmt_misc 2023-11-20T07:02:26.361 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/hugepages 2023-11-20T07:02:26.361 INFO:teuthology.orchestra.run.smithi088.stdout:/dev/mqueue 2023-11-20T07:02:26.361 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/debug 2023-11-20T07:02:26.361 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/tracing 2023-11-20T07:02:26.361 INFO:teuthology.orchestra.run.smithi088.stdout:/proc/fs/nfsd 2023-11-20T07:02:26.361 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/fs/fuse/connections 2023-11-20T07:02:26.362 INFO:teuthology.orchestra.run.smithi088.stdout:/sys/kernel/config 2023-11-20T07:02:26.362 INFO:teuthology.orchestra.run.smithi088.stdout:/run/credentials/systemd-sysusers.service 2023-11-20T07:02:26.362 INFO:teuthology.orchestra.run.smithi088.stdout:/run/rpc_pipefs 2023-11-20T07:02:26.362 INFO:teuthology.orchestra.run.smithi088.stdout:/run/user/1000 2023-11-20T07:02:26.362 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph 2023-11-20T07:02:26.363 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-0 2023-11-20T07:02:26.363 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-1 2023-11-20T07:02:26.363 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-2 2023-11-20T07:02:26.363 INFO:teuthology.orchestra.run.smithi088.stdout:/var/lib/ceph/osd/ceph-3 2023-11-20T07:02:26.363 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns 2023-11-20T07:02:26.364 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:02:26.364 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:02:26.364 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T07:02:26.364 INFO:teuthology.orchestra.run.smithi088.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T07:02:26.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:26.365 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-11-20T07:02:26.379 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:2023-11-20T07:02:26.377+0000 7f7346231580 -1 init, newargv = 0x55a2a77a2cc0 newargc=15 2023-11-20T07:02:26.379 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[49709]: starting ceph client 2023-11-20T07:02:26.387 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[49709]: starting fuse 2023-11-20T07:02:26.389 INFO:teuthology.orchestra.run.smithi088.stdout:43 2023-11-20T07:02:26.389 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-20T07:02:26.389 DEBUG:teuthology.orchestra.run.smithi088:> sudo stdin-killer -- python3 -c ' 2023-11-20T07:02:26.390 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2023-11-20T07:02:26.390 DEBUG:teuthology.orchestra.run.smithi088:> import re 2023-11-20T07:02:26.390 DEBUG:teuthology.orchestra.run.smithi088:> import os 2023-11-20T07:02:26.390 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2023-11-20T07:02:26.390 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:02:26.390 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2023-11-20T07:02:26.391 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-20T07:02:26.391 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2023-11-20T07:02:26.391 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-20T07:02:26.391 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:02:26.391 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2023-11-20T07:02:26.391 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2023-11-20T07:02:26.391 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2023-11-20T07:02:26.391 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2023-11-20T07:02:26.392 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:02:26.392 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2023-11-20T07:02:26.392 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-20T07:02:26.392 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-20T07:02:26.392 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-20T07:02:26.392 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2023-11-20T07:02:26.393 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2023-11-20T07:02:26.393 DEBUG:teuthology.orchestra.run.smithi088:> return f 2023-11-20T07:02:26.393 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-20T07:02:26.393 DEBUG:teuthology.orchestra.run.smithi088:> 2023-11-20T07:02:26.393 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.0")) 2023-11-20T07:02:26.393 DEBUG:teuthology.orchestra.run.smithi088:> ' 2023-11-20T07:02:26.512 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.0.49709.asok 2023-11-20T07:02:26.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-20T07:02:26.523 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49709.asok 2023-11-20T07:02:26.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:26.523 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49709.asok status 2023-11-20T07:02:26.691 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:02:26.692 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2023-11-20T07:02:26.692 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-20T07:02:26.692 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-20T07:02:26.692 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "0", 2023-11-20T07:02:26.692 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2023-11-20T07:02:26.692 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-20T07:02:26.692 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "49709", 2023-11-20T07:02:26.692 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2023-11-20T07:02:26.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:26.692 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2023-11-20T07:02:26.692 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2023-11-20T07:02:26.692 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 5661, 2023-11-20T07:02:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2023-11-20T07:02:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2023-11-20T07:02:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2023-11-20T07:02:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5661 2023-11-20T07:02:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-11-20T07:02:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-11-20T07:02:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-11-20T07:02:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 1312830859 2023-11-20T07:02:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-11-20T07:02:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:26.693 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-11-20T07:02:26.694 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-11-20T07:02:26.694 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-11-20T07:02:26.694 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 1312830859 2023-11-20T07:02:26.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-11-20T07:02:26.694 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.5661 192.168.0.1:0/1312830859", 2023-11-20T07:02:26.694 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "192.168.0.1:0/1312830859", 2023-11-20T07:02:26.694 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2023-11-20T07:02:26.694 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 18, 2023-11-20T07:02:26.694 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 38, 2023-11-20T07:02:26.694 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2023-11-20T07:02:26.694 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2023-11-20T07:02:26.695 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2023-11-20T07:02:26.695 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:02:26.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:26.707 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2023-11-20T07:02:26.707 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-20T07:02:26.716 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2023-11-20T07:02:26.716 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-20T07:02:26.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:26.717 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-20T07:02:26.784 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-20T07:02:26.784 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-20T07:02:26.918 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-20T07:02:27.009 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-20T07:02:27.010 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:02:27.010 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:02:27.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:27.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.197+0000 7efe6f068640 1 Processor -- start 2023-11-20T07:02:27.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6f068640 1 -- start start 2023-11-20T07:02:27.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6f068640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe680b2ad0 0x7efe6806b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6f068640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efe680ce310 0x7efe680ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6f068640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6806d000 con 0x7efe6815cf90 2023-11-20T07:02:27.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6f068640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe680cece0 con 0x7efe680ce310 2023-11-20T07:02:27.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6f068640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe68160580 con 0x7efe680b2ad0 2023-11-20T07:02:27.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6d605640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efe680ce310 0x7efe680ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6d605640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efe680ce310 0x7efe680ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:56714/0 (socket says 172.21.15.88:56714) 2023-11-20T07:02:27.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe5ffff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7efe6815cf90 0x7efe6806c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:60570/0 (socket says 172.21.15.88:60570) 2023-11-20T07:02:27.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6d605640 1 -- 172.21.15.88:0/3570812776 learned_addr learned my addr 172.21.15.88:0/3570812776 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:27.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6ce04640 1 --2- 172.21.15.88:0/3570812776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe680b2ad0 0x7efe6806b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6d605640 1 -- 172.21.15.88:0/3570812776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe680b2ad0 msgr2=0x7efe6806b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:27.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6d605640 1 --2- 172.21.15.88:0/3570812776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe680b2ad0 0x7efe6806b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6d605640 1 -- 172.21.15.88:0/3570812776 >> v1:172.21.15.175:6789/0 conn(0x7efe6815cf90 legacy=0x7efe6806c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.201+0000 7efe6d605640 1 -- 172.21.15.88:0/3570812776 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6815d4e0 con 0x7efe680ce310 2023-11-20T07:02:27.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe6d605640 1 --2- 172.21.15.88:0/3570812776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680ce310 0x7efe680ce7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efe60009e50 tx=0x7efe6001c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=836637afca0d398e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:27.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe5f7fe640 1 -- 172.21.15.88:0/3570812776 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe600a58a0 con 0x7efe680ce310 2023-11-20T07:02:27.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe5f7fe640 1 -- 172.21.15.88:0/3570812776 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe600a5a00 con 0x7efe680ce310 2023-11-20T07:02:27.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe5f7fe640 1 -- 172.21.15.88:0/3570812776 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe600a5d90 con 0x7efe680ce310 2023-11-20T07:02:27.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe6f068640 1 -- 172.21.15.88:0/3570812776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680ce310 msgr2=0x7efe680ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe6f068640 1 --2- 172.21.15.88:0/3570812776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680ce310 0x7efe680ce7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efe60009e50 tx=0x7efe6001c9e0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe6f068640 1 -- 172.21.15.88:0/3570812776 shutdown_connections 2023-11-20T07:02:27.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe6f068640 1 --2- 172.21.15.88:0/3570812776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680ce310 0x7efe680ce7a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe6f068640 1 --2- 172.21.15.88:0/3570812776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe680b2ad0 0x7efe6806b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe6f068640 1 -- 172.21.15.88:0/3570812776 >> 172.21.15.88:0/3570812776 conn(0x7efe680cd1c0 msgr2=0x7efe680cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:27.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe6f068640 1 -- 172.21.15.88:0/3570812776 shutdown_connections 2023-11-20T07:02:27.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe6f068640 1 -- 172.21.15.88:0/3570812776 wait complete. 2023-11-20T07:02:27.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.205+0000 7efe6f068640 1 Processor -- start 2023-11-20T07:02:27.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe6f068640 1 -- start start 2023-11-20T07:02:27.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe6f068640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680b2ad0 0x7efe680b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe6f068640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe680ce310 0x7efe680b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe6f068640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe6815cf90 0x7efe680b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe6f068640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680c4370 con 0x7efe680ce310 2023-11-20T07:02:27.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe6f068640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe680ab870 con 0x7efe680b2ad0 2023-11-20T07:02:27.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe6f068640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe680b4360 con 0x7efe6815cf90 2023-11-20T07:02:27.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe5ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe680ce310 0x7efe680b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe5ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe680ce310 0x7efe680b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40666/0 (socket says 172.21.15.88:40666) 2023-11-20T07:02:27.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe5ffff640 1 -- 172.21.15.88:0/38516964 learned_addr learned my addr 172.21.15.88:0/38516964 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:27.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe6ce04640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680b2ad0 0x7efe680b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe6d605640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe6815cf90 0x7efe680b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe5ffff640 1 -- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe6815cf90 msgr2=0x7efe680b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe5ffff640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe6815cf90 0x7efe680b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe5ffff640 1 -- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680b2ad0 msgr2=0x7efe680b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe5ffff640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680b2ad0 0x7efe680b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe5ffff640 1 -- 172.21.15.88:0/38516964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe60009b30 con 0x7efe680ce310 2023-11-20T07:02:27.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe5ffff640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe680ce310 0x7efe680b10d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efe5800c430 tx=0x7efe5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:27.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe5d7fa640 1 -- 172.21.15.88:0/38516964 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580074e0 con 0x7efe680ce310 2023-11-20T07:02:27.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe5d7fa640 1 -- 172.21.15.88:0/38516964 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58007640 con 0x7efe680ce310 2023-11-20T07:02:27.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe5d7fa640 1 -- 172.21.15.88:0/38516964 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58004a10 con 0x7efe680ce310 2023-11-20T07:02:27.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe6f068640 1 -- 172.21.15.88:0/38516964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe680b34a0 con 0x7efe680ce310 2023-11-20T07:02:27.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe6f068640 1 -- 172.21.15.88:0/38516964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe680b5890 con 0x7efe680ce310 2023-11-20T07:02:27.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.209+0000 7efe6f068640 1 -- 172.21.15.88:0/38516964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe68074010 con 0x7efe680ce310 2023-11-20T07:02:27.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.213+0000 7efe5d7fa640 1 -- 172.21.15.88:0/38516964 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efe58004b70 con 0x7efe680ce310 2023-11-20T07:02:27.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.213+0000 7efe5d7fa640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efe540664a0 0x7efe54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.213+0000 7efe5d7fa640 1 -- 172.21.15.88:0/38516964 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efe580839b0 con 0x7efe680ce310 2023-11-20T07:02:27.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.213+0000 7efe6ce04640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efe540664a0 0x7efe54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.213+0000 7efe6ce04640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efe540664a0 0x7efe54068960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe64009ac0 tx=0x7efe64009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:27.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.217+0000 7efe5d7fa640 1 -- 172.21.15.88:0/38516964 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efe58050c50 con 0x7efe680ce310 2023-11-20T07:02:27.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.369+0000 7efe6f068640 1 -- 172.21.15.88:0/38516964 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe680cddb0 con 0x7efe680ce310 2023-11-20T07:02:27.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe5d7fa640 1 -- 172.21.15.88:0/38516964 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16738 (secure 0 0 0) 0x7efe58054270 con 0x7efe680ce310 2023-11-20T07:02:27.372 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:27.373 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":38,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:02:20.307946+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:02:17.053314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T07:02:17.706068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:27.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe6f068640 1 -- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efe540664a0 msgr2=0x7efe54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe6f068640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efe540664a0 0x7efe54068960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe64009ac0 tx=0x7efe64009190 comp rx=0 tx=0).stop 2023-11-20T07:02:27.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe6f068640 1 -- 172.21.15.88:0/38516964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe680ce310 msgr2=0x7efe680b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe6f068640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe680ce310 0x7efe680b10d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efe5800c430 tx=0x7efe5800c8f0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe6f068640 1 -- 172.21.15.88:0/38516964 shutdown_connections 2023-11-20T07:02:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe6f068640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efe540664a0 0x7efe54068960 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe6f068640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe6815cf90 0x7efe680b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe6f068640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efe680ce310 0x7efe680b10d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe6f068640 1 --2- 172.21.15.88:0/38516964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe680b2ad0 0x7efe680b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe6f068640 1 -- 172.21.15.88:0/38516964 >> 172.21.15.88:0/38516964 conn(0x7efe680cd1c0 msgr2=0x7efe6815c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe6f068640 1 -- 172.21.15.88:0/38516964 shutdown_connections 2023-11-20T07:02:27.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.373+0000 7efe6f068640 1 -- 172.21.15.88:0/38516964 wait complete. 2023-11-20T07:02:27.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:02:17.053314+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:02:17.706068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-20T07:02:27.395 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:02:27.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.533+0000 7f6cffa9c640 1 Processor -- start 2023-11-20T07:02:27.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.533+0000 7f6cffa9c640 1 -- start start 2023-11-20T07:02:27.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cffa9c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6cf81590d0 0x7f6cf806df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cffa9c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6cf8070a00 0x7f6cf80cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cffa9c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf80c9600 con 0x7f6cf80c8dd0 2023-11-20T07:02:27.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cffa9c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf80c98e0 con 0x7f6cf8070a00 2023-11-20T07:02:27.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cffa9c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf80c9bc0 con 0x7f6cf81590d0 2023-11-20T07:02:27.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cfe039640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6cf8070a00 0x7f6cf80cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cfe039640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6cf8070a00 0x7f6cf80cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40670/0 (socket says 172.21.15.88:40670) 2023-11-20T07:02:27.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cfe039640 1 -- 172.21.15.88:0/3483692732 learned_addr learned my addr 172.21.15.88:0/3483692732 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:27.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cfd838640 1 --2- 172.21.15.88:0/3483692732 >> v2:172.21.15.175:3300/0 conn(0x7f6cf81590d0 0x7f6cf806df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cfe039640 1 -- 172.21.15.88:0/3483692732 >> v2:172.21.15.175:3300/0 conn(0x7f6cf81590d0 msgr2=0x7f6cf806df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:27.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cfe039640 1 --2- 172.21.15.88:0/3483692732 >> v2:172.21.15.175:3300/0 conn(0x7f6cf81590d0 0x7f6cf806df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cfe039640 1 -- 172.21.15.88:0/3483692732 >> v1:172.21.15.175:6789/0 conn(0x7f6cf80c8dd0 legacy=0x7f6cf80702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.537+0000 7f6cfe039640 1 -- 172.21.15.88:0/3483692732 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf80c9ea0 con 0x7f6cf8070a00 2023-11-20T07:02:27.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cfe039640 1 --2- 172.21.15.88:0/3483692732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8070a00 0x7f6cf80cc350 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8070f80 tx=0x7f6cf001dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5132e96306267981 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:27.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cfc836640 1 -- 172.21.15.88:0/3483692732 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00a6930 con 0x7f6cf8070a00 2023-11-20T07:02:27.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cfc836640 1 -- 172.21.15.88:0/3483692732 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf00a6a90 con 0x7f6cf8070a00 2023-11-20T07:02:27.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cfc836640 1 -- 172.21.15.88:0/3483692732 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00a6e20 con 0x7f6cf8070a00 2023-11-20T07:02:27.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 -- 172.21.15.88:0/3483692732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8070a00 msgr2=0x7f6cf80cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 --2- 172.21.15.88:0/3483692732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8070a00 0x7f6cf80cc350 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8070f80 tx=0x7f6cf001dab0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 -- 172.21.15.88:0/3483692732 shutdown_connections 2023-11-20T07:02:27.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 --2- 172.21.15.88:0/3483692732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8070a00 0x7f6cf80cc350 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 --2- 172.21.15.88:0/3483692732 >> v2:172.21.15.175:3300/0 conn(0x7f6cf81590d0 0x7f6cf806df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 -- 172.21.15.88:0/3483692732 >> 172.21.15.88:0/3483692732 conn(0x7f6cf80b0da0 msgr2=0x7f6cf80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:27.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 -- 172.21.15.88:0/3483692732 shutdown_connections 2023-11-20T07:02:27.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 -- 172.21.15.88:0/3483692732 wait complete. 2023-11-20T07:02:27.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 Processor -- start 2023-11-20T07:02:27.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 -- start start 2023-11-20T07:02:27.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8070a00 0x7f6cf8159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cf80c8dd0 0x7f6cf8151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cf81590d0 0x7f6cf81523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf80c2cc0 con 0x7f6cf8070a00 2023-11-20T07:02:27.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf815a070 con 0x7f6cf80c8dd0 2023-11-20T07:02:27.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.541+0000 7f6cffa9c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf80c4d00 con 0x7f6cf81590d0 2023-11-20T07:02:27.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cfd838640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8070a00 0x7f6cf8159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cfd838640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8070a00 0x7f6cf8159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40674/0 (socket says 172.21.15.88:40674) 2023-11-20T07:02:27.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cfd838640 1 -- 172.21.15.88:0/4036618571 learned_addr learned my addr 172.21.15.88:0/4036618571 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:27.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cfd037640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cf80c8dd0 0x7f6cf8151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cfe039640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cf81590d0 0x7f6cf81523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cfd838640 1 -- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cf81590d0 msgr2=0x7f6cf81523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cfd838640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cf81590d0 0x7f6cf81523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cfd838640 1 -- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cf80c8dd0 msgr2=0x7f6cf8151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cfd838640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cf80c8dd0 0x7f6cf8151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cfd838640 1 -- 172.21.15.88:0/4036618571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf0009b30 con 0x7f6cf8070a00 2023-11-20T07:02:27.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cfd838640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8070a00 0x7f6cf8159b30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400e930 tx=0x7f6cf400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:27.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cee7fc640 1 -- 172.21.15.88:0/4036618571 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4009690 con 0x7f6cf8070a00 2023-11-20T07:02:27.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cee7fc640 1 -- 172.21.15.88:0/4036618571 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf400ca00 con 0x7f6cf8070a00 2023-11-20T07:02:27.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cee7fc640 1 -- 172.21.15.88:0/4036618571 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf400cd70 con 0x7f6cf8070a00 2023-11-20T07:02:27.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cffa9c640 1 -- 172.21.15.88:0/4036618571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf80ca820 con 0x7f6cf8070a00 2023-11-20T07:02:27.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cffa9c640 1 -- 172.21.15.88:0/4036618571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf80c2f80 con 0x7f6cf8070a00 2023-11-20T07:02:27.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cffa9c640 1 -- 172.21.15.88:0/4036618571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf804e170 con 0x7f6cf8070a00 2023-11-20T07:02:27.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cee7fc640 1 -- 172.21.15.88:0/4036618571 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6cf4013470 con 0x7f6cf8070a00 2023-11-20T07:02:27.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.545+0000 7f6cee7fc640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6cdc0664d0 0x7f6cdc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.549+0000 7f6cee7fc640 1 -- 172.21.15.88:0/4036618571 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6cf40840e0 con 0x7f6cf8070a00 2023-11-20T07:02:27.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.549+0000 7f6cfd037640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6cdc0664d0 0x7f6cdc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.549+0000 7f6cfd037640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6cdc0664d0 0x7f6cdc068990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6cf806e2b0 tx=0x7f6ce8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:27.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.549+0000 7f6cee7fc640 1 -- 172.21.15.88:0/4036618571 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6cf4051590 con 0x7f6cf8070a00 2023-11-20T07:02:27.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 -- 172.21.15.88:0/4036618571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6cf8071270 con 0x7f6cf8070a00 2023-11-20T07:02:27.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cee7fc640 1 -- 172.21.15.88:0/4036618571 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6cf4054bb0 con 0x7f6cf8070a00 2023-11-20T07:02:27.702 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:02:27.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 -- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6cdc0664d0 msgr2=0x7f6cdc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6cdc0664d0 0x7f6cdc068990 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6cf806e2b0 tx=0x7f6ce8009040 comp rx=0 tx=0).stop 2023-11-20T07:02:27.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 -- 172.21.15.88:0/4036618571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8070a00 msgr2=0x7f6cf8159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8070a00 0x7f6cf8159b30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400e930 tx=0x7f6cf400edf0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 -- 172.21.15.88:0/4036618571 shutdown_connections 2023-11-20T07:02:27.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6cdc0664d0 0x7f6cdc068990 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cf81590d0 0x7f6cf81523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cf80c8dd0 0x7f6cf8151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 --2- 172.21.15.88:0/4036618571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf8070a00 0x7f6cf8159b30 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 -- 172.21.15.88:0/4036618571 >> 172.21.15.88:0/4036618571 conn(0x7f6cf80b0da0 msgr2=0x7f6cf80ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:27.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 -- 172.21.15.88:0/4036618571 shutdown_connections 2023-11-20T07:02:27.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.701+0000 7f6cffa9c640 1 -- 172.21.15.88:0/4036618571 wait complete. 2023-11-20T07:02:27.724 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:02:27.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.865+0000 7f122d7aa640 1 Processor -- start 2023-11-20T07:02:27.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.865+0000 7f122d7aa640 1 -- start start 2023-11-20T07:02:27.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.865+0000 7f122d7aa640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f122815cba0 0x7f12280d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.865+0000 7f122d7aa640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f12280d0210 0x7f12280b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f122d7aa640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12280d1670 con 0x7f12280b84e0 2023-11-20T07:02:27.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f122d7aa640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12280d1460 con 0x7f122815cba0 2023-11-20T07:02:27.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f122d7aa640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12280d1950 con 0x7f12280d0210 2023-11-20T07:02:27.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f1226ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f122815cba0 0x7f12280d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f1226ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f122815cba0 0x7f12280d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40676/0 (socket says 172.21.15.88:40676) 2023-11-20T07:02:27.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f1226ffd640 1 -- 172.21.15.88:0/295054301 learned_addr learned my addr 172.21.15.88:0/295054301 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:27.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f12277fe640 1 --2- 172.21.15.88:0/295054301 >> v2:172.21.15.175:3300/0 conn(0x7f12280d0210 0x7f12280b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f1226ffd640 1 -- 172.21.15.88:0/295054301 >> v2:172.21.15.175:3300/0 conn(0x7f12280d0210 msgr2=0x7f12280b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:27.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f1226ffd640 1 --2- 172.21.15.88:0/295054301 >> v2:172.21.15.175:3300/0 conn(0x7f12280d0210 0x7f12280b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f1226ffd640 1 -- 172.21.15.88:0/295054301 >> v1:172.21.15.175:6789/0 conn(0x7f12280b84e0 legacy=0x7f12280cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:27.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f1226ffd640 1 -- 172.21.15.88:0/295054301 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12280d1c30 con 0x7f122815cba0 2023-11-20T07:02:27.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f1226ffd640 1 --2- 172.21.15.88:0/295054301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122815cba0 0x7f12280d0f20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f12280ce450 tx=0x7f121801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbfc39dce8ad514 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:27.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f12267fc640 1 -- 172.21.15.88:0/295054301 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12180ab670 con 0x7f122815cba0 2023-11-20T07:02:27.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f12267fc640 1 -- 172.21.15.88:0/295054301 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12180ab7d0 con 0x7f122815cba0 2023-11-20T07:02:27.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.869+0000 7f12267fc640 1 -- 172.21.15.88:0/295054301 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12180abb60 con 0x7f122815cba0 2023-11-20T07:02:27.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 -- 172.21.15.88:0/295054301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122815cba0 msgr2=0x7f12280d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 --2- 172.21.15.88:0/295054301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122815cba0 0x7f12280d0f20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f12280ce450 tx=0x7f121801c470 comp rx=0 tx=0).stop 2023-11-20T07:02:27.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 -- 172.21.15.88:0/295054301 shutdown_connections 2023-11-20T07:02:27.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 --2- 172.21.15.88:0/295054301 >> v2:172.21.15.175:3300/0 conn(0x7f12280d0210 0x7f12280b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 --2- 172.21.15.88:0/295054301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122815cba0 0x7f12280d0f20 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 -- 172.21.15.88:0/295054301 >> 172.21.15.88:0/295054301 conn(0x7f12280719c0 msgr2=0x7f1228071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:27.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 -- 172.21.15.88:0/295054301 shutdown_connections 2023-11-20T07:02:27.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 -- 172.21.15.88:0/295054301 wait complete. 2023-11-20T07:02:27.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 Processor -- start 2023-11-20T07:02:27.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 -- start start 2023-11-20T07:02:27.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280b84e0 0x7f122814da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12280d0210 0x7f1228158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122815cba0 0x7f12281572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122814df90 con 0x7f122815cba0 2023-11-20T07:02:27.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228157d80 con 0x7f12280d0210 2023-11-20T07:02:27.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f122d7aa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1228158060 con 0x7f12280b84e0 2023-11-20T07:02:27.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f12277fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122815cba0 0x7f12281572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f12277fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122815cba0 0x7f12281572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40686/0 (socket says 172.21.15.88:40686) 2023-11-20T07:02:27.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f12277fe640 1 -- 172.21.15.88:0/2897526952 learned_addr learned my addr 172.21.15.88:0/2897526952 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:27.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f1226ffd640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280b84e0 0x7f122814da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.873+0000 7f121e7fc640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12280d0210 0x7f1228158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f12277fe640 1 -- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280b84e0 msgr2=0x7f122814da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f12277fe640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280b84e0 0x7f122814da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f12277fe640 1 -- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12280d0210 msgr2=0x7f1228158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:27.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f12277fe640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12280d0210 0x7f1228158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:27.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f12277fe640 1 -- 172.21.15.88:0/2897526952 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12180094d0 con 0x7f122815cba0 2023-11-20T07:02:27.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f12277fe640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122815cba0 0x7f12281572e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f122000d800 tx=0x7f122000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:27.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f121ffff640 1 -- 172.21.15.88:0/2897526952 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122000b6c0 con 0x7f122815cba0 2023-11-20T07:02:27.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f121ffff640 1 -- 172.21.15.88:0/2897526952 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122000b820 con 0x7f122815cba0 2023-11-20T07:02:27.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f121ffff640 1 -- 172.21.15.88:0/2897526952 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122000bbd0 con 0x7f122815cba0 2023-11-20T07:02:27.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f122d7aa640 1 -- 172.21.15.88:0/2897526952 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1228158340 con 0x7f122815cba0 2023-11-20T07:02:27.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f122d7aa640 1 -- 172.21.15.88:0/2897526952 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1228158900 con 0x7f122815cba0 2023-11-20T07:02:27.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f122d7aa640 1 -- 172.21.15.88:0/2897526952 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1228158b20 con 0x7f122815cba0 2023-11-20T07:02:27.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f121ffff640 1 -- 172.21.15.88:0/2897526952 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f122000bd30 con 0x7f122815cba0 2023-11-20T07:02:27.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f121ffff640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f12080664d0 0x7f1208068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:27.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f121ffff640 1 -- 172.21.15.88:0/2897526952 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1220084430 con 0x7f122815cba0 2023-11-20T07:02:27.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.877+0000 7f1226ffd640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f12080664d0 0x7f1208068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:27.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.881+0000 7f1226ffd640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f12080664d0 0x7f1208068990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f12180af000 tx=0x7f12180b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:27.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:27.881+0000 7f121ffff640 1 -- 172.21.15.88:0/2897526952 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f12200516f0 con 0x7f122815cba0 2023-11-20T07:02:28.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.029+0000 7f122d7aa640 1 -- 172.21.15.88:0/2897526952 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f122804e170 con 0x7f122815cba0 2023-11-20T07:02:28.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.029+0000 7f121ffff640 1 -- 172.21.15.88:0/2897526952 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1220054d10 con 0x7f122815cba0 2023-11-20T07:02:28.031 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:02:28.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.033+0000 7f122d7aa640 1 -- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f12080664d0 msgr2=0x7f1208068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.033+0000 7f122d7aa640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f12080664d0 0x7f1208068990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f12180af000 tx=0x7f12180b6040 comp rx=0 tx=0).stop 2023-11-20T07:02:28.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.033+0000 7f122d7aa640 1 -- 172.21.15.88:0/2897526952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122815cba0 msgr2=0x7f12281572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.033+0000 7f122d7aa640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122815cba0 0x7f12281572e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f122000d800 tx=0x7f122000dcc0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.033+0000 7f122d7aa640 1 -- 172.21.15.88:0/2897526952 shutdown_connections 2023-11-20T07:02:28.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.033+0000 7f122d7aa640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f12080664d0 0x7f1208068990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.033+0000 7f122d7aa640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122815cba0 0x7f12281572e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.033+0000 7f122d7aa640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12280d0210 0x7f1228158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.033+0000 7f122d7aa640 1 --2- 172.21.15.88:0/2897526952 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12280b84e0 0x7f122814da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.033+0000 7f122d7aa640 1 -- 172.21.15.88:0/2897526952 >> 172.21.15.88:0/2897526952 conn(0x7f12280719c0 msgr2=0x7f1228159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:28.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.033+0000 7f122d7aa640 1 -- 172.21.15.88:0/2897526952 shutdown_connections 2023-11-20T07:02:28.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.033+0000 7f122d7aa640 1 -- 172.21.15.88:0/2897526952 wait complete. 2023-11-20T07:02:28.052 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:02:28.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9339b65640 1 Processor -- start 2023-11-20T07:02:28.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9339b65640 1 -- start start 2023-11-20T07:02:28.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9339b65640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9334159900 0x7f933406e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:28.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9339b65640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f933406a5a0 0x7f93340c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:28.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9339b65640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93340b4360 con 0x7f93340b3f00 2023-11-20T07:02:28.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9339b65640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93340cd740 con 0x7f933406a5a0 2023-11-20T07:02:28.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9339b65640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93340b4600 con 0x7f9334159900 2023-11-20T07:02:28.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9333fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f933406a5a0 0x7f93340c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:28.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9333fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f933406a5a0 0x7f93340c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40694/0 (socket says 172.21.15.88:40694) 2023-11-20T07:02:28.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9333fff640 1 -- 172.21.15.88:0/2709097666 learned_addr learned my addr 172.21.15.88:0/2709097666 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:28.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f93337fe640 1 --2- 172.21.15.88:0/2709097666 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9334159900 0x7f933406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:28.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9333fff640 1 -- 172.21.15.88:0/2709097666 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9334159900 msgr2=0x7f933406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:28.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9333fff640 1 --2- 172.21.15.88:0/2709097666 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9334159900 0x7f933406e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9333fff640 1 -- 172.21.15.88:0/2709097666 >> v1:172.21.15.175:6789/0 conn(0x7f93340b3f00 legacy=0x7f9334069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.193+0000 7f9333fff640 1 -- 172.21.15.88:0/2709097666 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93340c8dd0 con 0x7f933406a5a0 2023-11-20T07:02:28.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f9333fff640 1 --2- 172.21.15.88:0/2709097666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f933406a5a0 0x7f93340c9b90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f932c00d150 tx=0x7f932c01ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d126a7ac3cfd2464 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:28.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f93327fc640 1 -- 172.21.15.88:0/2709097666 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c00b2d0 con 0x7f933406a5a0 2023-11-20T07:02:28.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f93327fc640 1 -- 172.21.15.88:0/2709097666 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c00b430 con 0x7f933406a5a0 2023-11-20T07:02:28.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f93327fc640 1 -- 172.21.15.88:0/2709097666 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c0a7cd0 con 0x7f933406a5a0 2023-11-20T07:02:28.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f9339b65640 1 -- 172.21.15.88:0/2709097666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f933406a5a0 msgr2=0x7f93340c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f9339b65640 1 --2- 172.21.15.88:0/2709097666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f933406a5a0 0x7f93340c9b90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f932c00d150 tx=0x7f932c01ebe0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f9339b65640 1 -- 172.21.15.88:0/2709097666 shutdown_connections 2023-11-20T07:02:28.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f9339b65640 1 --2- 172.21.15.88:0/2709097666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f933406a5a0 0x7f93340c9b90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f9339b65640 1 --2- 172.21.15.88:0/2709097666 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9334159900 0x7f933406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f9339b65640 1 -- 172.21.15.88:0/2709097666 >> 172.21.15.88:0/2709097666 conn(0x7f93340b0da0 msgr2=0x7f93340ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:28.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f9339b65640 1 -- 172.21.15.88:0/2709097666 shutdown_connections 2023-11-20T07:02:28.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f9339b65640 1 -- 172.21.15.88:0/2709097666 wait complete. 2023-11-20T07:02:28.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.197+0000 7f9339b65640 1 Processor -- start 2023-11-20T07:02:28.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9339b65640 1 -- start start 2023-11-20T07:02:28.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9339b65640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933406a5a0 0x7f9334154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:28.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9339b65640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93340b3f00 0x7f9334155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:28.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9339b65640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9334159900 0x7f93341559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:28.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9339b65640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93341575c0 con 0x7f93340b3f00 2023-11-20T07:02:28.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9339b65640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93341565b0 con 0x7f933406a5a0 2023-11-20T07:02:28.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9339b65640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9334156800 con 0x7f9334159900 2023-11-20T07:02:28.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9332ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93340b3f00 0x7f9334155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:28.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9332ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93340b3f00 0x7f9334155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40700/0 (socket says 172.21.15.88:40700) 2023-11-20T07:02:28.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9332ffd640 1 -- 172.21.15.88:0/865579704 learned_addr learned my addr 172.21.15.88:0/865579704 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:28.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f93337fe640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933406a5a0 0x7f9334154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:28.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9333fff640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9334159900 0x7f93341559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:28.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9332ffd640 1 -- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9334159900 msgr2=0x7f93341559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9332ffd640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9334159900 0x7f93341559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9332ffd640 1 -- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933406a5a0 msgr2=0x7f9334154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9332ffd640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933406a5a0 0x7f9334154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9332ffd640 1 -- 172.21.15.88:0/865579704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c00bd40 con 0x7f93340b3f00 2023-11-20T07:02:28.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9333fff640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9334159900 0x7f93341559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:28.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9332ffd640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93340b3f00 0x7f9334155480 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f932800c530 tx=0x7f932800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:28.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f931bfff640 1 -- 172.21.15.88:0/865579704 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9328005220 con 0x7f93340b3f00 2023-11-20T07:02:28.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f931bfff640 1 -- 172.21.15.88:0/865579704 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9328005380 con 0x7f93340b3f00 2023-11-20T07:02:28.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f931bfff640 1 -- 172.21.15.88:0/865579704 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9328007270 con 0x7f93340b3f00 2023-11-20T07:02:28.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9339b65640 1 -- 172.21.15.88:0/865579704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9334156ae0 con 0x7f93340b3f00 2023-11-20T07:02:28.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9339b65640 1 -- 172.21.15.88:0/865579704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93341570a0 con 0x7f93340b3f00 2023-11-20T07:02:28.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.201+0000 7f9339b65640 1 -- 172.21.15.88:0/865579704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933404e170 con 0x7f93340b3f00 2023-11-20T07:02:28.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.205+0000 7f931bfff640 1 -- 172.21.15.88:0/865579704 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f93280073d0 con 0x7f93340b3f00 2023-11-20T07:02:28.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.205+0000 7f931bfff640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f93200664a0 0x7f9320068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:28.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.205+0000 7f931bfff640 1 -- 172.21.15.88:0/865579704 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f93280837d0 con 0x7f93340b3f00 2023-11-20T07:02:28.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.205+0000 7f93337fe640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f93200664a0 0x7f9320068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:28.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.205+0000 7f93337fe640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f93200664a0 0x7f9320068960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9324009ac0 tx=0x7f9324009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:28.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.209+0000 7f931bfff640 1 -- 172.21.15.88:0/865579704 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9328050b00 con 0x7f93340b3f00 2023-11-20T07:02:28.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.357+0000 7f9339b65640 1 -- 172.21.15.88:0/865579704 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9334072e80 con 0x7f93340b3f00 2023-11-20T07:02:28.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.357+0000 7f931bfff640 1 -- 172.21.15.88:0/865579704 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9328054120 con 0x7f93340b3f00 2023-11-20T07:02:28.360 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:02:28.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.361+0000 7f9339b65640 1 -- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f93200664a0 msgr2=0x7f9320068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.361+0000 7f9339b65640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f93200664a0 0x7f9320068960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9324009ac0 tx=0x7f9324009190 comp rx=0 tx=0).stop 2023-11-20T07:02:28.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.361+0000 7f9339b65640 1 -- 172.21.15.88:0/865579704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93340b3f00 msgr2=0x7f9334155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.361+0000 7f9339b65640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93340b3f00 0x7f9334155480 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f932800c530 tx=0x7f932800c9f0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.361+0000 7f9339b65640 1 -- 172.21.15.88:0/865579704 shutdown_connections 2023-11-20T07:02:28.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.361+0000 7f9339b65640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f93200664a0 0x7f9320068960 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.361+0000 7f9339b65640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9334159900 0x7f93341559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.361+0000 7f9339b65640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93340b3f00 0x7f9334155480 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.361+0000 7f9339b65640 1 --2- 172.21.15.88:0/865579704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f933406a5a0 0x7f9334154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.361+0000 7f9339b65640 1 -- 172.21.15.88:0/865579704 >> 172.21.15.88:0/865579704 conn(0x7f93340b0da0 msgr2=0x7f93340ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:28.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.361+0000 7f9339b65640 1 -- 172.21.15.88:0/865579704 shutdown_connections 2023-11-20T07:02:28.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.361+0000 7f9339b65640 1 -- 172.21.15.88:0/865579704 wait complete. 2023-11-20T07:02:28.383 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-20T07:02:28.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.525+0000 7f7508009640 1 Processor -- start 2023-11-20T07:02:28.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7508009640 1 -- start start 2023-11-20T07:02:28.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7508009640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7500164520 0x7f75000ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:28.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7508009640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f75000b07f0 0x7f75000cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:28.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7508009640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75000c96f0 con 0x7f75000ad960 2023-11-20T07:02:28.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7508009640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7500164900 con 0x7f7500164520 2023-11-20T07:02:28.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7508009640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75000cb950 con 0x7f75000b07f0 2023-11-20T07:02:28.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7505da5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7500164520 0x7f75000ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:28.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f75055a4640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f75000ad960 0x7f75000b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53912/0 (socket says 172.21.15.88:53912) 2023-11-20T07:02:28.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7505da5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7500164520 0x7f75000ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40710/0 (socket says 172.21.15.88:40710) 2023-11-20T07:02:28.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f75055a4640 1 -- 172.21.15.88:0/2742481958 learned_addr learned my addr 172.21.15.88:0/2742481958 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f75065a6640 1 --2- 172.21.15.88:0/2742481958 >> v2:172.21.15.175:3300/0 conn(0x7f75000b07f0 0x7f75000cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7505da5640 1 -- 172.21.15.88:0/2742481958 >> v2:172.21.15.175:3300/0 conn(0x7f75000b07f0 msgr2=0x7f75000cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7505da5640 1 --2- 172.21.15.88:0/2742481958 >> v2:172.21.15.175:3300/0 conn(0x7f75000b07f0 0x7f75000cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7505da5640 1 -- 172.21.15.88:0/2742481958 >> v1:172.21.15.88:6789/0 conn(0x7f75000ad960 legacy=0x7f75000b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7505da5640 1 -- 172.21.15.88:0/2742481958 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000cbed0 con 0x7f7500164520 2023-11-20T07:02:28.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.529+0000 7f7504da3640 1 -- 172.21.15.88:0/2742481958 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827497918 0 0) 0x7f75000c96f0 con 0x7f75000ad960 2023-11-20T07:02:28.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7505da5640 1 --2- 172.21.15.88:0/2742481958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7500164520 0x7f75000ce010 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f75000c2120 tx=0x7f74fc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8bee3d055e715e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:28.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7504da3640 1 -- 172.21.15.88:0/2742481958 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0ab650 con 0x7f7500164520 2023-11-20T07:02:28.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7504da3640 1 -- 172.21.15.88:0/2742481958 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc0ab7b0 con 0x7f7500164520 2023-11-20T07:02:28.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7504da3640 1 -- 172.21.15.88:0/2742481958 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0abb40 con 0x7f7500164520 2023-11-20T07:02:28.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7508009640 1 -- 172.21.15.88:0/2742481958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7500164520 msgr2=0x7f75000ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7508009640 1 --2- 172.21.15.88:0/2742481958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7500164520 0x7f75000ce010 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f75000c2120 tx=0x7f74fc01c430 comp rx=0 tx=0).stop 2023-11-20T07:02:28.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7508009640 1 -- 172.21.15.88:0/2742481958 shutdown_connections 2023-11-20T07:02:28.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7508009640 1 --2- 172.21.15.88:0/2742481958 >> v2:172.21.15.175:3300/0 conn(0x7f75000b07f0 0x7f75000cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7508009640 1 --2- 172.21.15.88:0/2742481958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7500164520 0x7f75000ce010 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7508009640 1 -- 172.21.15.88:0/2742481958 >> 172.21.15.88:0/2742481958 conn(0x7f750006c190 msgr2=0x7f750006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:28.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7508009640 1 -- 172.21.15.88:0/2742481958 shutdown_connections 2023-11-20T07:02:28.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7508009640 1 -- 172.21.15.88:0/2742481958 wait complete. 2023-11-20T07:02:28.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7508009640 1 Processor -- start 2023-11-20T07:02:28.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.533+0000 7f7508009640 1 -- start start 2023-11-20T07:02:28.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f7508009640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75000ad960 0x7f750015ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:28.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f7508009640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75000b07f0 0x7f7500153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:28.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f7508009640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7500164520 0x7f75001630c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:28.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f7508009640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7500160540 con 0x7f7500164520 2023-11-20T07:02:28.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f7508009640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7500160260 con 0x7f75000b07f0 2023-11-20T07:02:28.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f7508009640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75001625e0 con 0x7f75000ad960 2023-11-20T07:02:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f75065a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7500164520 0x7f75001630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f75065a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7500164520 0x7f75001630c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40712/0 (socket says 172.21.15.88:40712) 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f75065a6640 1 -- 172.21.15.88:0/3059881028 learned_addr learned my addr 172.21.15.88:0/3059881028 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f75065a6640 1 -- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75000ad960 msgr2=0x7f750015ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f75065a6640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75000ad960 0x7f750015ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f75055a4640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75000b07f0 0x7f7500153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f75065a6640 1 -- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75000b07f0 msgr2=0x7f7500153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f75065a6640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75000b07f0 0x7f7500153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f75065a6640 1 -- 172.21.15.88:0/3059881028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc009420 con 0x7f7500164520 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f75055a4640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75000b07f0 0x7f7500153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f75065a6640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7500164520 0x7f75001630c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f74f8007cf0 tx=0x7f74f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f74f67fc640 1 -- 172.21.15.88:0/3059881028 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8014420 con 0x7f7500164520 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f74f67fc640 1 -- 172.21.15.88:0/3059881028 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f80145a0 con 0x7f7500164520 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f74f67fc640 1 -- 172.21.15.88:0/3059881028 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8014950 con 0x7f7500164520 2023-11-20T07:02:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f7508009640 1 -- 172.21.15.88:0/3059881028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75001628c0 con 0x7f7500164520 2023-11-20T07:02:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f7508009640 1 -- 172.21.15.88:0/3059881028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750015fe80 con 0x7f7500164520 2023-11-20T07:02:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.537+0000 7f7508009640 1 -- 172.21.15.88:0/3059881028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7500074010 con 0x7f7500164520 2023-11-20T07:02:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.541+0000 7f74f67fc640 1 -- 172.21.15.88:0/3059881028 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f74f8014ab0 con 0x7f7500164520 2023-11-20T07:02:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.541+0000 7f74f67fc640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f74e40664d0 0x7f74e4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.541+0000 7f74f67fc640 1 -- 172.21.15.88:0/3059881028 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f74f80847f0 con 0x7f7500164520 2023-11-20T07:02:28.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.541+0000 7f7505da5640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f74e40664d0 0x7f74e4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:28.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.541+0000 7f7505da5640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f74e40664d0 0x7f74e4068990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0af000 tx=0x7f74fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.545+0000 7f74f67fc640 1 -- 172.21.15.88:0/3059881028 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f74f8051b20 con 0x7f7500164520 2023-11-20T07:02:28.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.705+0000 7f7508009640 1 -- 172.21.15.88:0/3059881028 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7500162d70 con 0x7f7500164520 2023-11-20T07:02:28.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.705+0000 7f74f67fc640 1 -- 172.21.15.88:0/3059881028 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f74f8055140 con 0x7f7500164520 2023-11-20T07:02:28.708 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-11-20T07:02:28.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.709+0000 7f7508009640 1 -- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f74e40664d0 msgr2=0x7f74e4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.709+0000 7f7508009640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f74e40664d0 0x7f74e4068990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0af000 tx=0x7f74fc008040 comp rx=0 tx=0).stop 2023-11-20T07:02:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.709+0000 7f7508009640 1 -- 172.21.15.88:0/3059881028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7500164520 msgr2=0x7f75001630c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.709+0000 7f7508009640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7500164520 0x7f75001630c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f74f8007cf0 tx=0x7f74f800e4b0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.709+0000 7f7508009640 1 -- 172.21.15.88:0/3059881028 shutdown_connections 2023-11-20T07:02:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.709+0000 7f7508009640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f74e40664d0 0x7f74e4068990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.709+0000 7f7508009640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7500164520 0x7f75001630c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.709+0000 7f7508009640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75000b07f0 0x7f7500153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.709+0000 7f7508009640 1 --2- 172.21.15.88:0/3059881028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75000ad960 0x7f750015ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.709+0000 7f7508009640 1 -- 172.21.15.88:0/3059881028 >> 172.21.15.88:0/3059881028 conn(0x7f750006c190 msgr2=0x7f75000afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:28.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.709+0000 7f7508009640 1 -- 172.21.15.88:0/3059881028 shutdown_connections 2023-11-20T07:02:28.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:28.709+0000 7f7508009640 1 -- 172.21.15.88:0/3059881028 wait complete. 2023-11-20T07:02:28.728 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2023-11-20T07:02:28.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:28.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-20T07:02:28.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[49709]: fuse finished with error 0 and tester_r 0 2023-11-20T07:02:28.749 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T07:02:28.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:28.749 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-20T07:02:28.916 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:02:28.916 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:02:28.926 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9391 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-20T07:02:28.927 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:02:28.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:28.927 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-20T07:02:28.979 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-20T07:02:28.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T07:02:28.980 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:02:28.981 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:02:28.990 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2590 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-20T07:02:28.990 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T07:02:28.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:28.990 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-20T07:02:29.039 INFO:teuthology.orchestra.run.smithi088.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-20T07:02:29.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T07:02:29.040 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:02:29.041 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:02:29.050 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9391 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-20T07:02:29.050 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:02:29.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:29.050 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-20T07:02:29.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T07:02:29.100 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-20T07:02:29.100 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:02:29.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6ccdd94640 1 Processor -- start 2023-11-20T07:02:29.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6ccdd94640 1 -- start start 2023-11-20T07:02:29.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6ccdd94640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc815ca70 0x7f6cc80d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6ccdd94640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc80c65f0 con 0x7f6cc80d3550 2023-11-20T07:02:29.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6ccdd94640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc80cdf80 con 0x7f6cc80cf7a0 2023-11-20T07:02:29.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6ccdd94640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80ce820 con 0x7f6cc815ca70 2023-11-20T07:02:29.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc6ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6cc80d3550 0x7f6cc80cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53916/0 (socket says 172.21.15.88:53916) 2023-11-20T07:02:29.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc6ffd640 1 -- 172.21.15.88:0/2961130642 learned_addr learned my addr 172.21.15.88:0/2961130642 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc77fe640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc815ca70 0x7f6cc80d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840193183 0 0) 0x7f6cc80c65f0 con 0x7f6cc80d3550 2023-11-20T07:02:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cb0003530 con 0x7f6cc80d3550 2023-11-20T07:02:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3917013854 0 0) 0x7f6cb0003530 con 0x7f6cc80d3550 2023-11-20T07:02:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc815ca70 msgr2=0x7f6cc80d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc815ca70 0x7f6cc80d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 >> v1:172.21.15.175:6789/0 conn(0x7f6cc80cf7a0 legacy=0x7f6cc80c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc80ce260 con 0x7f6cc80d3550 2023-11-20T07:02:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f6cbc001680 con 0x7f6cc80d3550 2023-11-20T07:02:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc77fe640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc815ca70 0x7f6cc80d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 >> v1:172.21.15.88:6789/0 conn(0x7f6cc80d3550 legacy=0x7f6cc80cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb00039b0 0x7f6cb0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cb0004360 0x7f6cb0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc815ca70 0x7f6cb0005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc80ce820 con 0x7f6cb00039b0 2023-11-20T07:02:29.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb000b990 con 0x7f6cb0004360 2023-11-20T07:02:29.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.237+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb000bb00 con 0x7f6cc815ca70 2023-11-20T07:02:29.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.241+0000 7f6cc77fe640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb00039b0 0x7f6cb0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.241+0000 7f6cc6ffd640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cb0004360 0x7f6cb0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.241+0000 7f6cc7fff640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc815ca70 0x7f6cb0005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.241+0000 7f6cc77fe640 1 -- 172.21.15.88:0/2961130642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc815ca70 msgr2=0x7f6cb0005050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:29.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.241+0000 7f6cc77fe640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc815ca70 0x7f6cb0005050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.241+0000 7f6cc77fe640 1 -- 172.21.15.88:0/2961130642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cb0004360 msgr2=0x7f6cb0004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:29.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.241+0000 7f6cc77fe640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cb0004360 0x7f6cb0004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.241+0000 7f6cc77fe640 1 -- 172.21.15.88:0/2961130642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb80093b0 con 0x7f6cb00039b0 2023-11-20T07:02:29.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.241+0000 7f6cc77fe640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb00039b0 0x7f6cb0003d90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009c90 tx=0x7f6cb801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3d5d7f2495a607 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:29.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.241+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80a5890 con 0x7f6cb00039b0 2023-11-20T07:02:29.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.241+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb80a59f0 con 0x7f6cb00039b0 2023-11-20T07:02:29.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.241+0000 7f6cc67fc640 1 -- 172.21.15.88:0/2961130642 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80a5da0 con 0x7f6cb00039b0 2023-11-20T07:02:29.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 -- 172.21.15.88:0/2961130642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb00039b0 msgr2=0x7f6cb0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 --2- 172.21.15.88:0/2961130642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb00039b0 0x7f6cb0003d90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009c90 tx=0x7f6cb801cbd0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6cc7fff640 1 -- 172.21.15.88:0/2961130642 reap_dead start 2023-11-20T07:02:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 -- 172.21.15.88:0/2961130642 shutdown_connections 2023-11-20T07:02:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 -- 172.21.15.88:0/2961130642 >> 172.21.15.88:0/2961130642 conn(0x7f6cc809bc50 msgr2=0x7f6cc80d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 -- 172.21.15.88:0/2961130642 shutdown_connections 2023-11-20T07:02:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 -- 172.21.15.88:0/2961130642 wait complete. 2023-11-20T07:02:29.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 Processor -- start 2023-11-20T07:02:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 -- start start 2023-11-20T07:02:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb00039b0 0x7f6cc81e5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc81f6430 0x7f6cc81f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc81f1ff0 0x7f6cc80b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc81f2470 con 0x7f6cb00039b0 2023-11-20T07:02:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc81e59f0 con 0x7f6cc81f1ff0 2023-11-20T07:02:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6ccdd94640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc81e5cd0 con 0x7f6cc81f6430 2023-11-20T07:02:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6cc77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb00039b0 0x7f6cc81e5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6cc77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb00039b0 0x7f6cc81e5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40736/0 (socket says 172.21.15.88:40736) 2023-11-20T07:02:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6cc77fe640 1 -- 172.21.15.88:0/3169504966 learned_addr learned my addr 172.21.15.88:0/3169504966 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6cc7fff640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc81f1ff0 0x7f6cc80b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.245+0000 7f6cc6ffd640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc81f6430 0x7f6cc81f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6cc77fe640 1 -- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc81f6430 msgr2=0x7f6cc81f1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6cc77fe640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc81f6430 0x7f6cc81f1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6cc77fe640 1 -- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc81f1ff0 msgr2=0x7f6cc80b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6cc77fe640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc81f1ff0 0x7f6cc80b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6cc77fe640 1 -- 172.21.15.88:0/3169504966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc81e5fb0 con 0x7f6cb00039b0 2023-11-20T07:02:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6cc77fe640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb00039b0 0x7f6cc81e5310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009c90 tx=0x7f6cb0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6caffff640 1 -- 172.21.15.88:0/3169504966 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80ad850 con 0x7f6cb00039b0 2023-11-20T07:02:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6caffff640 1 -- 172.21.15.88:0/3169504966 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb80ad9d0 con 0x7f6cb00039b0 2023-11-20T07:02:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6caffff640 1 -- 172.21.15.88:0/3169504966 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80add80 con 0x7f6cb00039b0 2023-11-20T07:02:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6ccdd94640 1 -- 172.21.15.88:0/3169504966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc81e6290 con 0x7f6cb00039b0 2023-11-20T07:02:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6ccdd94640 1 -- 172.21.15.88:0/3169504966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc81f68b0 con 0x7f6cb00039b0 2023-11-20T07:02:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6ccdd94640 1 -- 172.21.15.88:0/3169504966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc8074010 con 0x7f6cb00039b0 2023-11-20T07:02:29.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6caffff640 1 -- 172.21.15.88:0/3169504966 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6cb80b4040 con 0x7f6cb00039b0 2023-11-20T07:02:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6caffff640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6cb40664a0 0x7f6cb4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.249+0000 7f6caffff640 1 -- 172.21.15.88:0/3169504966 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6cb811ea20 con 0x7f6cb00039b0 2023-11-20T07:02:29.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.253+0000 7f6cc6ffd640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6cb40664a0 0x7f6cb4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.253+0000 7f6cc6ffd640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6cb40664a0 0x7f6cb4068960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6cc815b5b0 tx=0x7f6cbc001120 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.253+0000 7f6caffff640 1 -- 172.21.15.88:0/3169504966 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6cb80ebf20 con 0x7f6cb00039b0 2023-11-20T07:02:29.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.441+0000 7f6ccdd94640 1 -- 172.21.15.88:0/3169504966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cc80cdd90 con 0x7f6cb00039b0 2023-11-20T07:02:29.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.441+0000 7f6caffff640 1 -- 172.21.15.88:0/3169504966 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f6cb80b2090 con 0x7f6cb00039b0 2023-11-20T07:02:29.442 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:29.442 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/4055175580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4055175580},{"type":"v1","addr":"172.21.15.175:6836","nonce":4055175580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3966879465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3966879465},{"type":"v1","addr":"172.21.15.175:6837","nonce":3966879465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/2725430928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2725430928},{"type":"v1","addr":"172.21.15.88:6834","nonce":2725430928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:02:18.706402+0000","modified":"2023-11-20T07:02:21.724727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2477383155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2477383155},{"type":"v1","addr":"172.21.15.88:6835","nonce":2477383155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-20T07:02:29.443 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 18 2023-11-20T07:02:29.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.441+0000 7f6ccdd94640 1 -- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6cb40664a0 msgr2=0x7f6cb4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.441+0000 7f6ccdd94640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6cb40664a0 0x7f6cb4068960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6cc815b5b0 tx=0x7f6cbc001120 comp rx=0 tx=0).stop 2023-11-20T07:02:29.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.441+0000 7f6ccdd94640 1 -- 172.21.15.88:0/3169504966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb00039b0 msgr2=0x7f6cc81e5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.441+0000 7f6ccdd94640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb00039b0 0x7f6cc81e5310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009c90 tx=0x7f6cb0005800 comp rx=0 tx=0).stop 2023-11-20T07:02:29.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.445+0000 7f6ccdd94640 1 -- 172.21.15.88:0/3169504966 shutdown_connections 2023-11-20T07:02:29.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.445+0000 7f6ccdd94640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6cb40664a0 0x7f6cb4068960 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.445+0000 7f6ccdd94640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6cc81f6430 0x7f6cc81f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.445+0000 7f6ccdd94640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc81f1ff0 0x7f6cc80b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.445+0000 7f6ccdd94640 1 --2- 172.21.15.88:0/3169504966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cb00039b0 0x7f6cc81e5310 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.445+0000 7f6ccdd94640 1 -- 172.21.15.88:0/3169504966 >> 172.21.15.88:0/3169504966 conn(0x7f6cc809bc50 msgr2=0x7f6cc80c7240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:29.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.445+0000 7f6ccdd94640 1 -- 172.21.15.88:0/3169504966 shutdown_connections 2023-11-20T07:02:29.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.445+0000 7f6ccdd94640 1 -- 172.21.15.88:0/3169504966 wait complete. 2023-11-20T07:02:29.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:29.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f469a5a3640 1 Processor -- start 2023-11-20T07:02:29.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f469a5a3640 1 -- start start 2023-11-20T07:02:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f469a5a3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469415c910 0x7f46940d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f469a5a3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f46940d3170 0x7f46940cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f469a5a3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46940cefe0 0x7f46940cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f469a5a3640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46940cf9a0 con 0x7f46940cefe0 2023-11-20T07:02:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f469a5a3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46940d17a0 con 0x7f46940d3170 2023-11-20T07:02:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f469a5a3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46940ce730 con 0x7f469415c910 2023-11-20T07:02:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f4699da2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46940cefe0 0x7f46940cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f4699da2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46940cefe0 0x7f46940cf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40742/0 (socket says 172.21.15.88:40742) 2023-11-20T07:02:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f4699da2640 1 -- 172.21.15.88:0/2711716251 learned_addr learned my addr 172.21.15.88:0/2711716251 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f4698da0640 1 --2- 172.21.15.88:0/2711716251 >> v2:172.21.15.175:3300/0 conn(0x7f46940d3170 0x7f46940cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f46995a1640 1 --2- 172.21.15.88:0/2711716251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469415c910 0x7f46940d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f4699da2640 1 -- 172.21.15.88:0/2711716251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469415c910 msgr2=0x7f46940d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f4699da2640 1 --2- 172.21.15.88:0/2711716251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469415c910 0x7f46940d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f4699da2640 1 -- 172.21.15.88:0/2711716251 >> v2:172.21.15.175:3300/0 conn(0x7f46940d3170 msgr2=0x7f46940cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f4699da2640 1 --2- 172.21.15.88:0/2711716251 >> v2:172.21.15.175:3300/0 conn(0x7f46940d3170 0x7f46940cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.601+0000 7f4699da2640 1 -- 172.21.15.88:0/2711716251 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940d0dd0 con 0x7f46940cefe0 2023-11-20T07:02:29.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f4699da2640 1 --2- 172.21.15.88:0/2711716251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46940cefe0 0x7f46940cf460 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f469408b900 tx=0x7f468c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccd05703d0c8337 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:29.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f468bfff640 1 -- 172.21.15.88:0/2711716251 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0a5790 con 0x7f46940cefe0 2023-11-20T07:02:29.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f468bfff640 1 -- 172.21.15.88:0/2711716251 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c0a58f0 con 0x7f46940cefe0 2023-11-20T07:02:29.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f468bfff640 1 -- 172.21.15.88:0/2711716251 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0a5c80 con 0x7f46940cefe0 2023-11-20T07:02:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f469a5a3640 1 -- 172.21.15.88:0/2711716251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46940cefe0 msgr2=0x7f46940cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f469a5a3640 1 --2- 172.21.15.88:0/2711716251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46940cefe0 0x7f46940cf460 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f469408b900 tx=0x7f468c01c910 comp rx=0 tx=0).stop 2023-11-20T07:02:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f469a5a3640 1 -- 172.21.15.88:0/2711716251 shutdown_connections 2023-11-20T07:02:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f469a5a3640 1 --2- 172.21.15.88:0/2711716251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46940cefe0 0x7f46940cf460 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f469a5a3640 1 --2- 172.21.15.88:0/2711716251 >> v2:172.21.15.175:3300/0 conn(0x7f46940d3170 0x7f46940cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f469a5a3640 1 --2- 172.21.15.88:0/2711716251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f469415c910 0x7f46940d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f469a5a3640 1 -- 172.21.15.88:0/2711716251 >> 172.21.15.88:0/2711716251 conn(0x7f469409bb50 msgr2=0x7f46940d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f469a5a3640 1 -- 172.21.15.88:0/2711716251 shutdown_connections 2023-11-20T07:02:29.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f469a5a3640 1 -- 172.21.15.88:0/2711716251 wait complete. 2023-11-20T07:02:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.605+0000 7f469a5a3640 1 Processor -- start 2023-11-20T07:02:29.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f469a5a3640 1 -- start start 2023-11-20T07:02:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f469a5a3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46940cefe0 0x7f46940cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f469a5a3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46940d3170 0x7f46941f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f469a5a3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469415c910 0x7f469415ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f469a5a3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46940cc7b0 con 0x7f46940cefe0 2023-11-20T07:02:29.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f469a5a3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46940c9ba0 con 0x7f469415c910 2023-11-20T07:02:29.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f469a5a3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46940c9e80 con 0x7f46940d3170 2023-11-20T07:02:29.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f46995a1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46940cefe0 0x7f46940cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f46995a1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46940cefe0 0x7f46940cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40750/0 (socket says 172.21.15.88:40750) 2023-11-20T07:02:29.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f46995a1640 1 -- 172.21.15.88:0/1502048641 learned_addr learned my addr 172.21.15.88:0/1502048641 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:29.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f4699da2640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469415c910 0x7f469415ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f4698da0640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46940d3170 0x7f46941f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f46995a1640 1 -- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46940d3170 msgr2=0x7f46941f8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f46995a1640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46940d3170 0x7f46941f8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f46995a1640 1 -- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469415c910 msgr2=0x7f469415ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f46995a1640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469415c910 0x7f469415ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f46995a1640 1 -- 172.21.15.88:0/1502048641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c009b30 con 0x7f46940cefe0 2023-11-20T07:02:29.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f46995a1640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46940cefe0 0x7f46940cc270 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f469000d800 tx=0x7f469000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:29.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f4689ffb640 1 -- 172.21.15.88:0/1502048641 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690018070 con 0x7f46940cefe0 2023-11-20T07:02:29.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f4689ffb640 1 -- 172.21.15.88:0/1502048641 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46900059a0 con 0x7f46940cefe0 2023-11-20T07:02:29.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f469a5a3640 1 -- 172.21.15.88:0/1502048641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46940ca160 con 0x7f46940cefe0 2023-11-20T07:02:29.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f4689ffb640 1 -- 172.21.15.88:0/1502048641 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690005b50 con 0x7f46940cefe0 2023-11-20T07:02:29.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f469a5a3640 1 -- 172.21.15.88:0/1502048641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46940c9870 con 0x7f46940cefe0 2023-11-20T07:02:29.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.609+0000 7f469a5a3640 1 -- 172.21.15.88:0/1502048641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469404e9c0 con 0x7f46940cefe0 2023-11-20T07:02:29.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.613+0000 7f4689ffb640 1 -- 172.21.15.88:0/1502048641 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4690005cb0 con 0x7f46940cefe0 2023-11-20T07:02:29.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.613+0000 7f4689ffb640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f46780664a0 0x7f4678068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.613+0000 7f4689ffb640 1 -- 172.21.15.88:0/1502048641 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4690083e30 con 0x7f46940cefe0 2023-11-20T07:02:29.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.613+0000 7f4698da0640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f46780664a0 0x7f4678068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.613+0000 7f4698da0640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f46780664a0 0x7f4678068960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f46940c8d60 tx=0x7f4684008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:29.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.617+0000 7f4689ffb640 1 -- 172.21.15.88:0/1502048641 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4690051160 con 0x7f46940cefe0 2023-11-20T07:02:29.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.765+0000 7f469a5a3640 1 -- 172.21.15.88:0/1502048641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46940cfe20 con 0x7f46940cefe0 2023-11-20T07:02:29.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.765+0000 7f4689ffb640 1 -- 172.21.15.88:0/1502048641 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16738 (secure 0 0 0) 0x7f4690054780 con 0x7f46940cefe0 2023-11-20T07:02:29.768 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:29.768 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":38,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:02:20.307946+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:02:17.053314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T07:02:17.706068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.769+0000 7f469a5a3640 1 -- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f46780664a0 msgr2=0x7f4678068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.769+0000 7f469a5a3640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f46780664a0 0x7f4678068960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f46940c8d60 tx=0x7f4684008040 comp rx=0 tx=0).stop 2023-11-20T07:02:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.769+0000 7f469a5a3640 1 -- 172.21.15.88:0/1502048641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46940cefe0 msgr2=0x7f46940cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.769+0000 7f469a5a3640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46940cefe0 0x7f46940cc270 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f469000d800 tx=0x7f469000dcc0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.769+0000 7f469a5a3640 1 -- 172.21.15.88:0/1502048641 shutdown_connections 2023-11-20T07:02:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.769+0000 7f469a5a3640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f46780664a0 0x7f4678068960 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.769+0000 7f469a5a3640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46940d3170 0x7f46941f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.769+0000 7f469a5a3640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469415c910 0x7f469415ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.769+0000 7f469a5a3640 1 --2- 172.21.15.88:0/1502048641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46940cefe0 0x7f46940cc270 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.769+0000 7f469a5a3640 1 -- 172.21.15.88:0/1502048641 >> 172.21.15.88:0/1502048641 conn(0x7f469409bb50 msgr2=0x7f46940af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.769+0000 7f469a5a3640 1 -- 172.21.15.88:0/1502048641 shutdown_connections 2023-11-20T07:02:29.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.769+0000 7f469a5a3640 1 -- 172.21.15.88:0/1502048641 wait complete. 2023-11-20T07:02:29.789 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-20T07:00:41.592121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-20T07:02:17.053314+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-20T07:02:17.706068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-20T07:02:29.789 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-20T07:02:29.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f318bd3e640 1 Processor -- start 2023-11-20T07:02:29.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f318bd3e640 1 -- start start 2023-11-20T07:02:29.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f318bd3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3184159900 0x7f318406e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f318bd3e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f31840b3f00 0x7f3184069e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f318bd3e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31840b4360 con 0x7f318406a3d0 2023-11-20T07:02:29.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f318bd3e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31840cd740 con 0x7f31840b3f00 2023-11-20T07:02:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f318bd3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318406a840 con 0x7f3184159900 2023-11-20T07:02:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f31892d9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f31840b3f00 0x7f3184069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f31892d9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f31840b3f00 0x7f3184069e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40758/0 (socket says 172.21.15.88:40758) 2023-11-20T07:02:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f31892d9640 1 -- 172.21.15.88:0/2546718861 learned_addr learned my addr 172.21.15.88:0/2546718861 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f3189ada640 1 --2- 172.21.15.88:0/2546718861 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3184159900 0x7f318406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f31892d9640 1 -- 172.21.15.88:0/2546718861 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3184159900 msgr2=0x7f318406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f31892d9640 1 --2- 172.21.15.88:0/2546718861 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3184159900 0x7f318406e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f31892d9640 1 -- 172.21.15.88:0/2546718861 >> v1:172.21.15.175:6789/0 conn(0x7f318406a3d0 legacy=0x7f31840cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.929+0000 7f31892d9640 1 -- 172.21.15.88:0/2546718861 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840b4600 con 0x7f31840b3f00 2023-11-20T07:02:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.933+0000 7f31892d9640 1 --2- 172.21.15.88:0/2546718861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31840b3f00 0x7f3184069e90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f317400bb10 tx=0x7f317401ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447e97da944e0184 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:29.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.933+0000 7f3188ad8640 1 -- 172.21.15.88:0/2546718861 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31740a7cb0 con 0x7f31840b3f00 2023-11-20T07:02:29.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.933+0000 7f3188ad8640 1 -- 172.21.15.88:0/2546718861 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31740a7e10 con 0x7f31840b3f00 2023-11-20T07:02:29.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.933+0000 7f3188ad8640 1 -- 172.21.15.88:0/2546718861 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31740af660 con 0x7f31840b3f00 2023-11-20T07:02:29.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.933+0000 7f318bd3e640 1 -- 172.21.15.88:0/2546718861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31840b3f00 msgr2=0x7f3184069e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.933+0000 7f318bd3e640 1 --2- 172.21.15.88:0/2546718861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31840b3f00 0x7f3184069e90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f317400bb10 tx=0x7f317401ebe0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.933+0000 7f318bd3e640 1 -- 172.21.15.88:0/2546718861 shutdown_connections 2023-11-20T07:02:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.933+0000 7f318bd3e640 1 --2- 172.21.15.88:0/2546718861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31840b3f00 0x7f3184069e90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.933+0000 7f318bd3e640 1 --2- 172.21.15.88:0/2546718861 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3184159900 0x7f318406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.933+0000 7f318bd3e640 1 -- 172.21.15.88:0/2546718861 >> 172.21.15.88:0/2546718861 conn(0x7f31840b0da0 msgr2=0x7f31840ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.933+0000 7f318bd3e640 1 -- 172.21.15.88:0/2546718861 shutdown_connections 2023-11-20T07:02:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.933+0000 7f318bd3e640 1 -- 172.21.15.88:0/2546718861 wait complete. 2023-11-20T07:02:29.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318bd3e640 1 Processor -- start 2023-11-20T07:02:29.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318bd3e640 1 -- start start 2023-11-20T07:02:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318bd3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f318406a3d0 0x7f318415ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318bd3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31840b3f00 0x7f318414db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318bd3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3184159900 0x7f318414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318bd3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318415b3d0 con 0x7f3184159900 2023-11-20T07:02:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318bd3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3184152b90 con 0x7f31840b3f00 2023-11-20T07:02:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318bd3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318414e0d0 con 0x7f318406a3d0 2023-11-20T07:02:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318a2db640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3184159900 0x7f318414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318a2db640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3184159900 0x7f318414d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40772/0 (socket says 172.21.15.88:40772) 2023-11-20T07:02:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318a2db640 1 -- 172.21.15.88:0/2516836262 learned_addr learned my addr 172.21.15.88:0/2516836262 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:29.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f31892d9640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31840b3f00 0x7f318414db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f3189ada640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f318406a3d0 0x7f318415ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318a2db640 1 -- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f318406a3d0 msgr2=0x7f318415ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318a2db640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f318406a3d0 0x7f318415ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318a2db640 1 -- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31840b3f00 msgr2=0x7f318414db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:29.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318a2db640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31840b3f00 0x7f318414db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:29.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318a2db640 1 -- 172.21.15.88:0/2516836262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317400b770 con 0x7f3184159900 2023-11-20T07:02:29.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318a2db640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3184159900 0x7f318414d0b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f317c00c760 tx=0x7f317c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f317a7fc640 1 -- 172.21.15.88:0/2516836262 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c003b80 con 0x7f3184159900 2023-11-20T07:02:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f317a7fc640 1 -- 172.21.15.88:0/2516836262 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c003ce0 con 0x7f3184159900 2023-11-20T07:02:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318bd3e640 1 -- 172.21.15.88:0/2516836262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318415b600 con 0x7f3184159900 2023-11-20T07:02:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f317a7fc640 1 -- 172.21.15.88:0/2516836262 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c00aa30 con 0x7f3184159900 2023-11-20T07:02:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.937+0000 7f318bd3e640 1 -- 172.21.15.88:0/2516836262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31841530c0 con 0x7f3184159900 2023-11-20T07:02:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.941+0000 7f318bd3e640 1 -- 172.21.15.88:0/2516836262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318404e170 con 0x7f3184159900 2023-11-20T07:02:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.941+0000 7f317a7fc640 1 -- 172.21.15.88:0/2516836262 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f317c00ab90 con 0x7f3184159900 2023-11-20T07:02:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.941+0000 7f317a7fc640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31680664a0 0x7f3168068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.941+0000 7f317a7fc640 1 -- 172.21.15.88:0/2516836262 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f317c083c20 con 0x7f3184159900 2023-11-20T07:02:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.941+0000 7f3189ada640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31680664a0 0x7f3168068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:29.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.941+0000 7f3189ada640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31680664a0 0x7f3168068960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3180007a60 tx=0x7f3180008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:29.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:29.945+0000 7f317a7fc640 1 -- 172.21.15.88:0/2516836262 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f317c051000 con 0x7f3184159900 2023-11-20T07:02:30.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.093+0000 7f318bd3e640 1 -- 172.21.15.88:0/2516836262 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31840ae840 con 0x7f3184159900 2023-11-20T07:02:30.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.093+0000 7f317a7fc640 1 -- 172.21.15.88:0/2516836262 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f317c054620 con 0x7f3184159900 2023-11-20T07:02:30.095 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-11-20T07:02:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.097+0000 7f318bd3e640 1 -- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31680664a0 msgr2=0x7f3168068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.097+0000 7f318bd3e640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31680664a0 0x7f3168068960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3180007a60 tx=0x7f3180008040 comp rx=0 tx=0).stop 2023-11-20T07:02:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.097+0000 7f318bd3e640 1 -- 172.21.15.88:0/2516836262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3184159900 msgr2=0x7f318414d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.097+0000 7f318bd3e640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3184159900 0x7f318414d0b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f317c00c760 tx=0x7f317c00cc20 comp rx=0 tx=0).stop 2023-11-20T07:02:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.097+0000 7f318bd3e640 1 -- 172.21.15.88:0/2516836262 shutdown_connections 2023-11-20T07:02:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.097+0000 7f318bd3e640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31680664a0 0x7f3168068960 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.097+0000 7f318bd3e640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3184159900 0x7f318414d0b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.097+0000 7f318bd3e640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31840b3f00 0x7f318414db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.097+0000 7f318bd3e640 1 --2- 172.21.15.88:0/2516836262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f318406a3d0 0x7f318415ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.097+0000 7f318bd3e640 1 -- 172.21.15.88:0/2516836262 >> 172.21.15.88:0/2516836262 conn(0x7f31840b0da0 msgr2=0x7f3184155240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.097+0000 7f318bd3e640 1 -- 172.21.15.88:0/2516836262 shutdown_connections 2023-11-20T07:02:30.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.097+0000 7f318bd3e640 1 -- 172.21.15.88:0/2516836262 wait complete. 2023-11-20T07:02:30.115 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-20T07:02:30.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.253+0000 7efcc96d6640 1 Processor -- start 2023-11-20T07:02:30.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.253+0000 7efcc96d6640 1 -- start start 2023-11-20T07:02:30.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc96d6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efcc4069e90 0x7efcc406d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc96d6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efcc40c26b0 0x7efcc40c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc96d6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc415ae30 con 0x7efcc406a270 2023-11-20T07:02:30.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc96d6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc40cb090 con 0x7efcc4069e90 2023-11-20T07:02:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc96d6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc40ca510 con 0x7efcc40c26b0 2023-11-20T07:02:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc2ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efcc4069e90 0x7efcc406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc2ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efcc4069e90 0x7efcc406d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40784/0 (socket says 172.21.15.88:40784) 2023-11-20T07:02:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcba7fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efcc406a270 0x7efcc40c9ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53924/0 (socket says 172.21.15.88:53924) 2023-11-20T07:02:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc2ffd640 1 -- 172.21.15.88:0/1109663278 learned_addr learned my addr 172.21.15.88:0/1109663278 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc37fe640 1 --2- 172.21.15.88:0/1109663278 >> v2:172.21.15.175:3300/0 conn(0x7efcc40c26b0 0x7efcc40c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc2ffd640 1 -- 172.21.15.88:0/1109663278 >> v2:172.21.15.175:3300/0 conn(0x7efcc40c26b0 msgr2=0x7efcc40c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc2ffd640 1 --2- 172.21.15.88:0/1109663278 >> v2:172.21.15.175:3300/0 conn(0x7efcc40c26b0 0x7efcc40c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc2ffd640 1 -- 172.21.15.88:0/1109663278 >> v1:172.21.15.88:6789/0 conn(0x7efcc406a270 legacy=0x7efcc40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc2ffd640 1 -- 172.21.15.88:0/1109663278 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc40ca7f0 con 0x7efcc4069e90 2023-11-20T07:02:30.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc2ffd640 1 --2- 172.21.15.88:0/1109663278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc4069e90 0x7efcc406d010 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7efcc4071540 tx=0x7efcb401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eac27aef61473e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc27fc640 1 -- 172.21.15.88:0/1109663278 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40a5860 con 0x7efcc4069e90 2023-11-20T07:02:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc27fc640 1 -- 172.21.15.88:0/1109663278 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb40a59c0 con 0x7efcc4069e90 2023-11-20T07:02:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.257+0000 7efcc27fc640 1 -- 172.21.15.88:0/1109663278 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40a5d50 con 0x7efcc4069e90 2023-11-20T07:02:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 -- 172.21.15.88:0/1109663278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc4069e90 msgr2=0x7efcc406d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 --2- 172.21.15.88:0/1109663278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc4069e90 0x7efcc406d010 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7efcc4071540 tx=0x7efcb401c9a0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 -- 172.21.15.88:0/1109663278 shutdown_connections 2023-11-20T07:02:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 --2- 172.21.15.88:0/1109663278 >> v2:172.21.15.175:3300/0 conn(0x7efcc40c26b0 0x7efcc40c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 --2- 172.21.15.88:0/1109663278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc4069e90 0x7efcc406d010 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 -- 172.21.15.88:0/1109663278 >> 172.21.15.88:0/1109663278 conn(0x7efcc40b0da0 msgr2=0x7efcc40ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 -- 172.21.15.88:0/1109663278 shutdown_connections 2023-11-20T07:02:30.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 -- 172.21.15.88:0/1109663278 wait complete. 2023-11-20T07:02:30.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 Processor -- start 2023-11-20T07:02:30.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 -- start start 2023-11-20T07:02:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efcc4069e90 0x7efcc40c1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc406a270 0x7efcc415d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c26b0 0x7efcc40cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40cc3d0 con 0x7efcc40c26b0 2023-11-20T07:02:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40cc6b0 con 0x7efcc406a270 2023-11-20T07:02:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc96d6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40cc990 con 0x7efcc4069e90 2023-11-20T07:02:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c26b0 0x7efcc40cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c26b0 0x7efcc40cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40792/0 (socket says 172.21.15.88:40792) 2023-11-20T07:02:30.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc37fe640 1 -- 172.21.15.88:0/3675431824 learned_addr learned my addr 172.21.15.88:0/3675431824 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcba7fc640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc406a270 0x7efcc415d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.261+0000 7efcc2ffd640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efcc4069e90 0x7efcc40c1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcc37fe640 1 -- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efcc4069e90 msgr2=0x7efcc40c1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcc37fe640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efcc4069e90 0x7efcc40c1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcc37fe640 1 -- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc406a270 msgr2=0x7efcc415d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcc37fe640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc406a270 0x7efcc415d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcc37fe640 1 -- 172.21.15.88:0/3675431824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb4009b30 con 0x7efcc40c26b0 2023-11-20T07:02:30.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcba7fc640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc406a270 0x7efcc415d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:30.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcc2ffd640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efcc4069e90 0x7efcc40c1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcc37fe640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c26b0 0x7efcc40cd470 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00d800 tx=0x7efcbc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcbbfff640 1 -- 172.21.15.88:0/3675431824 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc00b6c0 con 0x7efcc40c26b0 2023-11-20T07:02:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcbbfff640 1 -- 172.21.15.88:0/3675431824 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc00b820 con 0x7efcc40c26b0 2023-11-20T07:02:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcc96d6640 1 -- 172.21.15.88:0/3675431824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc40ccc70 con 0x7efcc40c26b0 2023-11-20T07:02:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcbbfff640 1 -- 172.21.15.88:0/3675431824 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc00bbd0 con 0x7efcc40c26b0 2023-11-20T07:02:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcc96d6640 1 -- 172.21.15.88:0/3675431824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc40c16b0 con 0x7efcc40c26b0 2023-11-20T07:02:30.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcc96d6640 1 -- 172.21.15.88:0/3675431824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc404e170 con 0x7efcc40c26b0 2023-11-20T07:02:30.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcbbfff640 1 -- 172.21.15.88:0/3675431824 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efcbc00bd30 con 0x7efcc40c26b0 2023-11-20T07:02:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcbbfff640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efca40664a0 0x7efca4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.265+0000 7efcbbfff640 1 -- 172.21.15.88:0/3675431824 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efcbc084450 con 0x7efcc40c26b0 2023-11-20T07:02:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.269+0000 7efcc2ffd640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efca40664a0 0x7efca4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.269+0000 7efcc2ffd640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efca40664a0 0x7efca4068960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efcb40ae000 tx=0x7efcb40a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.269+0000 7efcbbfff640 1 -- 172.21.15.88:0/3675431824 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efcbc051820 con 0x7efcc40c26b0 2023-11-20T07:02:30.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.421+0000 7efcc96d6640 1 -- 172.21.15.88:0/3675431824 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efcc40c2090 con 0x7efcc40c26b0 2023-11-20T07:02:30.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.421+0000 7efcbbfff640 1 -- 172.21.15.88:0/3675431824 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7efcbc054e40 con 0x7efcc40c26b0 2023-11-20T07:02:30.423 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-11-20T07:02:30.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.425+0000 7efcc96d6640 1 -- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efca40664a0 msgr2=0x7efca4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.425+0000 7efcc96d6640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efca40664a0 0x7efca4068960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efcb40ae000 tx=0x7efcb40a7070 comp rx=0 tx=0).stop 2023-11-20T07:02:30.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.425+0000 7efcc96d6640 1 -- 172.21.15.88:0/3675431824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c26b0 msgr2=0x7efcc40cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.425+0000 7efcc96d6640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c26b0 0x7efcc40cd470 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00d800 tx=0x7efcbc00dcc0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.425+0000 7efcc96d6640 1 -- 172.21.15.88:0/3675431824 shutdown_connections 2023-11-20T07:02:30.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.425+0000 7efcc96d6640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efca40664a0 0x7efca4068960 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.425+0000 7efcc96d6640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c26b0 0x7efcc40cd470 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.425+0000 7efcc96d6640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcc406a270 0x7efcc415d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.425+0000 7efcc96d6640 1 --2- 172.21.15.88:0/3675431824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efcc4069e90 0x7efcc40c1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.425+0000 7efcc96d6640 1 -- 172.21.15.88:0/3675431824 >> 172.21.15.88:0/3675431824 conn(0x7efcc40b0da0 msgr2=0x7efcc40ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:30.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.425+0000 7efcc96d6640 1 -- 172.21.15.88:0/3675431824 shutdown_connections 2023-11-20T07:02:30.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.425+0000 7efcc96d6640 1 -- 172.21.15.88:0/3675431824 wait complete. 2023-11-20T07:02:30.444 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-20T07:02:30.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d583f5640 1 Processor -- start 2023-11-20T07:02:30.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d583f5640 1 -- start start 2023-11-20T07:02:30.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d583f5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3d500b84e0 0x7f3d500d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d583f5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d500d1670 con 0x7f3d500d0210 2023-11-20T07:02:30.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d583f5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d500d1950 con 0x7f3d5015cba0 2023-11-20T07:02:30.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d583f5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d500d1460 con 0x7f3d500b84e0 2023-11-20T07:02:30.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d55990640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3d500d0210 0x7f3d500b5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53938/0 (socket says 172.21.15.88:53938) 2023-11-20T07:02:30.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d55990640 1 -- 172.21.15.88:0/2773750093 learned_addr learned my addr 172.21.15.88:0/2773750093 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:30.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d56992640 1 --2- 172.21.15.88:0/2773750093 >> v2:172.21.15.175:3300/0 conn(0x7f3d500b84e0 0x7f3d500d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043729042 0 0) 0x7f3d500d1670 con 0x7f3d500d0210 2023-11-20T07:02:30.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d3c003530 con 0x7f3d500d0210 2023-11-20T07:02:30.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3097859638 0 0) 0x7f3d3c003530 con 0x7f3d500d0210 2023-11-20T07:02:30.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 >> v2:172.21.15.175:3300/0 conn(0x7f3d500b84e0 msgr2=0x7f3d500d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:30.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d5518f640 1 --2- 172.21.15.88:0/2773750093 >> v2:172.21.15.175:3300/0 conn(0x7f3d500b84e0 0x7f3d500d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 >> v1:172.21.15.175:6789/0 conn(0x7f3d5015cba0 legacy=0x7f3d500cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500d1c30 con 0x7f3d500d0210 2023-11-20T07:02:30.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f3d40001680 con 0x7f3d500d0210 2023-11-20T07:02:30.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 >> v1:172.21.15.88:6789/0 conn(0x7f3d500d0210 legacy=0x7f3d500b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d5518f640 1 --2- 172.21.15.88:0/2773750093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d3c003980 0x7f3d3c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.585+0000 7f3d5518f640 1 --2- 172.21.15.88:0/2773750093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 0x7f3d3c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d5518f640 1 --2- 172.21.15.88:0/2773750093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d3c005190 0x7f3d3c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500d1460 con 0x7f3d3c0047d0 2023-11-20T07:02:30.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c00c130 con 0x7f3d3c005190 2023-11-20T07:02:30.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c00c2f0 con 0x7f3d3c003980 2023-11-20T07:02:30.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d55990640 1 --2- 172.21.15.88:0/2773750093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 0x7f3d3c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d56191640 1 --2- 172.21.15.88:0/2773750093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d3c003980 0x7f3d3c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d56992640 1 --2- 172.21.15.88:0/2773750093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d3c005190 0x7f3d3c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d55990640 1 -- 172.21.15.88:0/2773750093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d3c003980 msgr2=0x7f3d3c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:30.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d55990640 1 --2- 172.21.15.88:0/2773750093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d3c003980 0x7f3d3c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d55990640 1 -- 172.21.15.88:0/2773750093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d3c005190 msgr2=0x7f3d3c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:30.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d55990640 1 --2- 172.21.15.88:0/2773750093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d3c005190 0x7f3d3c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d55990640 1 -- 172.21.15.88:0/2773750093 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c003530 con 0x7f3d3c0047d0 2023-11-20T07:02:30.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d56992640 1 -- 172.21.15.88:0/2773750093 reap_dead start 2023-11-20T07:02:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d55990640 1 --2- 172.21.15.88:0/2773750093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 0x7f3d3c004c50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c210 tx=0x7f3d4001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd15455c8aa837f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40005ae0 con 0x7f3d3c0047d0 2023-11-20T07:02:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d40005c60 con 0x7f3d3c0047d0 2023-11-20T07:02:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.589+0000 7f3d5518f640 1 -- 172.21.15.88:0/2773750093 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d400a5790 con 0x7f3d3c0047d0 2023-11-20T07:02:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 -- 172.21.15.88:0/2773750093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 msgr2=0x7f3d3c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 --2- 172.21.15.88:0/2773750093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 0x7f3d3c004c50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c210 tx=0x7f3d4001cba0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 -- 172.21.15.88:0/2773750093 shutdown_connections 2023-11-20T07:02:30.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 --2- 172.21.15.88:0/2773750093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 0x7f3d3c004c50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 -- 172.21.15.88:0/2773750093 >> 172.21.15.88:0/2773750093 conn(0x7f3d500719c0 msgr2=0x7f3d50071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:30.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 -- 172.21.15.88:0/2773750093 shutdown_connections 2023-11-20T07:02:30.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 -- 172.21.15.88:0/2773750093 wait complete. 2023-11-20T07:02:30.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 Processor -- start 2023-11-20T07:02:30.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 -- start start 2023-11-20T07:02:30.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 0x7f3d5015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d5014b060 0x7f3d5015d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d5015d570 0x7f3d5015f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5014b4c0 con 0x7f3d3c0047d0 2023-11-20T07:02:30.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5015db10 con 0x7f3d5015d570 2023-11-20T07:02:30.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d583f5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5015ddf0 con 0x7f3d5014b060 2023-11-20T07:02:30.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d56191640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 0x7f3d5015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d56191640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 0x7f3d5015ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40808/0 (socket says 172.21.15.88:40808) 2023-11-20T07:02:30.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.593+0000 7f3d56191640 1 -- 172.21.15.88:0/3002418019 learned_addr learned my addr 172.21.15.88:0/3002418019 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:30.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d56191640 1 -- 172.21.15.88:0/3002418019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d5014b060 msgr2=0x7f3d5015d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d56191640 1 --2- 172.21.15.88:0/3002418019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d5014b060 0x7f3d5015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d56191640 1 -- 172.21.15.88:0/3002418019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d5015d570 msgr2=0x7f3d5015f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d56191640 1 --2- 172.21.15.88:0/3002418019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d5015d570 0x7f3d5015f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d56191640 1 -- 172.21.15.88:0/3002418019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5015e0d0 con 0x7f3d3c0047d0 2023-11-20T07:02:30.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d56191640 1 --2- 172.21.15.88:0/3002418019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 0x7f3d5015ebb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00f5f0 tx=0x7f3d4c00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:30.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d46ffd640 1 -- 172.21.15.88:0/3002418019 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0052e0 con 0x7f3d3c0047d0 2023-11-20T07:02:30.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d46ffd640 1 -- 172.21.15.88:0/3002418019 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c005440 con 0x7f3d3c0047d0 2023-11-20T07:02:30.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d583f5640 1 -- 172.21.15.88:0/3002418019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5015e3b0 con 0x7f3d3c0047d0 2023-11-20T07:02:30.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d46ffd640 1 -- 172.21.15.88:0/3002418019 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c003820 con 0x7f3d3c0047d0 2023-11-20T07:02:30.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d583f5640 1 -- 172.21.15.88:0/3002418019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d501587e0 con 0x7f3d3c0047d0 2023-11-20T07:02:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d583f5640 1 -- 172.21.15.88:0/3002418019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5004e170 con 0x7f3d3c0047d0 2023-11-20T07:02:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d46ffd640 1 -- 172.21.15.88:0/3002418019 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3d4c003980 con 0x7f3d3c0047d0 2023-11-20T07:02:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d46ffd640 1 --2- 172.21.15.88:0/3002418019 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3d340664a0 0x7f3d34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.597+0000 7f3d46ffd640 1 -- 172.21.15.88:0/3002418019 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3d4c083f20 con 0x7f3d3c0047d0 2023-11-20T07:02:30.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.601+0000 7f3d55990640 1 --2- 172.21.15.88:0/3002418019 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3d340664a0 0x7f3d34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.601+0000 7f3d55990640 1 --2- 172.21.15.88:0/3002418019 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3d340664a0 0x7f3d34068960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3d400ab000 tx=0x7f3d40001a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:30.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.601+0000 7f3d46ffd640 1 -- 172.21.15.88:0/3002418019 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3d4c051130 con 0x7f3d3c0047d0 2023-11-20T07:02:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 -- 172.21.15.88:0/3002418019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d50072db0 con 0x7f3d3c0047d0 2023-11-20T07:02:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d46ffd640 1 -- 172.21.15.88:0/3002418019 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d4c054750 con 0x7f3d3c0047d0 2023-11-20T07:02:30.753 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-11-20T07:02:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 -- 172.21.15.88:0/3002418019 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3d340664a0 msgr2=0x7f3d34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 --2- 172.21.15.88:0/3002418019 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3d340664a0 0x7f3d34068960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3d400ab000 tx=0x7f3d40001a10 comp rx=0 tx=0).stop 2023-11-20T07:02:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 -- 172.21.15.88:0/3002418019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 msgr2=0x7f3d5015ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 --2- 172.21.15.88:0/3002418019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 0x7f3d5015ebb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00f5f0 tx=0x7f3d4c00fab0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 -- 172.21.15.88:0/3002418019 shutdown_connections 2023-11-20T07:02:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 --2- 172.21.15.88:0/3002418019 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f3d340664a0 0x7f3d34068960 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 --2- 172.21.15.88:0/3002418019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d5014b060 0x7f3d5015d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 --2- 172.21.15.88:0/3002418019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d5015d570 0x7f3d5015f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 --2- 172.21.15.88:0/3002418019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d3c0047d0 0x7f3d5015ebb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 -- 172.21.15.88:0/3002418019 >> 172.21.15.88:0/3002418019 conn(0x7f3d500719c0 msgr2=0x7f3d5006b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 -- 172.21.15.88:0/3002418019 shutdown_connections 2023-11-20T07:02:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.753+0000 7f3d583f5640 1 -- 172.21.15.88:0/3002418019 wait complete. 2023-11-20T07:02:30.773 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:02:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.909+0000 7f9dfcc91640 1 Processor -- start 2023-11-20T07:02:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.909+0000 7f9dfcc91640 1 -- start start 2023-11-20T07:02:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9dfcc91640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9df80b07f0 0x7f9df8072100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9dfcc91640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df8071020 con 0x7f9df8071c70 2023-11-20T07:02:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9dfcc91640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df80c8e50 con 0x7f9df81591e0 2023-11-20T07:02:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9dfcc91640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df80c9130 con 0x7f9df80b07f0 2023-11-20T07:02:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9dedd9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9df8071c70 0x7f9df80b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53942/0 (socket says 172.21.15.88:53942) 2023-11-20T07:02:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9dedd9b640 1 -- 172.21.15.88:0/1414829446 learned_addr learned my addr 172.21.15.88:0/1414829446 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df6d9d640 1 --2- 172.21.15.88:0/1414829446 >> v2:172.21.15.175:3300/0 conn(0x7f9df80b07f0 0x7f9df8072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870444590 0 0) 0x7f9df8071020 con 0x7f9df8071c70 2023-11-20T07:02:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9de4003530 con 0x7f9df8071c70 2023-11-20T07:02:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 409920489 0 0) 0x7f9de4003530 con 0x7f9df8071c70 2023-11-20T07:02:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 >> v2:172.21.15.175:3300/0 conn(0x7f9df80b07f0 msgr2=0x7f9df8072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 --2- 172.21.15.88:0/1414829446 >> v2:172.21.15.175:3300/0 conn(0x7f9df80b07f0 0x7f9df8072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 >> v1:172.21.15.175:6789/0 conn(0x7f9df81591e0 legacy=0x7f9df80c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80c9410 con 0x7f9df8071c70 2023-11-20T07:02:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f9de8001680 con 0x7f9df8071c70 2023-11-20T07:02:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 >> v1:172.21.15.88:6789/0 conn(0x7f9df8071c70 legacy=0x7f9df80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de4003b50 0x7f9de4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9de4008820 0x7f9de400ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de400b490 0x7f9de400d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80c9130 con 0x7f9de4003b50 2023-11-20T07:02:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de400e230 con 0x7f9de400b490 2023-11-20T07:02:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de400e3f0 con 0x7f9de4008820 2023-11-20T07:02:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df659c640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de4003b50 0x7f9de4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df6d9d640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de400b490 0x7f9de400d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9dedd9b640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9de4008820 0x7f9de400ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df659c640 1 -- 172.21.15.88:0/1414829446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9de4008820 msgr2=0x7f9de400ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df659c640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9de4008820 0x7f9de400ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df659c640 1 -- 172.21.15.88:0/1414829446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de400b490 msgr2=0x7f9de400d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df659c640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de400b490 0x7f9de400d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df659c640 1 -- 172.21.15.88:0/1414829446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de4003530 con 0x7f9de4003b50 2023-11-20T07:02:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9dedd9b640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9de4008820 0x7f9de400ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df6d9d640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de400b490 0x7f9de400d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.913+0000 7f9df6d9d640 1 -- 172.21.15.88:0/1414829446 reap_dead start 2023-11-20T07:02:30.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9df659c640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de4003b50 0x7f9de4003f70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9de0001780 tx=0x7f9de001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f39dc24e2625c71 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de00052d0 con 0x7f9de4003b50 2023-11-20T07:02:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de00a7050 con 0x7f9de4003b50 2023-11-20T07:02:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9df5d9b640 1 -- 172.21.15.88:0/1414829446 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0003600 con 0x7f9de4003b50 2023-11-20T07:02:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9dfcc91640 1 -- 172.21.15.88:0/1414829446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de4003b50 msgr2=0x7f9de4003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9dfcc91640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de4003b50 0x7f9de4003f70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9de0001780 tx=0x7f9de001c3e0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9dfcc91640 1 -- 172.21.15.88:0/1414829446 shutdown_connections 2023-11-20T07:02:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9dfcc91640 1 --2- 172.21.15.88:0/1414829446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9de4003b50 0x7f9de4003f70 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9dfcc91640 1 -- 172.21.15.88:0/1414829446 >> 172.21.15.88:0/1414829446 conn(0x7f9df806c190 msgr2=0x7f9df806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9dfcc91640 1 -- 172.21.15.88:0/1414829446 shutdown_connections 2023-11-20T07:02:30.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9dfcc91640 1 -- 172.21.15.88:0/1414829446 wait complete. 2023-11-20T07:02:30.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9dfcc91640 1 Processor -- start 2023-11-20T07:02:30.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.917+0000 7f9dfcc91640 1 -- start start 2023-11-20T07:02:30.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9dfcc91640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de4003b50 0x7f9df80c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9dfcc91640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9df815c0f0 0x7f9df81f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9dfcc91640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9df815b2d0 0x7f9df81545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9dfcc91640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df81f5d10 con 0x7f9df815b2d0 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9dfcc91640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df815c570 con 0x7f9de4003b50 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9dfcc91640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df81f1760 con 0x7f9df815c0f0 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9df6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9df815b2d0 0x7f9df81545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9df6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9df815b2d0 0x7f9df81545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40832/0 (socket says 172.21.15.88:40832) 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9df6d9d640 1 -- 172.21.15.88:0/2424582915 learned_addr learned my addr 172.21.15.88:0/2424582915 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9dedd9b640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9df815c0f0 0x7f9df81f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9df659c640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de4003b50 0x7f9df80c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9df6d9d640 1 -- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9df815c0f0 msgr2=0x7f9df81f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9df6d9d640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9df815c0f0 0x7f9df81f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9df6d9d640 1 -- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de4003b50 msgr2=0x7f9df80c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9df6d9d640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de4003b50 0x7f9df80c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9df6d9d640 1 -- 172.21.15.88:0/2424582915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df81e6370 con 0x7f9df815b2d0 2023-11-20T07:02:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9df6d9d640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9df815b2d0 0x7f9df81545c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9df806ade0 tx=0x7f9df0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9def7fe640 1 -- 172.21.15.88:0/2424582915 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df000e050 con 0x7f9df815b2d0 2023-11-20T07:02:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9def7fe640 1 -- 172.21.15.88:0/2424582915 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df000f040 con 0x7f9df815b2d0 2023-11-20T07:02:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9def7fe640 1 -- 172.21.15.88:0/2424582915 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df00039a0 con 0x7f9df815b2d0 2023-11-20T07:02:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9dfcc91640 1 -- 172.21.15.88:0/2424582915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df81e6650 con 0x7f9df815b2d0 2023-11-20T07:02:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9dfcc91640 1 -- 172.21.15.88:0/2424582915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df80c85d0 con 0x7f9df815b2d0 2023-11-20T07:02:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9dfcc91640 1 -- 172.21.15.88:0/2424582915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df8074010 con 0x7f9df815b2d0 2023-11-20T07:02:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.921+0000 7f9def7fe640 1 -- 172.21.15.88:0/2424582915 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9df0003b00 con 0x7f9df815b2d0 2023-11-20T07:02:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.925+0000 7f9def7fe640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9dd80664d0 0x7f9dd8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.925+0000 7f9def7fe640 1 -- 172.21.15.88:0/2424582915 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9df0084960 con 0x7f9df815b2d0 2023-11-20T07:02:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.925+0000 7f9df659c640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9dd80664d0 0x7f9dd8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.925+0000 7f9df659c640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9dd80664d0 0x7f9dd8068990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9de0001750 tx=0x7f9de00011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:30.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:30.929+0000 7f9def7fe640 1 -- 172.21.15.88:0/2424582915 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9df0051c90 con 0x7f9df815b2d0 2023-11-20T07:02:31.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.105+0000 7f9dfcc91640 1 -- 172.21.15.88:0/2424582915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9df80cbc10 con 0x7f9df815b2d0 2023-11-20T07:02:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.105+0000 7f9def7fe640 1 -- 172.21.15.88:0/2424582915 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f9df0003db0 con 0x7f9df815b2d0 2023-11-20T07:02:31.108 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:31.108 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/4055175580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4055175580},{"type":"v1","addr":"172.21.15.175:6836","nonce":4055175580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3966879465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3966879465},{"type":"v1","addr":"172.21.15.175:6837","nonce":3966879465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/2725430928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2725430928},{"type":"v1","addr":"172.21.15.88:6834","nonce":2725430928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:02:18.706402+0000","modified":"2023-11-20T07:02:21.724727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2477383155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2477383155},{"type":"v1","addr":"172.21.15.88:6835","nonce":2477383155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-20T07:02:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 18 2023-11-20T07:02:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.109+0000 7f9dfcc91640 1 -- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9dd80664d0 msgr2=0x7f9dd8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.109+0000 7f9dfcc91640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9dd80664d0 0x7f9dd8068990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9de0001750 tx=0x7f9de00011a0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.109+0000 7f9dfcc91640 1 -- 172.21.15.88:0/2424582915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9df815b2d0 msgr2=0x7f9df81545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.109+0000 7f9dfcc91640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9df815b2d0 0x7f9df81545c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9df806ade0 tx=0x7f9df0010590 comp rx=0 tx=0).stop 2023-11-20T07:02:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.109+0000 7f9dfcc91640 1 -- 172.21.15.88:0/2424582915 shutdown_connections 2023-11-20T07:02:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.109+0000 7f9dfcc91640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f9dd80664d0 0x7f9dd8068990 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.109+0000 7f9dfcc91640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9df815c0f0 0x7f9df81f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.109+0000 7f9dfcc91640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9df815b2d0 0x7f9df81545c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.109+0000 7f9dfcc91640 1 --2- 172.21.15.88:0/2424582915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9de4003b50 0x7f9df80c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.109+0000 7f9dfcc91640 1 -- 172.21.15.88:0/2424582915 >> 172.21.15.88:0/2424582915 conn(0x7f9df806c190 msgr2=0x7f9df80c9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.109+0000 7f9dfcc91640 1 -- 172.21.15.88:0/2424582915 shutdown_connections 2023-11-20T07:02:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.109+0000 7f9dfcc91640 1 -- 172.21.15.88:0/2424582915 wait complete. 2023-11-20T07:02:31.129 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:31.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59e0b9d640 1 Processor -- start 2023-11-20T07:02:31.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59e0b9d640 1 -- start start 2023-11-20T07:02:31.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59e0b9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc1597c0 0x7f59dc0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59e0b9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59dc159ba0 0x7f59dc0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59e0b9d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0723d0 con 0x7f59dc0adc10 2023-11-20T07:02:31.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59e0b9d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0717c0 con 0x7f59dc159ba0 2023-11-20T07:02:31.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59e0b9d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc071aa0 con 0x7f59dc1597c0 2023-11-20T07:02:31.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59d9d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59dc159ba0 0x7f59dc0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59d9d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59dc159ba0 0x7f59dc0cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40844/0 (socket says 172.21.15.88:40844) 2023-11-20T07:02:31.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59d9d9b640 1 -- 172.21.15.88:0/2504006680 learned_addr learned my addr 172.21.15.88:0/2504006680 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:31.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59da59c640 1 --2- 172.21.15.88:0/2504006680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc1597c0 0x7f59dc0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59d9d9b640 1 -- 172.21.15.88:0/2504006680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc1597c0 msgr2=0x7f59dc0ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:31.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59d9d9b640 1 --2- 172.21.15.88:0/2504006680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc1597c0 0x7f59dc0ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59d9d9b640 1 -- 172.21.15.88:0/2504006680 >> v1:172.21.15.175:6789/0 conn(0x7f59dc0adc10 legacy=0x7f59dc0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.265+0000 7f59d9d9b640 1 -- 172.21.15.88:0/2504006680 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc071d80 con 0x7f59dc159ba0 2023-11-20T07:02:31.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.269+0000 7f59d9d9b640 1 --2- 172.21.15.88:0/2504006680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59dc159ba0 0x7f59dc0cae10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009870 tx=0x7f59d001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a22f55011a48e3d server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:31.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.269+0000 7f59d959a640 1 -- 172.21.15.88:0/2504006680 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d00aa640 con 0x7f59dc159ba0 2023-11-20T07:02:31.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.269+0000 7f59d959a640 1 -- 172.21.15.88:0/2504006680 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d00aa7a0 con 0x7f59dc159ba0 2023-11-20T07:02:31.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.269+0000 7f59d959a640 1 -- 172.21.15.88:0/2504006680 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d00aab30 con 0x7f59dc159ba0 2023-11-20T07:02:31.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.269+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2504006680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59dc159ba0 msgr2=0x7f59dc0cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.269+0000 7f59e0b9d640 1 --2- 172.21.15.88:0/2504006680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59dc159ba0 0x7f59dc0cae10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009870 tx=0x7f59d001c540 comp rx=0 tx=0).stop 2023-11-20T07:02:31.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.269+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2504006680 shutdown_connections 2023-11-20T07:02:31.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.269+0000 7f59e0b9d640 1 --2- 172.21.15.88:0/2504006680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59dc159ba0 0x7f59dc0cae10 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.269+0000 7f59e0b9d640 1 --2- 172.21.15.88:0/2504006680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc1597c0 0x7f59dc0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.269+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2504006680 >> 172.21.15.88:0/2504006680 conn(0x7f59dc06c190 msgr2=0x7f59dc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:31.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.269+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2504006680 shutdown_connections 2023-11-20T07:02:31.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.269+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2504006680 wait complete. 2023-11-20T07:02:31.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59e0b9d640 1 Processor -- start 2023-11-20T07:02:31.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59e0b9d640 1 -- start start 2023-11-20T07:02:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59e0b9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc0adc10 0x7f59dc159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59e0b9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59dc1597c0 0x7f59dc0c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59e0b9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59dc159ba0 0x7f59dc15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59e0b9d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc15b120 con 0x7f59dc1597c0 2023-11-20T07:02:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59e0b9d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0c4780 con 0x7f59dc159ba0 2023-11-20T07:02:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59e0b9d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0ab870 con 0x7f59dc0adc10 2023-11-20T07:02:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59d9d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59dc1597c0 0x7f59dc0c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59d9d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59dc1597c0 0x7f59dc0c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40856/0 (socket says 172.21.15.88:40856) 2023-11-20T07:02:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59d9d9b640 1 -- 172.21.15.88:0/2950017793 learned_addr learned my addr 172.21.15.88:0/2950017793 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:31.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59da59c640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc0adc10 0x7f59dc159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59dad9d640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59dc159ba0 0x7f59dc15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59d9d9b640 1 -- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc0adc10 msgr2=0x7f59dc159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59d9d9b640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc0adc10 0x7f59dc159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59d9d9b640 1 -- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59dc159ba0 msgr2=0x7f59dc15b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59d9d9b640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59dc159ba0 0x7f59dc15b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59d9d9b640 1 -- 172.21.15.88:0/2950017793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d00094d0 con 0x7f59dc1597c0 2023-11-20T07:02:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59d9d9b640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59dc1597c0 0x7f59dc0c4240 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f59d00ac040 tx=0x7f59d001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59caffd640 1 -- 172.21.15.88:0/2950017793 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d00bd5f0 con 0x7f59dc1597c0 2023-11-20T07:02:31.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59caffd640 1 -- 172.21.15.88:0/2950017793 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d00bd770 con 0x7f59dc1597c0 2023-11-20T07:02:31.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2950017793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc15a5a0 con 0x7f59dc1597c0 2023-11-20T07:02:31.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59caffd640 1 -- 172.21.15.88:0/2950017793 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d00bdb20 con 0x7f59dc1597c0 2023-11-20T07:02:31.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.273+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2950017793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc15ab60 con 0x7f59dc1597c0 2023-11-20T07:02:31.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.277+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2950017793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc0ab9e0 con 0x7f59dc1597c0 2023-11-20T07:02:31.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.277+0000 7f59caffd640 1 -- 172.21.15.88:0/2950017793 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f59d00a8050 con 0x7f59dc1597c0 2023-11-20T07:02:31.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.277+0000 7f59caffd640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f59bc0664a0 0x7f59bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.277+0000 7f59caffd640 1 -- 172.21.15.88:0/2950017793 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f59d011e680 con 0x7f59dc1597c0 2023-11-20T07:02:31.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.277+0000 7f59da59c640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f59bc0664a0 0x7f59bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.277+0000 7f59da59c640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f59bc0664a0 0x7f59bc068960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f59cc007a60 tx=0x7f59cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:31.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.281+0000 7f59caffd640 1 -- 172.21.15.88:0/2950017793 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59d00ebb80 con 0x7f59dc1597c0 2023-11-20T07:02:31.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.433+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2950017793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59dc074010 con 0x7f59dc1597c0 2023-11-20T07:02:31.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.433+0000 7f59caffd640 1 -- 172.21.15.88:0/2950017793 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16738 (secure 0 0 0) 0x7f59d00ef1a0 con 0x7f59dc1597c0 2023-11-20T07:02:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:31.435 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":38,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:02:20.307946+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:02:17.053314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T07:02:17.706068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.437+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f59bc0664a0 msgr2=0x7f59bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.437+0000 7f59e0b9d640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f59bc0664a0 0x7f59bc068960 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f59cc007a60 tx=0x7f59cc008040 comp rx=0 tx=0).stop 2023-11-20T07:02:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.437+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2950017793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59dc1597c0 msgr2=0x7f59dc0c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.437+0000 7f59e0b9d640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59dc1597c0 0x7f59dc0c4240 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f59d00ac040 tx=0x7f59d001ad80 comp rx=0 tx=0).stop 2023-11-20T07:02:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.437+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2950017793 shutdown_connections 2023-11-20T07:02:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.437+0000 7f59e0b9d640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f59bc0664a0 0x7f59bc068960 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.437+0000 7f59e0b9d640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59dc159ba0 0x7f59dc15b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.437+0000 7f59e0b9d640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59dc1597c0 0x7f59dc0c4240 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.437+0000 7f59e0b9d640 1 --2- 172.21.15.88:0/2950017793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc0adc10 0x7f59dc159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.437+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2950017793 >> 172.21.15.88:0/2950017793 conn(0x7f59dc06c190 msgr2=0x7f59dc0af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.437+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2950017793 shutdown_connections 2023-11-20T07:02:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.437+0000 7f59e0b9d640 1 -- 172.21.15.88:0/2950017793 wait complete. 2023-11-20T07:02:31.455 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-20T07:02:31.456 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:02:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.593+0000 7f3432e09640 1 Processor -- start 2023-11-20T07:02:31.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.593+0000 7f3432e09640 1 -- start start 2023-11-20T07:02:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.593+0000 7f3432e09640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f342c15d690 0x7f342c15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.593+0000 7f3432e09640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342c15be60 con 0x7f342c0b07f0 2023-11-20T07:02:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.593+0000 7f3432e09640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342c15c1f0 con 0x7f342c070c40 2023-11-20T07:02:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.593+0000 7f3432e09640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342c15b3b0 con 0x7f342c15d690 2023-11-20T07:02:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.597+0000 7f3423fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f342c0b07f0 0x7f342c162480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53948/0 (socket says 172.21.15.88:53948) 2023-11-20T07:02:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.597+0000 7f3423fff640 1 -- 172.21.15.88:0/1478599457 learned_addr learned my addr 172.21.15.88:0/1478599457 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:31.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.597+0000 7f34313a6640 1 --2- 172.21.15.88:0/1478599457 >> v2:172.21.15.88:3300/0 conn(0x7f342c15d690 0x7f342c15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.597+0000 7f34237fe640 1 -- 172.21.15.88:0/1478599457 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722452789 0 0) 0x7f342c15be60 con 0x7f342c0b07f0 2023-11-20T07:02:31.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.597+0000 7f34237fe640 1 -- 172.21.15.88:0/1478599457 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3414003530 con 0x7f342c0b07f0 2023-11-20T07:02:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.597+0000 7f34313a6640 1 -- 172.21.15.88:0/1478599457 >> v1:172.21.15.175:6789/0 conn(0x7f342c070c40 legacy=0x7f342c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.597+0000 7f34313a6640 1 -- 172.21.15.88:0/1478599457 >> v1:172.21.15.88:6789/0 conn(0x7f342c0b07f0 legacy=0x7f342c162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.597+0000 7f34313a6640 1 -- 172.21.15.88:0/1478599457 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c071020 con 0x7f342c15d690 2023-11-20T07:02:31.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.597+0000 7f34313a6640 1 --2- 172.21.15.88:0/1478599457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342c15d690 0x7f342c15ae70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3424009d90 tx=0x7f342401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89eaedfa95b252ec server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:31.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.597+0000 7f34237fe640 1 -- 172.21.15.88:0/1478599457 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34240a5940 con 0x7f342c15d690 2023-11-20T07:02:31.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.597+0000 7f34237fe640 1 -- 172.21.15.88:0/1478599457 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34240a5aa0 con 0x7f342c15d690 2023-11-20T07:02:31.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.597+0000 7f34237fe640 1 -- 172.21.15.88:0/1478599457 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34240a5e30 con 0x7f342c15d690 2023-11-20T07:02:31.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 -- 172.21.15.88:0/1478599457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342c15d690 msgr2=0x7f342c15ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 --2- 172.21.15.88:0/1478599457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342c15d690 0x7f342c15ae70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3424009d90 tx=0x7f342401c880 comp rx=0 tx=0).stop 2023-11-20T07:02:31.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 -- 172.21.15.88:0/1478599457 shutdown_connections 2023-11-20T07:02:31.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 --2- 172.21.15.88:0/1478599457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342c15d690 0x7f342c15ae70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 -- 172.21.15.88:0/1478599457 >> 172.21.15.88:0/1478599457 conn(0x7f342c06c190 msgr2=0x7f342c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:31.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 -- 172.21.15.88:0/1478599457 shutdown_connections 2023-11-20T07:02:31.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 -- 172.21.15.88:0/1478599457 wait complete. 2023-11-20T07:02:31.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 Processor -- start 2023-11-20T07:02:31.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 -- start start 2023-11-20T07:02:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f342c070c40 0x7f342c1f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f342c0b07f0 0x7f342c151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342c15d690 0x7f342c0a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c151780 con 0x7f342c15d690 2023-11-20T07:02:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0aa920 con 0x7f342c070c40 2023-11-20T07:02:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3432e09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342c0aa640 con 0x7f342c0b07f0 2023-11-20T07:02:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f34313a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342c15d690 0x7f342c0a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f34313a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342c15d690 0x7f342c0a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40878/0 (socket says 172.21.15.88:40878) 2023-11-20T07:02:31.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f34313a6640 1 -- 172.21.15.88:0/3275796613 learned_addr learned my addr 172.21.15.88:0/3275796613 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3430ba5640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f342c070c40 0x7f342c1f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f3423fff640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f342c0b07f0 0x7f342c151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f34313a6640 1 -- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f342c0b07f0 msgr2=0x7f342c151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f34313a6640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f342c0b07f0 0x7f342c151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f34313a6640 1 -- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f342c070c40 msgr2=0x7f342c1f5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f34313a6640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f342c070c40 0x7f342c1f5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.601+0000 7f34313a6640 1 -- 172.21.15.88:0/3275796613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424009a70 con 0x7f342c15d690 2023-11-20T07:02:31.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.605+0000 7f34313a6640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342c15d690 0x7f342c0a9b80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f342401a4b0 tx=0x7f3424019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:31.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.605+0000 7f34217fa640 1 -- 172.21.15.88:0/3275796613 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34240adc60 con 0x7f342c15d690 2023-11-20T07:02:31.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.605+0000 7f34217fa640 1 -- 172.21.15.88:0/3275796613 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34240addc0 con 0x7f342c15d690 2023-11-20T07:02:31.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.605+0000 7f3432e09640 1 -- 172.21.15.88:0/3275796613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342c0aae00 con 0x7f342c15d690 2023-11-20T07:02:31.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.605+0000 7f34217fa640 1 -- 172.21.15.88:0/3275796613 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34240b7610 con 0x7f342c15d690 2023-11-20T07:02:31.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.605+0000 7f3432e09640 1 -- 172.21.15.88:0/3275796613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342c0ab3c0 con 0x7f342c15d690 2023-11-20T07:02:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.605+0000 7f3432e09640 1 -- 172.21.15.88:0/3275796613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342c0ab5b0 con 0x7f342c15d690 2023-11-20T07:02:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.605+0000 7f34217fa640 1 -- 172.21.15.88:0/3275796613 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f34240b4050 con 0x7f342c15d690 2023-11-20T07:02:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.605+0000 7f34217fa640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34180664a0 0x7f3418068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.605+0000 7f34217fa640 1 -- 172.21.15.88:0/3275796613 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f342411efe0 con 0x7f342c15d690 2023-11-20T07:02:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.605+0000 7f3430ba5640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34180664a0 0x7f3418068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.609+0000 7f3430ba5640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34180664a0 0x7f3418068960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3428007fd0 tx=0x7f3428007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:31.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.609+0000 7f34217fa640 1 -- 172.21.15.88:0/3275796613 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34240ec420 con 0x7f342c15d690 2023-11-20T07:02:31.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.789+0000 7f3432e09640 1 -- 172.21.15.88:0/3275796613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f342c074010 con 0x7f342c15d690 2023-11-20T07:02:31.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.789+0000 7f34217fa640 1 -- 172.21.15.88:0/3275796613 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f3424009450 con 0x7f342c15d690 2023-11-20T07:02:31.791 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:31.792 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/4055175580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4055175580},{"type":"v1","addr":"172.21.15.175:6836","nonce":4055175580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3966879465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3966879465},{"type":"v1","addr":"172.21.15.175:6837","nonce":3966879465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/2725430928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2725430928},{"type":"v1","addr":"172.21.15.88:6834","nonce":2725430928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:02:18.706402+0000","modified":"2023-11-20T07:02:21.724727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2477383155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2477383155},{"type":"v1","addr":"172.21.15.88:6835","nonce":2477383155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-20T07:02:31.792 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 18 2023-11-20T07:02:31.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.793+0000 7f3432e09640 1 -- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34180664a0 msgr2=0x7f3418068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.793+0000 7f3432e09640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34180664a0 0x7f3418068960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3428007fd0 tx=0x7f3428007e40 comp rx=0 tx=0).stop 2023-11-20T07:02:31.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.793+0000 7f3432e09640 1 -- 172.21.15.88:0/3275796613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342c15d690 msgr2=0x7f342c0a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.793+0000 7f3432e09640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342c15d690 0x7f342c0a9b80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f342401a4b0 tx=0x7f3424019620 comp rx=0 tx=0).stop 2023-11-20T07:02:31.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.793+0000 7f3432e09640 1 -- 172.21.15.88:0/3275796613 shutdown_connections 2023-11-20T07:02:31.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.793+0000 7f3432e09640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34180664a0 0x7f3418068960 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.793+0000 7f3432e09640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f342c0b07f0 0x7f342c151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.793+0000 7f3432e09640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342c15d690 0x7f342c0a9b80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.793+0000 7f3432e09640 1 --2- 172.21.15.88:0/3275796613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f342c070c40 0x7f342c1f5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.793+0000 7f3432e09640 1 -- 172.21.15.88:0/3275796613 >> 172.21.15.88:0/3275796613 conn(0x7f342c06c190 msgr2=0x7f342c0b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:31.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.793+0000 7f3432e09640 1 -- 172.21.15.88:0/3275796613 shutdown_connections 2023-11-20T07:02:31.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.793+0000 7f3432e09640 1 -- 172.21.15.88:0/3275796613 wait complete. 2023-11-20T07:02:31.813 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:02:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec591ab640 1 Processor -- start 2023-11-20T07:02:31.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec591ab640 1 -- start start 2023-11-20T07:02:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec591ab640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540b07f0 0x7fec5415ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec591ab640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec5415d690 0x7fec54164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec591ab640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5415be60 con 0x7fec54070c40 2023-11-20T07:02:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec591ab640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5415b3b0 con 0x7fec5415d690 2023-11-20T07:02:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec591ab640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5415c1f0 con 0x7fec540b07f0 2023-11-20T07:02:31.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec5359e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec5415d690 0x7fec54164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec52d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fec54070c40 0x7fec540b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53950/0 (socket says 172.21.15.88:53950) 2023-11-20T07:02:31.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec52d9d640 1 -- 172.21.15.88:0/3871812729 learned_addr learned my addr 172.21.15.88:0/3871812729 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:31.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec4bfff640 1 --2- 172.21.15.88:0/3871812729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540b07f0 0x7fec5415ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec5359e640 1 -- 172.21.15.88:0/3871812729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540b07f0 msgr2=0x7fec5415ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:31.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec5359e640 1 --2- 172.21.15.88:0/3871812729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540b07f0 0x7fec5415ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec5359e640 1 -- 172.21.15.88:0/3871812729 >> v1:172.21.15.88:6789/0 conn(0x7fec54070c40 legacy=0x7fec540b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec5359e640 1 -- 172.21.15.88:0/3871812729 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec54071020 con 0x7fec5415d690 2023-11-20T07:02:31.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.949+0000 7fec5259c640 1 -- 172.21.15.88:0/3871812729 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657959763 0 0) 0x7fec5415be60 con 0x7fec54070c40 2023-11-20T07:02:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.953+0000 7fec5359e640 1 --2- 172.21.15.88:0/3871812729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5415d690 0x7fec54164490 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009d90 tx=0x7fec4c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49e9029d99df09a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.953+0000 7fec5259c640 1 -- 172.21.15.88:0/3871812729 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c0a5980 con 0x7fec5415d690 2023-11-20T07:02:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.953+0000 7fec5259c640 1 -- 172.21.15.88:0/3871812729 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c0a5ae0 con 0x7fec5415d690 2023-11-20T07:02:31.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.953+0000 7fec5259c640 1 -- 172.21.15.88:0/3871812729 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c0a5e70 con 0x7fec5415d690 2023-11-20T07:02:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.953+0000 7fec591ab640 1 -- 172.21.15.88:0/3871812729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5415d690 msgr2=0x7fec54164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.953+0000 7fec591ab640 1 --2- 172.21.15.88:0/3871812729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5415d690 0x7fec54164490 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009d90 tx=0x7fec4c01c8c0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.953+0000 7fec591ab640 1 -- 172.21.15.88:0/3871812729 shutdown_connections 2023-11-20T07:02:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.953+0000 7fec591ab640 1 --2- 172.21.15.88:0/3871812729 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec5415d690 0x7fec54164490 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.953+0000 7fec591ab640 1 --2- 172.21.15.88:0/3871812729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec540b07f0 0x7fec5415ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.953+0000 7fec591ab640 1 -- 172.21.15.88:0/3871812729 >> 172.21.15.88:0/3871812729 conn(0x7fec5406c190 msgr2=0x7fec5406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.953+0000 7fec591ab640 1 -- 172.21.15.88:0/3871812729 shutdown_connections 2023-11-20T07:02:31.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.953+0000 7fec591ab640 1 -- 172.21.15.88:0/3871812729 wait complete. 2023-11-20T07:02:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec591ab640 1 Processor -- start 2023-11-20T07:02:31.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec591ab640 1 -- start start 2023-11-20T07:02:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec591ab640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec54070c40 0x7fec54150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec591ab640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540b07f0 0x7fec540c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec591ab640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5415d690 0x7fec54159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec591ab640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec540cd8f0 con 0x7fec54070c40 2023-11-20T07:02:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec591ab640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec540ccce0 con 0x7fec540b07f0 2023-11-20T07:02:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec591ab640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec540ccfc0 con 0x7fec5415d690 2023-11-20T07:02:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec52d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec54070c40 0x7fec54150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec52d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec54070c40 0x7fec54150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40886/0 (socket says 172.21.15.88:40886) 2023-11-20T07:02:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec52d9d640 1 -- 172.21.15.88:0/661553613 learned_addr learned my addr 172.21.15.88:0/661553613 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec5359e640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5415d690 0x7fec54159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec4bfff640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540b07f0 0x7fec540c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec52d9d640 1 -- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5415d690 msgr2=0x7fec54159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec52d9d640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5415d690 0x7fec54159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec52d9d640 1 -- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540b07f0 msgr2=0x7fec540c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec52d9d640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540b07f0 0x7fec540c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec52d9d640 1 -- 172.21.15.88:0/661553613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c009a70 con 0x7fec54070c40 2023-11-20T07:02:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec5359e640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5415d690 0x7fec54159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:31.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec52d9d640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec54070c40 0x7fec54150970 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fec440011f0 tx=0x7fec4400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:31.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec4b7fe640 1 -- 172.21.15.88:0/661553613 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec440074e0 con 0x7fec54070c40 2023-11-20T07:02:31.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec4b7fe640 1 -- 172.21.15.88:0/661553613 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec44007640 con 0x7fec54070c40 2023-11-20T07:02:31.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec591ab640 1 -- 172.21.15.88:0/661553613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec540cd2a0 con 0x7fec54070c40 2023-11-20T07:02:31.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec4b7fe640 1 -- 172.21.15.88:0/661553613 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec44004a10 con 0x7fec54070c40 2023-11-20T07:02:31.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.957+0000 7fec591ab640 1 -- 172.21.15.88:0/661553613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec54154f10 con 0x7fec54070c40 2023-11-20T07:02:31.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.961+0000 7fec591ab640 1 -- 172.21.15.88:0/661553613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec54074010 con 0x7fec54070c40 2023-11-20T07:02:31.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.961+0000 7fec4b7fe640 1 -- 172.21.15.88:0/661553613 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fec44004b70 con 0x7fec54070c40 2023-11-20T07:02:31.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.961+0000 7fec4b7fe640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fec340664a0 0x7fec34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:31.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.961+0000 7fec4b7fe640 1 -- 172.21.15.88:0/661553613 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fec440834d0 con 0x7fec54070c40 2023-11-20T07:02:31.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.961+0000 7fec4bfff640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fec340664a0 0x7fec34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:31.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.961+0000 7fec4bfff640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fec340664a0 0x7fec34068960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fec5415ef80 tx=0x7fec3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:31.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:31.965+0000 7fec4b7fe640 1 -- 172.21.15.88:0/661553613 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fec44050810 con 0x7fec54070c40 2023-11-20T07:02:32.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 -- 172.21.15.88:0/661553613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec540b0390 con 0x7fec54070c40 2023-11-20T07:02:32.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec4b7fe640 1 -- 172.21.15.88:0/661553613 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fec44053e30 con 0x7fec54070c40 2023-11-20T07:02:32.145 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:32.145 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/4055175580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4055175580},{"type":"v1","addr":"172.21.15.175:6836","nonce":4055175580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3966879465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3966879465},{"type":"v1","addr":"172.21.15.175:6837","nonce":3966879465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/2725430928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2725430928},{"type":"v1","addr":"172.21.15.88:6834","nonce":2725430928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-20T07:02:18.706402+0000","modified":"2023-11-20T07:02:21.724727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6835/2477383155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2477383155},{"type":"v1","addr":"172.21.15.88:6835","nonce":2477383155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-20T07:02:32.145 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 18 2023-11-20T07:02:32.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 -- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fec340664a0 msgr2=0x7fec34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:32.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fec340664a0 0x7fec34068960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fec5415ef80 tx=0x7fec3c008040 comp rx=0 tx=0).stop 2023-11-20T07:02:32.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 -- 172.21.15.88:0/661553613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec54070c40 msgr2=0x7fec54150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:32.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec54070c40 0x7fec54150970 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fec440011f0 tx=0x7fec4400c9b0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 -- 172.21.15.88:0/661553613 shutdown_connections 2023-11-20T07:02:32.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fec340664a0 0x7fec34068960 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec5415d690 0x7fec54159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec540b07f0 0x7fec540c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 --2- 172.21.15.88:0/661553613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec54070c40 0x7fec54150970 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 -- 172.21.15.88:0/661553613 >> 172.21.15.88:0/661553613 conn(0x7fec5406c190 msgr2=0x7fec540ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:32.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 -- 172.21.15.88:0/661553613 shutdown_connections 2023-11-20T07:02:32.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.145+0000 7fec591ab640 1 -- 172.21.15.88:0/661553613 wait complete. 2023-11-20T07:02:32.165 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.301+0000 7fe17ed0f640 1 Processor -- start 2023-11-20T07:02:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.301+0000 7fe17ed0f640 1 -- start start 2023-11-20T07:02:32.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.301+0000 7fe17ed0f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe17815a880 0x7fe17815dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:32.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.301+0000 7fe17ed0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1780cda30 0x7fe1780b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:32.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.301+0000 7fe17ed0f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17815e000 con 0x7fe1780b00e0 2023-11-20T07:02:32.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.301+0000 7fe17ed0f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1780b0ab0 con 0x7fe17815a880 2023-11-20T07:02:32.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.301+0000 7fe17ed0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780cb1d0 con 0x7fe1780cda30 2023-11-20T07:02:32.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.301+0000 7fe17caab640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe17815a880 0x7fe17815dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:32.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.301+0000 7fe17caab640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe17815a880 0x7fe17815dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40894/0 (socket says 172.21.15.88:40894) 2023-11-20T07:02:32.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.301+0000 7fe17caab640 1 -- 172.21.15.88:0/2887491270 learned_addr learned my addr 172.21.15.88:0/2887491270 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:32.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.301+0000 7fe17d2ac640 1 --2- 172.21.15.88:0/2887491270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1780cda30 0x7fe1780b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:32.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17caab640 1 -- 172.21.15.88:0/2887491270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1780cda30 msgr2=0x7fe1780b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:32.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17caab640 1 --2- 172.21.15.88:0/2887491270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1780cda30 0x7fe1780b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17caab640 1 -- 172.21.15.88:0/2887491270 >> v1:172.21.15.175:6789/0 conn(0x7fe1780b00e0 legacy=0x7fe178160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:32.305 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17caab640 1 -- 172.21.15.88:0/2887491270 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780cb4b0 con 0x7fe17815a880 2023-11-20T07:02:32.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17caab640 1 --2- 172.21.15.88:0/2887491270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe17815a880 0x7fe17815dac0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe17806ae80 tx=0x7fe17401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10416214a81729c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:32.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe16f7fe640 1 -- 172.21.15.88:0/2887491270 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740ab600 con 0x7fe17815a880 2023-11-20T07:02:32.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe16f7fe640 1 -- 172.21.15.88:0/2887491270 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1740a7050 con 0x7fe17815a880 2023-11-20T07:02:32.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe16f7fe640 1 -- 172.21.15.88:0/2887491270 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740ab980 con 0x7fe17815a880 2023-11-20T07:02:32.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2887491270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe17815a880 msgr2=0x7fe17815dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:32.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17ed0f640 1 --2- 172.21.15.88:0/2887491270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe17815a880 0x7fe17815dac0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe17806ae80 tx=0x7fe17401c4c0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2887491270 shutdown_connections 2023-11-20T07:02:32.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17ed0f640 1 --2- 172.21.15.88:0/2887491270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1780cda30 0x7fe1780b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17ed0f640 1 --2- 172.21.15.88:0/2887491270 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe17815a880 0x7fe17815dac0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2887491270 >> 172.21.15.88:0/2887491270 conn(0x7fe17806c190 msgr2=0x7fe17806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:32.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2887491270 shutdown_connections 2023-11-20T07:02:32.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.305+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2887491270 wait complete. 2023-11-20T07:02:32.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe17ed0f640 1 Processor -- start 2023-11-20T07:02:32.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe17ed0f640 1 -- start start 2023-11-20T07:02:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe17ed0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1780b00e0 0x7fe1780c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe17ed0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1780cda30 0x7fe17815bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe17ed0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe17815a880 0x7fe178157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe17ed0f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780c2900 con 0x7fe1780cda30 2023-11-20T07:02:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe17ed0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780c2be0 con 0x7fe1780b00e0 2023-11-20T07:02:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe17ed0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780c2ec0 con 0x7fe17815a880 2023-11-20T07:02:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe16ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1780cda30 0x7fe17815bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe16ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1780cda30 0x7fe17815bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40900/0 (socket says 172.21.15.88:40900) 2023-11-20T07:02:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe16ffff640 1 -- 172.21.15.88:0/2771363779 learned_addr learned my addr 172.21.15.88:0/2771363779 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe17d2ac640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe17815a880 0x7fe178157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe17caab640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1780b00e0 0x7fe1780c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe16ffff640 1 -- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe17815a880 msgr2=0x7fe178157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe16ffff640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe17815a880 0x7fe178157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe16ffff640 1 -- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1780b00e0 msgr2=0x7fe1780c1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe16ffff640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1780b00e0 0x7fe1780c1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe16ffff640 1 -- 172.21.15.88:0/2771363779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1740094d0 con 0x7fe1780cda30 2023-11-20T07:02:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe16ffff640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1780cda30 0x7fe17815bf60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c450 tx=0x7fe16800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe16d7fa640 1 -- 172.21.15.88:0/2771363779 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168012830 con 0x7fe1780cda30 2023-11-20T07:02:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe16d7fa640 1 -- 172.21.15.88:0/2771363779 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1680129b0 con 0x7fe1780cda30 2023-11-20T07:02:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe16d7fa640 1 -- 172.21.15.88:0/2771363779 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168012d60 con 0x7fe1780cda30 2023-11-20T07:02:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.309+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2771363779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1780c31a0 con 0x7fe1780cda30 2023-11-20T07:02:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.313+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2771363779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1780b25d0 con 0x7fe1780cda30 2023-11-20T07:02:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.313+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2771363779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1780cad80 con 0x7fe1780cda30 2023-11-20T07:02:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.313+0000 7fe16d7fa640 1 -- 172.21.15.88:0/2771363779 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe16801c460 con 0x7fe1780cda30 2023-11-20T07:02:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.313+0000 7fe16d7fa640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe1640664d0 0x7fe164068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.313+0000 7fe16d7fa640 1 -- 172.21.15.88:0/2771363779 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe168083cd0 con 0x7fe1780cda30 2023-11-20T07:02:32.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.313+0000 7fe17caab640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe1640664d0 0x7fe164068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:32.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.317+0000 7fe17caab640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe1640664d0 0x7fe164068990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe1740ad000 tx=0x7fe1740a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.317+0000 7fe16d7fa640 1 -- 172.21.15.88:0/2771363779 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe168051020 con 0x7fe1780cda30 2023-11-20T07:02:32.471 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.469+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2771363779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe178074010 con 0x7fe1780cda30 2023-11-20T07:02:32.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe16d7fa640 1 -- 172.21.15.88:0/2771363779 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16738 (secure 0 0 0) 0x7fe168054640 con 0x7fe1780cda30 2023-11-20T07:02:32.472 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:32.473 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":38,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:02:20.307946+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-20T07:02:17.053314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-20T07:02:17.706068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:32.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe1640664d0 msgr2=0x7fe164068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:32.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe17ed0f640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe1640664d0 0x7fe164068990 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe1740ad000 tx=0x7fe1740a6000 comp rx=0 tx=0).stop 2023-11-20T07:02:32.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2771363779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1780cda30 msgr2=0x7fe17815bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe17ed0f640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1780cda30 0x7fe17815bf60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe16800c450 tx=0x7fe16800c910 comp rx=0 tx=0).stop 2023-11-20T07:02:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2771363779 shutdown_connections 2023-11-20T07:02:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe17ed0f640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe1640664d0 0x7fe164068990 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe17ed0f640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe17815a880 0x7fe178157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe17ed0f640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1780cda30 0x7fe17815bf60 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe17ed0f640 1 --2- 172.21.15.88:0/2771363779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1780b00e0 0x7fe1780c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2771363779 >> 172.21.15.88:0/2771363779 conn(0x7fe17806c190 msgr2=0x7fe17815f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2771363779 shutdown_connections 2023-11-20T07:02:32.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.473+0000 7fe17ed0f640 1 -- 172.21.15.88:0/2771363779 wait complete. 2023-11-20T07:02:32.494 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-20T07:02:32.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.629+0000 7f24ffa17640 1 Processor -- start 2023-11-20T07:02:32.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24ffa17640 1 -- start start 2023-11-20T07:02:32.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24ffa17640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24f8070c40 0x7f24f815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24ffa17640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24f80b07f0 0x7f24f8164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24ffa17640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f815be60 con 0x7f24f80b4020 2023-11-20T07:02:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24ffa17640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f815b3b0 con 0x7f24f8070c40 2023-11-20T07:02:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24ffa17640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f815c1f0 con 0x7f24f80b07f0 2023-11-20T07:02:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24fd7b3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24f8070c40 0x7f24f815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24fd7b3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24f8070c40 0x7f24f815ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40908/0 (socket says 172.21.15.88:40908) 2023-11-20T07:02:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24fd7b3640 1 -- 172.21.15.88:0/2390595451 learned_addr learned my addr 172.21.15.88:0/2390595451 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24fd7b3640 1 -- 172.21.15.88:0/2390595451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24f80b07f0 msgr2=0x7f24f8164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24fd7b3640 1 --2- 172.21.15.88:0/2390595451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24f80b07f0 0x7f24f8164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24fd7b3640 1 -- 172.21.15.88:0/2390595451 >> v1:172.21.15.175:6789/0 conn(0x7f24f80b4020 legacy=0x7f24f80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:32.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.633+0000 7f24fd7b3640 1 -- 172.21.15.88:0/2390595451 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f8071020 con 0x7f24f8070c40 2023-11-20T07:02:32.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24fd7b3640 1 --2- 172.21.15.88:0/2390595451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24f8070c40 0x7f24f815ae70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009870 tx=0x7f24f401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2718f3019190ae56 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:32.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24effff640 1 -- 172.21.15.88:0/2390595451 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f40a7070 con 0x7f24f8070c40 2023-11-20T07:02:32.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24effff640 1 -- 172.21.15.88:0/2390595451 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f40ab430 con 0x7f24f8070c40 2023-11-20T07:02:32.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24effff640 1 -- 172.21.15.88:0/2390595451 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f40ab7c0 con 0x7f24f8070c40 2023-11-20T07:02:32.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24ffa17640 1 -- 172.21.15.88:0/2390595451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24f8070c40 msgr2=0x7f24f815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:32.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24ffa17640 1 --2- 172.21.15.88:0/2390595451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24f8070c40 0x7f24f815ae70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009870 tx=0x7f24f401c470 comp rx=0 tx=0).stop 2023-11-20T07:02:32.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24ffa17640 1 -- 172.21.15.88:0/2390595451 shutdown_connections 2023-11-20T07:02:32.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24ffa17640 1 --2- 172.21.15.88:0/2390595451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24f80b07f0 0x7f24f8164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24ffa17640 1 --2- 172.21.15.88:0/2390595451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24f8070c40 0x7f24f815ae70 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24ffa17640 1 -- 172.21.15.88:0/2390595451 >> 172.21.15.88:0/2390595451 conn(0x7f24f806c190 msgr2=0x7f24f806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:32.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24ffa17640 1 -- 172.21.15.88:0/2390595451 shutdown_connections 2023-11-20T07:02:32.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24ffa17640 1 -- 172.21.15.88:0/2390595451 wait complete. 2023-11-20T07:02:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24ffa17640 1 Processor -- start 2023-11-20T07:02:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.637+0000 7f24ffa17640 1 -- start start 2023-11-20T07:02:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24ffa17640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24f8070c40 0x7f24f814f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24ffa17640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24f80b07f0 0x7f24f80cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24ffa17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24f80b4020 0x7f24f80cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24ffa17640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f8150190 con 0x7f24f80b4020 2023-11-20T07:02:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24ffa17640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f80afc90 con 0x7f24f80b07f0 2023-11-20T07:02:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24ffa17640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f80c2190 con 0x7f24f8070c40 2023-11-20T07:02:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24fdfb4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24f80b4020 0x7f24f80cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24fdfb4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24f80b4020 0x7f24f80cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40910/0 (socket says 172.21.15.88:40910) 2023-11-20T07:02:32.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24fdfb4640 1 -- 172.21.15.88:0/3129321413 learned_addr learned my addr 172.21.15.88:0/3129321413 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24fcfb2640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24f80b07f0 0x7f24f80cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24fd7b3640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24f8070c40 0x7f24f814f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24fdfb4640 1 -- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24f8070c40 msgr2=0x7f24f814f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24fdfb4640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24f8070c40 0x7f24f814f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24fdfb4640 1 -- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24f80b07f0 msgr2=0x7f24f80cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24fdfb4640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24f80b07f0 0x7f24f80cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24fdfb4640 1 -- 172.21.15.88:0/3129321413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f40094d0 con 0x7f24f80b4020 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24fdfb4640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24f80b4020 0x7f24f80cc770 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f24f000b9e0 tx=0x7f24f000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24edffb640 1 -- 172.21.15.88:0/3129321413 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f000caa0 con 0x7f24f80b4020 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24edffb640 1 -- 172.21.15.88:0/3129321413 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f000cc20 con 0x7f24f80b4020 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24edffb640 1 -- 172.21.15.88:0/3129321413 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0014440 con 0x7f24f80b4020 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24ffa17640 1 -- 172.21.15.88:0/3129321413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f80c2470 con 0x7f24f80b4020 2023-11-20T07:02:32.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24ffa17640 1 -- 172.21.15.88:0/3129321413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f80c2a30 con 0x7f24f80b4020 2023-11-20T07:02:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.641+0000 7f24ffa17640 1 -- 172.21.15.88:0/3129321413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f8074010 con 0x7f24f80b4020 2023-11-20T07:02:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.645+0000 7f24edffb640 1 -- 172.21.15.88:0/3129321413 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f24f001d3b0 con 0x7f24f80b4020 2023-11-20T07:02:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.645+0000 7f24edffb640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f24dc0664a0 0x7f24dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.645+0000 7f24edffb640 1 -- 172.21.15.88:0/3129321413 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f24f0083ce0 con 0x7f24f80b4020 2023-11-20T07:02:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.645+0000 7f24fd7b3640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f24dc0664a0 0x7f24dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:32.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.645+0000 7f24fd7b3640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f24dc0664a0 0x7f24dc068960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f24f40af000 tx=0x7f24f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:32.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.649+0000 7f24edffb640 1 -- 172.21.15.88:0/3129321413 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f24f0051160 con 0x7f24f80b4020 2023-11-20T07:02:32.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.829+0000 7f24ffa17640 1 -- 172.21.15.88:0/3129321413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f24f80b0250 con 0x7f24f80b4020 2023-11-20T07:02:32.831 INFO:tasks.ceph.mon.a.smithi088.stderr:2023-11-20T07:02:32.829+0000 7f5e6f7b2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-20T07:02:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.837+0000 7f24edffb640 1 -- 172.21.15.88:0/3129321413 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f24f0019090 con 0x7f24f80b4020 2023-11-20T07:02:32.836 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-20T07:02:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.837+0000 7f24ffa17640 1 -- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f24dc0664a0 msgr2=0x7f24dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:32.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.837+0000 7f24ffa17640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f24dc0664a0 0x7f24dc068960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f24f40af000 tx=0x7f24f4008040 comp rx=0 tx=0).stop 2023-11-20T07:02:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.837+0000 7f24ffa17640 1 -- 172.21.15.88:0/3129321413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24f80b4020 msgr2=0x7f24f80cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.837+0000 7f24ffa17640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24f80b4020 0x7f24f80cc770 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f24f000b9e0 tx=0x7f24f000bea0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.837+0000 7f24ffa17640 1 -- 172.21.15.88:0/3129321413 shutdown_connections 2023-11-20T07:02:32.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.837+0000 7f24ffa17640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f24dc0664a0 0x7f24dc068960 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.837+0000 7f24ffa17640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24f80b4020 0x7f24f80cc770 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.837+0000 7f24ffa17640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24f80b07f0 0x7f24f80cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.837+0000 7f24ffa17640 1 --2- 172.21.15.88:0/3129321413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24f8070c40 0x7f24f814f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.837+0000 7f24ffa17640 1 -- 172.21.15.88:0/3129321413 >> 172.21.15.88:0/3129321413 conn(0x7f24f806c190 msgr2=0x7f24f80cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.841+0000 7f24ffa17640 1 -- 172.21.15.88:0/3129321413 shutdown_connections 2023-11-20T07:02:32.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:32.841+0000 7f24ffa17640 1 -- 172.21.15.88:0/3129321413 wait complete. 2023-11-20T07:02:32.843 INFO:tasks.ceph.mds.c.smithi088.stderr: -515> 2023-11-20T07:02:24.021+0000 7f150dfb4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-20T07:02:32.860 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-20T07:02:32.885 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-11-20T07:02:33.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01fd3e640 1 Processor -- start 2023-11-20T07:02:33.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01fd3e640 1 -- start start 2023-11-20T07:02:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01fd3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0180d0210 0x7fb0180d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01fd3e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180d1670 con 0x7fb01815cba0 2023-11-20T07:02:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01fd3e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0180d1950 con 0x7fb0180b84e0 2023-11-20T07:02:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01fd3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180d1460 con 0x7fb0180d0210 2023-11-20T07:02:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01dada640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb01815cba0 0x7fb0180cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53958/0 (socket says 172.21.15.88:53958) 2023-11-20T07:02:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01dada640 1 -- 172.21.15.88:0/2905717656 learned_addr learned my addr 172.21.15.88:0/2905717656 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:33.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227187005 0 0) 0x7fb0180d1670 con 0x7fb01815cba0 2023-11-20T07:02:33.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01d2d9640 1 --2- 172.21.15.88:0/2905717656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0180d0210 0x7fb0180d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:33.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb004003530 con 0x7fb01815cba0 2023-11-20T07:02:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503809168 0 0) 0x7fb004003530 con 0x7fb01815cba0 2023-11-20T07:02:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0180d0210 msgr2=0x7fb0180d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 --2- 172.21.15.88:0/2905717656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0180d0210 0x7fb0180d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 >> v1:172.21.15.175:6789/0 conn(0x7fb0180b84e0 legacy=0x7fb0180b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180d1c30 con 0x7fb01815cba0 2023-11-20T07:02:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fb014001680 con 0x7fb01815cba0 2023-11-20T07:02:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 >> v1:172.21.15.88:6789/0 conn(0x7fb01815cba0 legacy=0x7fb0180cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 --2- 172.21.15.88:0/2905717656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0040039b0 0x7fb004003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 --2- 172.21.15.88:0/2905717656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0180d0210 0x7fb0040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 --2- 172.21.15.88:0/2905717656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb004004d10 0x7fb004005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180d1460 con 0x7fb004004d10 2023-11-20T07:02:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00400ba70 con 0x7fb0040039b0 2023-11-20T07:02:33.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00400bc30 con 0x7fb0180d0210 2023-11-20T07:02:33.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01dada640 1 --2- 172.21.15.88:0/2905717656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0040039b0 0x7fb004003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:33.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01e2db640 1 --2- 172.21.15.88:0/2905717656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb004004d10 0x7fb004005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:33.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01d2d9640 1 --2- 172.21.15.88:0/2905717656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0180d0210 0x7fb0040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:33.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01e2db640 1 -- 172.21.15.88:0/2905717656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0180d0210 msgr2=0x7fb0040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:33.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.001+0000 7fb01e2db640 1 --2- 172.21.15.88:0/2905717656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0180d0210 0x7fb0040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:33.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01e2db640 1 -- 172.21.15.88:0/2905717656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0040039b0 msgr2=0x7fb004003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:33.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01e2db640 1 --2- 172.21.15.88:0/2905717656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0040039b0 0x7fb004003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:33.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01e2db640 1 -- 172.21.15.88:0/2905717656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb004003530 con 0x7fb004004d10 2023-11-20T07:02:33.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01e2db640 1 --2- 172.21.15.88:0/2905717656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb004004d10 0x7fb004005190 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb010001e40 tx=0x7fb01001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9adf21e4f54199 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:33.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010003b80 con 0x7fb004004d10 2023-11-20T07:02:33.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb010003ce0 con 0x7fb004004d10 2023-11-20T07:02:33.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01cad8640 1 -- 172.21.15.88:0/2905717656 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100052c0 con 0x7fb004004d10 2023-11-20T07:02:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01fd3e640 1 -- 172.21.15.88:0/2905717656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb004004d10 msgr2=0x7fb004005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01fd3e640 1 --2- 172.21.15.88:0/2905717656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb004004d10 0x7fb004005190 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb010001e40 tx=0x7fb01001c740 comp rx=0 tx=0).stop 2023-11-20T07:02:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01e2db640 1 -- 172.21.15.88:0/2905717656 reap_dead start 2023-11-20T07:02:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01fd3e640 1 -- 172.21.15.88:0/2905717656 shutdown_connections 2023-11-20T07:02:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01fd3e640 1 -- 172.21.15.88:0/2905717656 >> 172.21.15.88:0/2905717656 conn(0x7fb0180719c0 msgr2=0x7fb018071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01fd3e640 1 -- 172.21.15.88:0/2905717656 shutdown_connections 2023-11-20T07:02:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.005+0000 7fb01fd3e640 1 -- 172.21.15.88:0/2905717656 wait complete. 2023-11-20T07:02:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01fd3e640 1 Processor -- start 2023-11-20T07:02:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01fd3e640 1 -- start start 2023-11-20T07:02:33.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01fd3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb004004d10 0x7fb01815cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:33.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01fd3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0181569f0 0x7fb01815d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:33.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01fd3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb018158000 0x7fb01815f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:33.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01fd3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018156f60 con 0x7fb004004d10 2023-11-20T07:02:33.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01fd3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018157240 con 0x7fb018158000 2023-11-20T07:02:33.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01fd3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb018157520 con 0x7fb0181569f0 2023-11-20T07:02:33.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01dada640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb004004d10 0x7fb01815cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:33.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01dada640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb004004d10 0x7fb01815cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40932/0 (socket says 172.21.15.88:40932) 2023-11-20T07:02:33.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01dada640 1 -- 172.21.15.88:0/244004618 learned_addr learned my addr 172.21.15.88:0/244004618 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:33.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01d2d9640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0181569f0 0x7fb01815d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:33.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01e2db640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb018158000 0x7fb01815f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:33.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01dada640 1 -- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0181569f0 msgr2=0x7fb01815d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:33.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01dada640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0181569f0 0x7fb01815d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:33.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01dada640 1 -- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb018158000 msgr2=0x7fb01815f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:33.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01dada640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb018158000 0x7fb01815f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:33.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01dada640 1 -- 172.21.15.88:0/244004618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018157800 con 0x7fb004004d10 2023-11-20T07:02:33.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01dada640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb004004d10 0x7fb01815cf80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb0140072c0 tx=0x7fb014007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:33.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb00e7fc640 1 -- 172.21.15.88:0/244004618 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0140014b0 con 0x7fb004004d10 2023-11-20T07:02:33.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb00e7fc640 1 -- 172.21.15.88:0/244004618 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01400f9c0 con 0x7fb004004d10 2023-11-20T07:02:33.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01fd3e640 1 -- 172.21.15.88:0/244004618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb018157ae0 con 0x7fb004004d10 2023-11-20T07:02:33.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb00e7fc640 1 -- 172.21.15.88:0/244004618 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400fd50 con 0x7fb004004d10 2023-11-20T07:02:33.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.009+0000 7fb01fd3e640 1 -- 172.21.15.88:0/244004618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01815fc30 con 0x7fb004004d10 2023-11-20T07:02:33.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.013+0000 7fb01fd3e640 1 -- 172.21.15.88:0/244004618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01804e170 con 0x7fb004004d10 2023-11-20T07:02:33.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.013+0000 7fb00e7fc640 1 -- 172.21.15.88:0/244004618 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb01401d460 con 0x7fb004004d10 2023-11-20T07:02:33.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.013+0000 7fb00e7fc640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faffc0664a0 0x7faffc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:33.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.013+0000 7fb00e7fc640 1 -- 172.21.15.88:0/244004618 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fb014084210 con 0x7fb004004d10 2023-11-20T07:02:33.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.013+0000 7fb01d2d9640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faffc0664a0 0x7faffc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:33.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.017+0000 7fb01d2d9640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faffc0664a0 0x7faffc068960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb018148750 tx=0x7fb008008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:33.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.017+0000 7fb00e7fc640 1 -- 172.21.15.88:0/244004618 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb014051580 con 0x7fb004004d10 2023-11-20T07:02:33.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.201+0000 7fb01fd3e640 1 -- 172.21.15.88:0/244004618 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb0180d06e0 con 0x7fb004004d10 2023-11-20T07:02:33.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.837+0000 7fb00e7fc640 1 -- 172.21.15.88:0/244004618 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb014054ba0 con 0x7fb004004d10 2023-11-20T07:02:33.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.841+0000 7fb01fd3e640 1 -- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faffc0664a0 msgr2=0x7faffc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.841+0000 7fb01fd3e640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faffc0664a0 0x7faffc068960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb018148750 tx=0x7fb008008040 comp rx=0 tx=0).stop 2023-11-20T07:02:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.841+0000 7fb01fd3e640 1 -- 172.21.15.88:0/244004618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb004004d10 msgr2=0x7fb01815cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.841+0000 7fb01fd3e640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb004004d10 0x7fb01815cf80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb0140072c0 tx=0x7fb014007780 comp rx=0 tx=0).stop 2023-11-20T07:02:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.841+0000 7fb01fd3e640 1 -- 172.21.15.88:0/244004618 shutdown_connections 2023-11-20T07:02:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.841+0000 7fb01fd3e640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7faffc0664a0 0x7faffc068960 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.841+0000 7fb01fd3e640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0181569f0 0x7fb01815d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.841+0000 7fb01fd3e640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb018158000 0x7fb01815f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.841+0000 7fb01fd3e640 1 --2- 172.21.15.88:0/244004618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb004004d10 0x7fb01815cf80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.841+0000 7fb01fd3e640 1 -- 172.21.15.88:0/244004618 >> 172.21.15.88:0/244004618 conn(0x7fb0180719c0 msgr2=0x7fb018158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.841+0000 7fb01fd3e640 1 -- 172.21.15.88:0/244004618 shutdown_connections 2023-11-20T07:02:33.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:33.841+0000 7fb01fd3e640 1 -- 172.21.15.88:0/244004618 wait complete. 2023-11-20T07:02:33.862 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-20T07:02:34.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.045+0000 7f8446417640 1 Processor -- start 2023-11-20T07:02:34.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.045+0000 7f8446417640 1 -- start start 2023-11-20T07:02:34.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f8446417640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84401441a0 0x7f84400b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:34.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f8446417640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f84400cb530 0x7f84400c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:34.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f8446417640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844015e5f0 con 0x7f84400b1a90 2023-11-20T07:02:34.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f8446417640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84400b1f20 con 0x7f84400cb530 2023-11-20T07:02:34.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f8446417640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f844015e8d0 con 0x7f84401441a0 2023-11-20T07:02:34.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f84449b4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f84400cb530 0x7f84400c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:34.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f843f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f84400b1a90 0x7f84400cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53966/0 (socket says 172.21.15.88:53966) 2023-11-20T07:02:34.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f84449b4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f84400cb530 0x7f84400c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40936/0 (socket says 172.21.15.88:40936) 2023-11-20T07:02:34.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f843f7fe640 1 -- 172.21.15.88:0/1745189364 learned_addr learned my addr 172.21.15.88:0/1745189364 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:34.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f843ffff640 1 --2- 172.21.15.88:0/1745189364 >> v2:172.21.15.175:3300/0 conn(0x7f84401441a0 0x7f84400b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:34.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f84449b4640 1 -- 172.21.15.88:0/1745189364 >> v2:172.21.15.175:3300/0 conn(0x7f84401441a0 msgr2=0x7f84400b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:34.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f84449b4640 1 --2- 172.21.15.88:0/1745189364 >> v2:172.21.15.175:3300/0 conn(0x7f84401441a0 0x7f84400b1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:34.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f84449b4640 1 -- 172.21.15.88:0/1745189364 >> v1:172.21.15.88:6789/0 conn(0x7f84400b1a90 legacy=0x7f84400cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:34.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.049+0000 7f84449b4640 1 -- 172.21.15.88:0/1745189364 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844015ebb0 con 0x7f84400cb530 2023-11-20T07:02:34.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f84449b4640 1 --2- 172.21.15.88:0/1745189364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84400cb530 0x7f84400c8fc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f84400cc0c0 tx=0x7f843801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4588a9d509e670 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:34.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f843effd640 1 -- 172.21.15.88:0/1745189364 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84380a57d0 con 0x7f84400cb530 2023-11-20T07:02:34.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f843effd640 1 -- 172.21.15.88:0/1745189364 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84380a5930 con 0x7f84400cb530 2023-11-20T07:02:34.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f843effd640 1 -- 172.21.15.88:0/1745189364 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84380a5cc0 con 0x7f84400cb530 2023-11-20T07:02:34.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f8446417640 1 -- 172.21.15.88:0/1745189364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84400cb530 msgr2=0x7f84400c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:34.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f8446417640 1 --2- 172.21.15.88:0/1745189364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84400cb530 0x7f84400c8fc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f84400cc0c0 tx=0x7f843801c910 comp rx=0 tx=0).stop 2023-11-20T07:02:34.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f8446417640 1 -- 172.21.15.88:0/1745189364 shutdown_connections 2023-11-20T07:02:34.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f8446417640 1 --2- 172.21.15.88:0/1745189364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84400cb530 0x7f84400c8fc0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:34.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f8446417640 1 --2- 172.21.15.88:0/1745189364 >> v2:172.21.15.175:3300/0 conn(0x7f84401441a0 0x7f84400b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:34.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f8446417640 1 -- 172.21.15.88:0/1745189364 >> 172.21.15.88:0/1745189364 conn(0x7f844006a820 msgr2=0x7f84400b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:34.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f8446417640 1 -- 172.21.15.88:0/1745189364 shutdown_connections 2023-11-20T07:02:34.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f8446417640 1 -- 172.21.15.88:0/1745189364 wait complete. 2023-11-20T07:02:34.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f8446417640 1 Processor -- start 2023-11-20T07:02:34.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f8446417640 1 -- start start 2023-11-20T07:02:34.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f8446417640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84400b1a90 0x7f844015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:34.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.053+0000 7f8446417640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84400cb530 0x7f844015b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:34.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f8446417640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84401441a0 0x7f84400c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:34.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f8446417640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8440140740 con 0x7f84400b1a90 2023-11-20T07:02:34.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f8446417640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400cd0d0 con 0x7f84401441a0 2023-11-20T07:02:34.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f8446417640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844015df80 con 0x7f84400cb530 2023-11-20T07:02:34.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84400b1a90 0x7f844015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:34.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84400b1a90 0x7f844015da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40950/0 (socket says 172.21.15.88:40950) 2023-11-20T07:02:34.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843ffff640 1 -- 172.21.15.88:0/1833298058 learned_addr learned my addr 172.21.15.88:0/1833298058 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:34.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843ffff640 1 -- 172.21.15.88:0/1833298058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84400cb530 msgr2=0x7f844015b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:34.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843ffff640 1 --2- 172.21.15.88:0/1833298058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84400cb530 0x7f844015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:34.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843ffff640 1 -- 172.21.15.88:0/1833298058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84401441a0 msgr2=0x7f84400c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:34.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843ffff640 1 --2- 172.21.15.88:0/1833298058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84401441a0 0x7f84400c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:34.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843ffff640 1 -- 172.21.15.88:0/1833298058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8438009a70 con 0x7f84400b1a90 2023-11-20T07:02:34.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843ffff640 1 --2- 172.21.15.88:0/1833298058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84400b1a90 0x7f844015da40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f843000c7f0 tx=0x7f843000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:34.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843cff9640 1 -- 172.21.15.88:0/1833298058 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430007820 con 0x7f84400b1a90 2023-11-20T07:02:34.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843cff9640 1 -- 172.21.15.88:0/1833298058 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8430007980 con 0x7f84400b1a90 2023-11-20T07:02:34.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f8446417640 1 -- 172.21.15.88:0/1833298058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8440140950 con 0x7f84400b1a90 2023-11-20T07:02:34.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843cff9640 1 -- 172.21.15.88:0/1833298058 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430007d30 con 0x7f84400b1a90 2023-11-20T07:02:34.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f8446417640 1 -- 172.21.15.88:0/1833298058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84400ccd60 con 0x7f84400b1a90 2023-11-20T07:02:34.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f8446417640 1 -- 172.21.15.88:0/1833298058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8440140e70 con 0x7f84400b1a90 2023-11-20T07:02:34.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.057+0000 7f843cff9640 1 -- 172.21.15.88:0/1833298058 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f84300113f0 con 0x7f84400b1a90 2023-11-20T07:02:34.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.061+0000 7f843cff9640 1 --2- 172.21.15.88:0/1833298058 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f842c0664a0 0x7f842c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:34.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.061+0000 7f843cff9640 1 -- 172.21.15.88:0/1833298058 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f8430084390 con 0x7f84400b1a90 2023-11-20T07:02:34.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.061+0000 7f843f7fe640 1 --2- 172.21.15.88:0/1833298058 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f842c0664a0 0x7f842c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:34.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.061+0000 7f843f7fe640 1 --2- 172.21.15.88:0/1833298058 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f842c0664a0 0x7f842c068960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f84400b4000 tx=0x7f8434007a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:34.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.065+0000 7f843cff9640 1 -- 172.21.15.88:0/1833298058 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84300515d0 con 0x7f84400b1a90 2023-11-20T07:02:34.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.213+0000 7f8446417640 1 -- 172.21.15.88:0/1833298058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f844004e170 con 0x7f84400b1a90 2023-11-20T07:02:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f843cff9640 1 -- 172.21.15.88:0/1833298058 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8430054bf0 con 0x7f84400b1a90 2023-11-20T07:02:34.841 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2023-11-20T07:02:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f8446417640 1 -- 172.21.15.88:0/1833298058 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f842c0664a0 msgr2=0x7f842c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f8446417640 1 --2- 172.21.15.88:0/1833298058 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f842c0664a0 0x7f842c068960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f84400b4000 tx=0x7f8434007a50 comp rx=0 tx=0).stop 2023-11-20T07:02:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f8446417640 1 -- 172.21.15.88:0/1833298058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84400b1a90 msgr2=0x7f844015da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f8446417640 1 --2- 172.21.15.88:0/1833298058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84400b1a90 0x7f844015da40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f843000c7f0 tx=0x7f843000ccb0 comp rx=0 tx=0).stop 2023-11-20T07:02:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f8446417640 1 -- 172.21.15.88:0/1833298058 shutdown_connections 2023-11-20T07:02:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f8446417640 1 --2- 172.21.15.88:0/1833298058 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f842c0664a0 0x7f842c068960 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f8446417640 1 --2- 172.21.15.88:0/1833298058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84400cb530 0x7f844015b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f8446417640 1 --2- 172.21.15.88:0/1833298058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84401441a0 0x7f84400c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f8446417640 1 --2- 172.21.15.88:0/1833298058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84400b1a90 0x7f844015da40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f8446417640 1 -- 172.21.15.88:0/1833298058 >> 172.21.15.88:0/1833298058 conn(0x7f844006a820 msgr2=0x7f8440070380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f8446417640 1 -- 172.21.15.88:0/1833298058 shutdown_connections 2023-11-20T07:02:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:34.841+0000 7f8446417640 1 -- 172.21.15.88:0/1833298058 wait complete. 2023-11-20T07:02:34.869 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-20T07:02:35.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.009+0000 7f31cb194640 1 Processor -- start 2023-11-20T07:02:35.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.009+0000 7f31cb194640 1 -- start start 2023-11-20T07:02:35.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31cb194640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31c406a5a0 0x7f31c406e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:35.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31cb194640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c415ce60 0x7f31c4160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:35.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31cb194640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c40b1830 con 0x7f31c415ca80 2023-11-20T07:02:35.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31cb194640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c406e660 con 0x7f31c406a5a0 2023-11-20T07:02:35.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31cb194640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c406d9a0 con 0x7f31c415ce60 2023-11-20T07:02:35.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31bbfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31c406a5a0 0x7f31c406e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:35.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31c9731640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c415ce60 0x7f31c4160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:35.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31c8f30640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f31c415ca80 0x7f31c4069e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:60686/0 (socket says 172.21.15.88:60686) 2023-11-20T07:02:35.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31c8f30640 1 -- 172.21.15.88:0/3766300758 learned_addr learned my addr 172.21.15.88:0/3766300758 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:35.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31c9731640 1 -- 172.21.15.88:0/3766300758 >> v2:172.21.15.175:3300/0 conn(0x7f31c406a5a0 msgr2=0x7f31c406e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:35.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31c9731640 1 --2- 172.21.15.88:0/3766300758 >> v2:172.21.15.175:3300/0 conn(0x7f31c406a5a0 0x7f31c406e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:35.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31c9731640 1 -- 172.21.15.88:0/3766300758 >> v1:172.21.15.175:6789/0 conn(0x7f31c415ca80 legacy=0x7f31c4069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:35.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31c9731640 1 -- 172.21.15.88:0/3766300758 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c406dc80 con 0x7f31c415ce60 2023-11-20T07:02:35.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.013+0000 7f31bbfff640 1 --2- 172.21.15.88:0/3766300758 >> v2:172.21.15.175:3300/0 conn(0x7f31c406a5a0 0x7f31c406e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:35.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31c9731640 1 --2- 172.21.15.88:0/3766300758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c415ce60 0x7f31c4160790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009d90 tx=0x7f31bc01f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ce4972e5371e4d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:35.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31bb7fe640 1 -- 172.21.15.88:0/3766300758 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0af600 con 0x7f31c415ce60 2023-11-20T07:02:35.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31bb7fe640 1 -- 172.21.15.88:0/3766300758 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc0ab050 con 0x7f31c415ce60 2023-11-20T07:02:35.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31bb7fe640 1 -- 172.21.15.88:0/3766300758 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0af980 con 0x7f31c415ce60 2023-11-20T07:02:35.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31cb194640 1 -- 172.21.15.88:0/3766300758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c415ce60 msgr2=0x7f31c4160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:35.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31cb194640 1 --2- 172.21.15.88:0/3766300758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c415ce60 0x7f31c4160790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009d90 tx=0x7f31bc01f130 comp rx=0 tx=0).stop 2023-11-20T07:02:35.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31cb194640 1 -- 172.21.15.88:0/3766300758 shutdown_connections 2023-11-20T07:02:35.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31cb194640 1 --2- 172.21.15.88:0/3766300758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c415ce60 0x7f31c4160790 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:35.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31cb194640 1 --2- 172.21.15.88:0/3766300758 >> v2:172.21.15.175:3300/0 conn(0x7f31c406a5a0 0x7f31c406e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:35.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31cb194640 1 -- 172.21.15.88:0/3766300758 >> 172.21.15.88:0/3766300758 conn(0x7f31c406b5a0 msgr2=0x7f31c40cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:35.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31cb194640 1 -- 172.21.15.88:0/3766300758 shutdown_connections 2023-11-20T07:02:35.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31cb194640 1 -- 172.21.15.88:0/3766300758 wait complete. 2023-11-20T07:02:35.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31cb194640 1 Processor -- start 2023-11-20T07:02:35.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.017+0000 7f31cb194640 1 -- start start 2023-11-20T07:02:35.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31cb194640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31c406a5a0 0x7f31c41f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:35.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31cb194640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c415ca80 0x7f31c40b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:35.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31cb194640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31c415ce60 0x7f31c41570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31cb194640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40b4a00 con 0x7f31c415ce60 2023-11-20T07:02:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31cb194640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40b3df0 con 0x7f31c406a5a0 2023-11-20T07:02:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31cb194640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40b40d0 con 0x7f31c415ca80 2023-11-20T07:02:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31c9731640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31c415ce60 0x7f31c41570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31c9731640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31c415ce60 0x7f31c41570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40966/0 (socket says 172.21.15.88:40966) 2023-11-20T07:02:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31c9731640 1 -- 172.21.15.88:0/3001984646 learned_addr learned my addr 172.21.15.88:0/3001984646 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31bbfff640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c415ca80 0x7f31c40b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31c8f30640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31c406a5a0 0x7f31c41f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31c9731640 1 -- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c415ca80 msgr2=0x7f31c40b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31c9731640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c415ca80 0x7f31c40b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31c9731640 1 -- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31c406a5a0 msgr2=0x7f31c41f59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:35.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31c9731640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31c406a5a0 0x7f31c41f59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31c9731640 1 -- 172.21.15.88:0/3001984646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b4009420 con 0x7f31c415ce60 2023-11-20T07:02:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31c9731640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31c415ce60 0x7f31c41570d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0b2040 tx=0x7f31bc01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31b97fa640 1 -- 172.21.15.88:0/3001984646 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc009450 con 0x7f31c415ce60 2023-11-20T07:02:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31b97fa640 1 -- 172.21.15.88:0/3001984646 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc0b9410 con 0x7f31c415ce60 2023-11-20T07:02:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31b97fa640 1 -- 172.21.15.88:0/3001984646 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0b97a0 con 0x7f31c415ce60 2023-11-20T07:02:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31cb194640 1 -- 172.21.15.88:0/3001984646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc009a70 con 0x7f31c415ce60 2023-11-20T07:02:35.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31cb194640 1 -- 172.21.15.88:0/3001984646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c40b4690 con 0x7f31c415ce60 2023-11-20T07:02:35.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31cb194640 1 -- 172.21.15.88:0/3001984646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c40b4b70 con 0x7f31c415ce60 2023-11-20T07:02:35.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.021+0000 7f31b97fa640 1 -- 172.21.15.88:0/3001984646 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f31bc0b6050 con 0x7f31c415ce60 2023-11-20T07:02:35.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.025+0000 7f31b97fa640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31b00664a0 0x7f31b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:35.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.025+0000 7f31b97fa640 1 -- 172.21.15.88:0/3001984646 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f31bc122350 con 0x7f31c415ce60 2023-11-20T07:02:35.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.025+0000 7f31c8f30640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31b00664a0 0x7f31b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:35.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.025+0000 7f31c8f30640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31b00664a0 0x7f31b0068960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f31c0005890 tx=0x7f31c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:35.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.029+0000 7f31b97fa640 1 -- 172.21.15.88:0/3001984646 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f31bc0ef7d0 con 0x7f31c415ce60 2023-11-20T07:02:35.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.177+0000 7f31cb194640 1 -- 172.21.15.88:0/3001984646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31c404e170 con 0x7f31c415ce60 2023-11-20T07:02:35.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.849+0000 7f31b97fa640 1 -- 172.21.15.88:0/3001984646 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7f31bc0b40d0 con 0x7f31c415ce60 2023-11-20T07:02:35.851 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2023-11-20T07:02:35.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.853+0000 7f31cb194640 1 -- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31b00664a0 msgr2=0x7f31b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:35.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.853+0000 7f31cb194640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31b00664a0 0x7f31b0068960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f31c0005890 tx=0x7f31c0009040 comp rx=0 tx=0).stop 2023-11-20T07:02:35.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.853+0000 7f31cb194640 1 -- 172.21.15.88:0/3001984646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31c415ce60 msgr2=0x7f31c41570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:35.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.853+0000 7f31cb194640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31c415ce60 0x7f31c41570d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0b2040 tx=0x7f31bc01bed0 comp rx=0 tx=0).stop 2023-11-20T07:02:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.853+0000 7f31cb194640 1 -- 172.21.15.88:0/3001984646 shutdown_connections 2023-11-20T07:02:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.853+0000 7f31cb194640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f31b00664a0 0x7f31b0068960 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.857+0000 7f31cb194640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c415ca80 0x7f31c40b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:35.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.857+0000 7f31cb194640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f31c415ce60 0x7f31c41570d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.857+0000 7f31cb194640 1 --2- 172.21.15.88:0/3001984646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31c406a5a0 0x7f31c41f59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.857+0000 7f31cb194640 1 -- 172.21.15.88:0/3001984646 >> 172.21.15.88:0/3001984646 conn(0x7f31c406b5a0 msgr2=0x7f31c415a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.857+0000 7f31cb194640 1 -- 172.21.15.88:0/3001984646 shutdown_connections 2023-11-20T07:02:35.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:35.857+0000 7f31cb194640 1 -- 172.21.15.88:0/3001984646 wait complete. 2023-11-20T07:02:35.882 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-20T07:02:36.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81acc46640 1 Processor -- start 2023-11-20T07:02:36.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81acc46640 1 -- start start 2023-11-20T07:02:36.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81acc46640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81a806a5a0 0x7f81a806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:36.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81acc46640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f81a80b3f00 0x7f81a80c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:36.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81acc46640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a80b4370 con 0x7f81a8159900 2023-11-20T07:02:36.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81acc46640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80cd740 con 0x7f81a806a5a0 2023-11-20T07:02:36.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81acc46640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80b4600 con 0x7f81a80b3f00 2023-11-20T07:02:36.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81a5d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81a806a5a0 0x7f81a806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:36.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81a5d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f81a806a5a0 0x7f81a806e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40978/0 (socket says 172.21.15.88:40978) 2023-11-20T07:02:36.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81a5d9b640 1 -- 172.21.15.88:0/561512536 learned_addr learned my addr 172.21.15.88:0/561512536 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:36.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81a6d9d640 1 --2- 172.21.15.88:0/561512536 >> v2:172.21.15.175:3300/0 conn(0x7f81a80b3f00 0x7f81a80c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:36.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81a5d9b640 1 -- 172.21.15.88:0/561512536 >> v2:172.21.15.175:3300/0 conn(0x7f81a80b3f00 msgr2=0x7f81a80c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:36.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81a5d9b640 1 --2- 172.21.15.88:0/561512536 >> v2:172.21.15.175:3300/0 conn(0x7f81a80b3f00 0x7f81a80c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81a5d9b640 1 -- 172.21.15.88:0/561512536 >> v1:172.21.15.175:6789/0 conn(0x7f81a8159900 legacy=0x7f81a8069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:36.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81a5d9b640 1 -- 172.21.15.88:0/561512536 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80c8dd0 con 0x7f81a806a5a0 2023-11-20T07:02:36.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.021+0000 7f81a6d9d640 1 --2- 172.21.15.88:0/561512536 >> v2:172.21.15.175:3300/0 conn(0x7f81a80b3f00 0x7f81a80c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:36.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.025+0000 7f81a5d9b640 1 --2- 172.21.15.88:0/561512536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a806a5a0 0x7f81a806e260 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f81a806afc0 tx=0x7f819c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0dfa67ef316cb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.025+0000 7f81a559a640 1 -- 172.21.15.88:0/561512536 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0aa430 con 0x7f81a806a5a0 2023-11-20T07:02:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.025+0000 7f81a559a640 1 -- 172.21.15.88:0/561512536 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c0aa590 con 0x7f81a806a5a0 2023-11-20T07:02:36.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.025+0000 7f81a559a640 1 -- 172.21.15.88:0/561512536 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0aa920 con 0x7f81a806a5a0 2023-11-20T07:02:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.025+0000 7f81acc46640 1 -- 172.21.15.88:0/561512536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a806a5a0 msgr2=0x7f81a806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.025+0000 7f81acc46640 1 --2- 172.21.15.88:0/561512536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a806a5a0 0x7f81a806e260 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f81a806afc0 tx=0x7f819c01c4d0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.025+0000 7f81acc46640 1 -- 172.21.15.88:0/561512536 shutdown_connections 2023-11-20T07:02:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.025+0000 7f81acc46640 1 --2- 172.21.15.88:0/561512536 >> v2:172.21.15.175:3300/0 conn(0x7f81a80b3f00 0x7f81a80c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.025+0000 7f81acc46640 1 --2- 172.21.15.88:0/561512536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a806a5a0 0x7f81a806e260 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.025+0000 7f81acc46640 1 -- 172.21.15.88:0/561512536 >> 172.21.15.88:0/561512536 conn(0x7f81a80b0da0 msgr2=0x7f81a80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.025+0000 7f81acc46640 1 -- 172.21.15.88:0/561512536 shutdown_connections 2023-11-20T07:02:36.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.025+0000 7f81acc46640 1 -- 172.21.15.88:0/561512536 wait complete. 2023-11-20T07:02:36.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81acc46640 1 Processor -- start 2023-11-20T07:02:36.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81acc46640 1 -- start start 2023-11-20T07:02:36.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81acc46640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81a806a5a0 0x7f81a814af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:36.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81acc46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b3f00 0x7f81a81462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81acc46640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81a8159900 0x7f81a814c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81acc46640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a814dbd0 con 0x7f81a80b3f00 2023-11-20T07:02:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81acc46640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a814cfc0 con 0x7f81a8159900 2023-11-20T07:02:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81acc46640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a814d2a0 con 0x7f81a806a5a0 2023-11-20T07:02:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81a5d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b3f00 0x7f81a81462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81a5d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b3f00 0x7f81a81462b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40982/0 (socket says 172.21.15.88:40982) 2023-11-20T07:02:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81a5d9b640 1 -- 172.21.15.88:0/889088796 learned_addr learned my addr 172.21.15.88:0/889088796 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81a6d9d640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81a8159900 0x7f81a814c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81a659c640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81a806a5a0 0x7f81a814af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:36.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81a5d9b640 1 -- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81a806a5a0 msgr2=0x7f81a814af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:36.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81a5d9b640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81a806a5a0 0x7f81a814af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81a5d9b640 1 -- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81a8159900 msgr2=0x7f81a814c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:36.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81a5d9b640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81a8159900 0x7f81a814c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81a5d9b640 1 -- 172.21.15.88:0/889088796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c0094d0 con 0x7f81a80b3f00 2023-11-20T07:02:36.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81a659c640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81a806a5a0 0x7f81a814af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:36.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81a5d9b640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b3f00 0x7f81a81462b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f819c0190e0 tx=0x7f819c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:36.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f8196ffd640 1 -- 172.21.15.88:0/889088796 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0b3800 con 0x7f81a80b3f00 2023-11-20T07:02:36.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f8196ffd640 1 -- 172.21.15.88:0/889088796 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c0b3960 con 0x7f81a80b3f00 2023-11-20T07:02:36.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81acc46640 1 -- 172.21.15.88:0/889088796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a814d580 con 0x7f81a80b3f00 2023-11-20T07:02:36.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f8196ffd640 1 -- 172.21.15.88:0/889088796 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0b3cf0 con 0x7f81a80b3f00 2023-11-20T07:02:36.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81acc46640 1 -- 172.21.15.88:0/889088796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a81467f0 con 0x7f81a80b3f00 2023-11-20T07:02:36.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.029+0000 7f81acc46640 1 -- 172.21.15.88:0/889088796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a804e170 con 0x7f81a80b3f00 2023-11-20T07:02:36.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.033+0000 7f8196ffd640 1 -- 172.21.15.88:0/889088796 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f819c0b2380 con 0x7f81a80b3f00 2023-11-20T07:02:36.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.033+0000 7f8196ffd640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f81880664a0 0x7f8188068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:36.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.033+0000 7f8196ffd640 1 -- 172.21.15.88:0/889088796 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f819c11dc40 con 0x7f81a80b3f00 2023-11-20T07:02:36.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.033+0000 7f81a659c640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f81880664a0 0x7f8188068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:36.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.033+0000 7f81a659c640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f81880664a0 0x7f8188068960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8198000f70 tx=0x7f8198009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:36.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.037+0000 7f8196ffd640 1 -- 172.21.15.88:0/889088796 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f819c0eb1e0 con 0x7f81a80b3f00 2023-11-20T07:02:36.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.193+0000 7f81acc46640 1 -- 172.21.15.88:0/889088796 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f81a806b380 con 0x7f81a80b3f00 2023-11-20T07:02:36.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f8196ffd640 1 -- 172.21.15.88:0/889088796 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f819c0ee800 con 0x7f81a80b3f00 2023-11-20T07:02:36.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f81acc46640 1 -- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f81880664a0 msgr2=0x7f8188068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:36.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f81acc46640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f81880664a0 0x7f8188068960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8198000f70 tx=0x7f8198009040 comp rx=0 tx=0).stop 2023-11-20T07:02:36.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f81acc46640 1 -- 172.21.15.88:0/889088796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b3f00 msgr2=0x7f81a81462b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:36.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f81acc46640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b3f00 0x7f81a81462b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f819c0190e0 tx=0x7f819c01ad10 comp rx=0 tx=0).stop 2023-11-20T07:02:36.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f81acc46640 1 -- 172.21.15.88:0/889088796 shutdown_connections 2023-11-20T07:02:36.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f81acc46640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f81880664a0 0x7f8188068960 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f81acc46640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81a8159900 0x7f81a814c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f81acc46640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81a80b3f00 0x7f81a81462b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f81acc46640 1 --2- 172.21.15.88:0/889088796 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81a806a5a0 0x7f81a814af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f81acc46640 1 -- 172.21.15.88:0/889088796 >> 172.21.15.88:0/889088796 conn(0x7f81a80b0da0 msgr2=0x7f81a80ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:36.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f81acc46640 1 -- 172.21.15.88:0/889088796 shutdown_connections 2023-11-20T07:02:36.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.197+0000 7f81acc46640 1 -- 172.21.15.88:0/889088796 wait complete. 2023-11-20T07:02:36.219 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection' 2023-11-20T07:02:36.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.353+0000 7f28b18a9640 1 Processor -- start 2023-11-20T07:02:36.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.353+0000 7f28b18a9640 1 -- start start 2023-11-20T07:02:36.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28b18a9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28ac15cb90 0x7f28ac0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:36.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28b18a9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f28ac0d3010 0x7f28ac0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:36.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28b18a9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac0d1850 con 0x7f28ac0d1400 2023-11-20T07:02:36.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28b18a9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac0ce770 con 0x7f28ac15cb90 2023-11-20T07:02:36.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28b18a9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac0d0600 con 0x7f28ac0d3010 2023-11-20T07:02:36.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28aaffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28ac15cb90 0x7f28ac0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:36.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28aaffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28ac15cb90 0x7f28ac0cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49996/0 (socket says 172.21.15.88:49996) 2023-11-20T07:02:36.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28aaffd640 1 -- 172.21.15.88:0/3578960935 learned_addr learned my addr 172.21.15.88:0/3578960935 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:36.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28a27fc640 1 --2- 172.21.15.88:0/3578960935 >> v2:172.21.15.175:3300/0 conn(0x7f28ac0d3010 0x7f28ac0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:36.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28aaffd640 1 -- 172.21.15.88:0/3578960935 >> v2:172.21.15.175:3300/0 conn(0x7f28ac0d3010 msgr2=0x7f28ac0d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:36.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28aaffd640 1 --2- 172.21.15.88:0/3578960935 >> v2:172.21.15.175:3300/0 conn(0x7f28ac0d3010 0x7f28ac0d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28aaffd640 1 -- 172.21.15.88:0/3578960935 >> v1:172.21.15.88:6789/0 conn(0x7f28ac0d1400 legacy=0x7f28ac0cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:36.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.357+0000 7f28aaffd640 1 -- 172.21.15.88:0/3578960935 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac0c6450 con 0x7f28ac15cb90 2023-11-20T07:02:36.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28aaffd640 1 --2- 172.21.15.88:0/3578960935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ac15cb90 0x7f28ac0cfb10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f28ac08a880 tx=0x7f289c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940c449912a882a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:36.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28aa7fc640 1 -- 172.21.15.88:0/3578960935 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c0a5830 con 0x7f28ac15cb90 2023-11-20T07:02:36.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28aa7fc640 1 -- 172.21.15.88:0/3578960935 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c0a5990 con 0x7f28ac15cb90 2023-11-20T07:02:36.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28aa7fc640 1 -- 172.21.15.88:0/3578960935 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c0a5d20 con 0x7f28ac15cb90 2023-11-20T07:02:36.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28b18a9640 1 -- 172.21.15.88:0/3578960935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ac15cb90 msgr2=0x7f28ac0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:36.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28b18a9640 1 --2- 172.21.15.88:0/3578960935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ac15cb90 0x7f28ac0cfb10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f28ac08a880 tx=0x7f289c01c970 comp rx=0 tx=0).stop 2023-11-20T07:02:36.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28b18a9640 1 -- 172.21.15.88:0/3578960935 shutdown_connections 2023-11-20T07:02:36.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28b18a9640 1 --2- 172.21.15.88:0/3578960935 >> v2:172.21.15.175:3300/0 conn(0x7f28ac0d3010 0x7f28ac0d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28b18a9640 1 --2- 172.21.15.88:0/3578960935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ac15cb90 0x7f28ac0cfb10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28b18a9640 1 -- 172.21.15.88:0/3578960935 >> 172.21.15.88:0/3578960935 conn(0x7f28ac09bc50 msgr2=0x7f28ac0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:36.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28b18a9640 1 -- 172.21.15.88:0/3578960935 shutdown_connections 2023-11-20T07:02:36.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28b18a9640 1 -- 172.21.15.88:0/3578960935 wait complete. 2023-11-20T07:02:36.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28b18a9640 1 Processor -- start 2023-11-20T07:02:36.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.361+0000 7f28b18a9640 1 -- start start 2023-11-20T07:02:36.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28b18a9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ac0d1400 0x7f28ac15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28b18a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28ac0d3010 0x7f28ac14b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28b18a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28ac15cb90 0x7f28ac06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28b18a9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac15b810 con 0x7f28ac0d1400 2023-11-20T07:02:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28b18a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac15ac30 con 0x7f28ac0d3010 2023-11-20T07:02:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28b18a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac151500 con 0x7f28ac15cb90 2023-11-20T07:02:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28aaffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ac0d1400 0x7f28ac15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28aaffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ac0d1400 0x7f28ac15a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50008/0 (socket says 172.21.15.88:50008) 2023-11-20T07:02:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28aaffd640 1 -- 172.21.15.88:0/171868581 learned_addr learned my addr 172.21.15.88:0/171868581 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28aaffd640 1 -- 172.21.15.88:0/171868581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28ac15cb90 msgr2=0x7f28ac06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28aaffd640 1 --2- 172.21.15.88:0/171868581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28ac15cb90 0x7f28ac06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28aaffd640 1 -- 172.21.15.88:0/171868581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28ac0d3010 msgr2=0x7f28ac14b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:36.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28aaffd640 1 --2- 172.21.15.88:0/171868581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28ac0d3010 0x7f28ac14b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28aaffd640 1 -- 172.21.15.88:0/171868581 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c009b30 con 0x7f28ac0d1400 2023-11-20T07:02:36.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28aaffd640 1 --2- 172.21.15.88:0/171868581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ac0d1400 0x7f28ac15a6f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f289c0af040 tx=0x7f289c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:36.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28a8ff9640 1 -- 172.21.15.88:0/171868581 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c0b8670 con 0x7f28ac0d1400 2023-11-20T07:02:36.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28a8ff9640 1 -- 172.21.15.88:0/171868581 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c0b8810 con 0x7f28ac0d1400 2023-11-20T07:02:36.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28a8ff9640 1 -- 172.21.15.88:0/171868581 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c0b8bc0 con 0x7f28ac0d1400 2023-11-20T07:02:36.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28b18a9640 1 -- 172.21.15.88:0/171868581 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac1517e0 con 0x7f28ac0d1400 2023-11-20T07:02:36.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28b18a9640 1 -- 172.21.15.88:0/171868581 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac151da0 con 0x7f28ac0d1400 2023-11-20T07:02:36.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28b18a9640 1 -- 172.21.15.88:0/171868581 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac074010 con 0x7f28ac0d1400 2023-11-20T07:02:36.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28a8ff9640 1 -- 172.21.15.88:0/171868581 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f289c006d50 con 0x7f28ac0d1400 2023-11-20T07:02:36.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.365+0000 7f28a8ff9640 1 --2- 172.21.15.88:0/171868581 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f288c0664a0 0x7f288c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:36.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.369+0000 7f28a8ff9640 1 -- 172.21.15.88:0/171868581 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f289c11ee30 con 0x7f28ac0d1400 2023-11-20T07:02:36.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.369+0000 7f28a27fc640 1 --2- 172.21.15.88:0/171868581 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f288c0664a0 0x7f288c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:36.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.369+0000 7f28a27fc640 1 --2- 172.21.15.88:0/171868581 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f288c0664a0 0x7f288c068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f28ac1551d0 tx=0x7f2894008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:36.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.369+0000 7f28a8ff9640 1 -- 172.21.15.88:0/171868581 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f289c0ec4f0 con 0x7f28ac0d1400 2023-11-20T07:02:36.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.581+0000 7f28b18a9640 1 -- 172.21.15.88:0/171868581 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]} v 0) v1 -- 0x7f28ac158f30 con 0x7f28ac0d1400 2023-11-20T07:02:36.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.853+0000 7f28a8ff9640 1 -- 172.21.15.88:0/171868581 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]}]=0 v121) v1 ==== 145+0+0 (secure 0 0 0) 0x7f289c0efb10 con 0x7f28ac0d1400 2023-11-20T07:02:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.853+0000 7f28b18a9640 1 -- 172.21.15.88:0/171868581 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f288c0664a0 msgr2=0x7f288c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.853+0000 7f28b18a9640 1 --2- 172.21.15.88:0/171868581 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f288c0664a0 0x7f288c068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f28ac1551d0 tx=0x7f2894008040 comp rx=0 tx=0).stop 2023-11-20T07:02:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.857+0000 7f28b18a9640 1 -- 172.21.15.88:0/171868581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ac0d1400 msgr2=0x7f28ac15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.857+0000 7f28b18a9640 1 --2- 172.21.15.88:0/171868581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ac0d1400 0x7f28ac15a6f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f289c0af040 tx=0x7f289c019710 comp rx=0 tx=0).stop 2023-11-20T07:02:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.857+0000 7f28b18a9640 1 -- 172.21.15.88:0/171868581 shutdown_connections 2023-11-20T07:02:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.857+0000 7f28b18a9640 1 --2- 172.21.15.88:0/171868581 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f288c0664a0 0x7f288c068960 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.857+0000 7f28b18a9640 1 --2- 172.21.15.88:0/171868581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28ac15cb90 0x7f28ac06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.857+0000 7f28b18a9640 1 --2- 172.21.15.88:0/171868581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28ac0d3010 0x7f28ac14b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.857+0000 7f28b18a9640 1 --2- 172.21.15.88:0/171868581 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28ac0d1400 0x7f28ac15a6f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:36.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.857+0000 7f28b18a9640 1 -- 172.21.15.88:0/171868581 >> 172.21.15.88:0/171868581 conn(0x7f28ac09bc50 msgr2=0x7f28ac0b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:36.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.857+0000 7f28b18a9640 1 -- 172.21.15.88:0/171868581 shutdown_connections 2023-11-20T07:02:36.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:36.857+0000 7f28b18a9640 1 -- 172.21.15.88:0/171868581 wait complete. 2023-11-20T07:02:36.876 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. ... ERROR 2023-11-20T07:02:36.876 INFO:tasks.cephfs_test_runner: 2023-11-20T07:02:36.877 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-20T07:02:36.877 INFO:tasks.cephfs_test_runner:ERROR: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-20T07:02:36.877 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-11-20T07:02:36.877 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-20T07:02:36.877 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-20T07:02:36.877 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa/tasks/cephfs/test_data_scan.py", line 530, in test_fragmented_injection 2023-11-20T07:02:36.877 INFO:tasks.cephfs_test_runner: self.fs.mon_manager.run_cluster_cmd('config', 'set', 'mds', 2023-11-20T07:02:36.877 INFO:tasks.cephfs_test_runner:TypeError: run_cluster_cmd() takes 1 positional argument but 6 were given 2023-11-20T07:02:36.877 INFO:tasks.cephfs_test_runner: 2023-11-20T07:02:36.877 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-20T07:02:36.877 INFO:tasks.cephfs_test_runner:Ran 1 test in 52.934s 2023-11-20T07:02:36.877 INFO:tasks.cephfs_test_runner: 2023-11-20T07:02:36.878 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-20T07:02:36.878 INFO:tasks.cephfs_test_runner: 2023-11-20T07:02:36.878 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-20T07:02:36.878 INFO:tasks.cephfs_test_runner:ERROR: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-20T07:02:36.878 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-11-20T07:02:36.878 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-20T07:02:36.878 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-20T07:02:36.878 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa/tasks/cephfs/test_data_scan.py", line 530, in test_fragmented_injection 2023-11-20T07:02:36.878 INFO:tasks.cephfs_test_runner: self.fs.mon_manager.run_cluster_cmd('config', 'set', 'mds', 2023-11-20T07:02:36.878 INFO:tasks.cephfs_test_runner:TypeError: run_cluster_cmd() takes 1 positional argument but 6 were given 2023-11-20T07:02:36.878 INFO:tasks.cephfs_test_runner: 2023-11-20T07:02:36.879 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-20T07:02:37.004 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b9bb5078c7f34f2daffcf8ce1bd3e10a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_dc2d87c1fc8f518422f0be9931df0b31dc6a3bad/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-20T07:02:37.005 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-20T07:02:37.014 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-20T07:02:37.069 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-20T07:02:37.069 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:02:37.070 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:02:37.092 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2590 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-20T07:02:37.092 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-11-20T07:02:37.092 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:02:37.144 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354672k,nr_inodes=4088668,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2590 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-20T07:02:37.144 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:02:37.144 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:02:37.154 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9391 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-20T07:02:37.155 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-20T07:02:37.155 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-20T07:02:37.207 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9391 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-20T07:02:37.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:37.208 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-11-20T07:02:37.260 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-20T07:02:37.260 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-20T07:02:37.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:37.260 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-20T07:02:37.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:37.325 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-20T07:02:37.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:37.403 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2023-11-20T07:02:37.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:37.593 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-11-20T07:02:37.603 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-20T07:02:37.603 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-20T07:02:37.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:37.604 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-20T07:02:37.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:37.671 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-20T07:02:37.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-20T07:02:37.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-11-20T07:02:38.131 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-20T07:02:38.140 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-20T07:02:38.140 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T07:02:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.281+0000 7fe697017640 1 Processor -- start 2023-11-20T07:02:38.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.281+0000 7fe697017640 1 -- start start 2023-11-20T07:02:38.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.281+0000 7fe697017640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe6900d3010 0x7fe6900cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.281+0000 7fe697017640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6900ce770 con 0x7fe69015cb90 2023-11-20T07:02:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.281+0000 7fe697017640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6900d0600 con 0x7fe6900d15d0 2023-11-20T07:02:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.281+0000 7fe697017640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6900c6450 con 0x7fe6900d3010 2023-11-20T07:02:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.281+0000 7fe694db3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe69015cb90 0x7fe6900d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55834/0 (socket says 172.21.15.88:55834) 2023-11-20T07:02:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.281+0000 7fe694db3640 1 -- 172.21.15.88:0/766395539 learned_addr learned my addr 172.21.15.88:0/766395539 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.281+0000 7fe6955b4640 1 --2- 172.21.15.88:0/766395539 >> v2:172.21.15.88:3300/0 conn(0x7fe6900d3010 0x7fe6900cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.281+0000 7fe6955b4640 1 -- 172.21.15.88:0/766395539 >> v1:172.21.15.175:6789/0 conn(0x7fe6900d15d0 legacy=0x7fe6900c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.281+0000 7fe6955b4640 1 -- 172.21.15.88:0/766395539 >> v1:172.21.15.88:6789/0 conn(0x7fe69015cb90 legacy=0x7fe6900d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.281+0000 7fe6955b4640 1 -- 172.21.15.88:0/766395539 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900d08a0 con 0x7fe6900d3010 2023-11-20T07:02:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe6955b4640 1 --2- 172.21.15.88:0/766395539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6900d3010 0x7fe6900cfb10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe688009d90 tx=0x7fe68801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477548c8ac26f35a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe68f7fe640 1 -- 172.21.15.88:0/766395539 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6880a5950 con 0x7fe6900d3010 2023-11-20T07:02:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe68f7fe640 1 -- 172.21.15.88:0/766395539 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6880a5ab0 con 0x7fe6900d3010 2023-11-20T07:02:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe68f7fe640 1 -- 172.21.15.88:0/766395539 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6880a5e40 con 0x7fe6900d3010 2023-11-20T07:02:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe697017640 1 -- 172.21.15.88:0/766395539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6900d3010 msgr2=0x7fe6900cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe697017640 1 --2- 172.21.15.88:0/766395539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6900d3010 0x7fe6900cfb10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe688009d90 tx=0x7fe68801c890 comp rx=0 tx=0).stop 2023-11-20T07:02:38.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe697017640 1 -- 172.21.15.88:0/766395539 shutdown_connections 2023-11-20T07:02:38.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe697017640 1 --2- 172.21.15.88:0/766395539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6900d3010 0x7fe6900cfb10 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe697017640 1 -- 172.21.15.88:0/766395539 >> 172.21.15.88:0/766395539 conn(0x7fe69009bc50 msgr2=0x7fe6900d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:38.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe697017640 1 -- 172.21.15.88:0/766395539 shutdown_connections 2023-11-20T07:02:38.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe697017640 1 -- 172.21.15.88:0/766395539 wait complete. 2023-11-20T07:02:38.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe697017640 1 Processor -- start 2023-11-20T07:02:38.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.285+0000 7fe697017640 1 -- start start 2023-11-20T07:02:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe697017640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6900d15d0 0x7fe69015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe697017640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6900d3010 0x7fe690154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe697017640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69015cb90 0x7fe6900cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe697017640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900cab50 con 0x7fe69015cb90 2023-11-20T07:02:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe697017640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe690156be0 con 0x7fe6900d3010 2023-11-20T07:02:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe697017640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900cad60 con 0x7fe6900d15d0 2023-11-20T07:02:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe6955b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69015cb90 0x7fe6900cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe6955b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69015cb90 0x7fe6900cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50014/0 (socket says 172.21.15.88:50014) 2023-11-20T07:02:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe6955b4640 1 -- 172.21.15.88:0/1280880893 learned_addr learned my addr 172.21.15.88:0/1280880893 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe68ffff640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6900d3010 0x7fe690154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe694db3640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6900d15d0 0x7fe69015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe6955b4640 1 -- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6900d15d0 msgr2=0x7fe69015ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe6955b4640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6900d15d0 0x7fe69015ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe6955b4640 1 -- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6900d3010 msgr2=0x7fe690154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe6955b4640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6900d3010 0x7fe690154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe6955b4640 1 -- 172.21.15.88:0/1280880893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe688009a70 con 0x7fe69015cb90 2023-11-20T07:02:38.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe6955b4640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69015cb90 0x7fe6900cbe00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe6880b0040 tx=0x7fe688019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:38.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe68d7fa640 1 -- 172.21.15.88:0/1280880893 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6880ade40 con 0x7fe69015cb90 2023-11-20T07:02:38.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe68d7fa640 1 -- 172.21.15.88:0/1280880893 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6880b9450 con 0x7fe69015cb90 2023-11-20T07:02:38.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe697017640 1 -- 172.21.15.88:0/1280880893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6900cb040 con 0x7fe69015cb90 2023-11-20T07:02:38.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe68d7fa640 1 -- 172.21.15.88:0/1280880893 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6880b9800 con 0x7fe69015cb90 2023-11-20T07:02:38.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe697017640 1 -- 172.21.15.88:0/1280880893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6900cb600 con 0x7fe69015cb90 2023-11-20T07:02:38.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.289+0000 7fe697017640 1 -- 172.21.15.88:0/1280880893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6900d38a0 con 0x7fe69015cb90 2023-11-20T07:02:38.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.293+0000 7fe68d7fa640 1 -- 172.21.15.88:0/1280880893 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe6880b9960 con 0x7fe69015cb90 2023-11-20T07:02:38.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.293+0000 7fe68d7fa640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6740664a0 0x7fe674068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.293+0000 7fe68d7fa640 1 -- 172.21.15.88:0/1280880893 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe68811f620 con 0x7fe69015cb90 2023-11-20T07:02:38.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.293+0000 7fe694db3640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6740664a0 0x7fe674068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.293+0000 7fe694db3640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6740664a0 0x7fe674068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe6840010f0 tx=0x7fe684009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:38.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.297+0000 7fe68d7fa640 1 -- 172.21.15.88:0/1280880893 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe6880ecd10 con 0x7fe69015cb90 2023-11-20T07:02:38.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.441+0000 7fe697017640 1 -- 172.21.15.88:0/1280880893 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe69015cf70 con 0x7fe6740664a0 2023-11-20T07:02:38.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.445+0000 7fe68d7fa640 1 -- 172.21.15.88:0/1280880893 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50655 (secure 0 0 0) 0x7fe6840013c0 con 0x7fe6740664a0 2023-11-20T07:02:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:38.447 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-20T07:02:38.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.445+0000 7fe697017640 1 -- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6740664a0 msgr2=0x7fe674068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.445+0000 7fe697017640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6740664a0 0x7fe674068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe6840010f0 tx=0x7fe684009040 comp rx=0 tx=0).stop 2023-11-20T07:02:38.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.449+0000 7fe697017640 1 -- 172.21.15.88:0/1280880893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69015cb90 msgr2=0x7fe6900cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.449+0000 7fe697017640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69015cb90 0x7fe6900cbe00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe6880b0040 tx=0x7fe688019630 comp rx=0 tx=0).stop 2023-11-20T07:02:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.449+0000 7fe697017640 1 -- 172.21.15.88:0/1280880893 shutdown_connections 2023-11-20T07:02:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.449+0000 7fe697017640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe6740664a0 0x7fe674068960 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.449+0000 7fe697017640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe69015cb90 0x7fe6900cbe00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.449+0000 7fe697017640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6900d3010 0x7fe690154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.449+0000 7fe697017640 1 --2- 172.21.15.88:0/1280880893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6900d15d0 0x7fe69015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.449+0000 7fe697017640 1 -- 172.21.15.88:0/1280880893 >> 172.21.15.88:0/1280880893 conn(0x7fe69009bc50 msgr2=0x7fe6900d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.449+0000 7fe697017640 1 -- 172.21.15.88:0/1280880893 shutdown_connections 2023-11-20T07:02:38.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.449+0000 7fe697017640 1 -- 172.21.15.88:0/1280880893 wait complete. 2023-11-20T07:02:38.467 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-11-20T07:02:37.556968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":221012,"kb_used_data":4832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753708,"statfs":{"total":773094113280,"available":772867796992,"internally_reserved":0,"allocated":4947968,"data_stored":2801464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2850,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-46,"num_write_kb":-15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000954"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-20T07:02:35.483616+0000","last_change":"2023-11-20T07:00:43.158695+0000","last_active":"2023-11-20T07:02:35.483616+0000","last_peered":"2023-11-20T07:02:35.483616+0000","last_clean":"2023-11-20T07:02:35.483616+0000","last_became_active":"2023-11-20T07:00:43.157454+0000","last_became_peered":"2023-11-20T07:00:43.157454+0000","last_unstale":"2023-11-20T07:02:35.483616+0000","last_undegraded":"2023-11-20T07:02:35.483616+0000","last_fullsized":"2023-11-20T07:02:35.483616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_clean_scrub_stamp":"2023-11-20T07:00:42.001721+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:44:20.907460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":798228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.63100000000000001}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.82199999999999995}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.83799999999999997}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.79500000000000004}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.71299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":201950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.69299999999999995}]},{"osd":1,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":0.625},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.754}]},{"osd":3,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.4830000000000001,"5min":2.4830000000000001,"15min":2.4830000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.73399999999999999}]},{"osd":4,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.499}]},{"osd":5,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.85299999999999998}]},{"osd":7,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.74299999999999999}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.60299999999999998}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.63100000000000001}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.52200000000000002}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.70599999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.75600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":201950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.752},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.69299999999999995}]},{"osd":1,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.79200000000000004}]},{"osd":3,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.83299999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.82099999999999995}]},{"osd":7,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.84899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":201950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.45000000000000001}]},{"osd":1,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.434},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.51400000000000001}]},{"osd":4,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.55200000000000005}]},{"osd":6,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.629},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.56499999999999995}]},{"osd":7,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.59299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":195639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.442}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.497}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47499999999999998}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79300000000000004}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.82699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":195659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.31}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.371},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.46600000000000003}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.495},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.751}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":798228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.504}]},{"osd":2,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.371}]},{"osd":3,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.67800000000000005}]},{"osd":7,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.70099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T07:02:38.469 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T07:02:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.605+0000 7f64485b8640 1 Processor -- start 2023-11-20T07:02:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.605+0000 7f64485b8640 1 -- start start 2023-11-20T07:02:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f64485b8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64400b07f0 0x7f644015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f64485b8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f644015d690 0x7f6440164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f64485b8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644015be60 con 0x7f6440070c40 2023-11-20T07:02:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f64485b8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644015b3b0 con 0x7f644015d690 2023-11-20T07:02:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f64485b8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644015c1f0 con 0x7f64400b07f0 2023-11-20T07:02:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f6446b55640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f644015d690 0x7f6440164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f6445b53640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64400b07f0 0x7f644015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f6446b55640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f644015d690 0x7f6440164490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:39360/0 (socket says 172.21.15.88:39360) 2023-11-20T07:02:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f6446b55640 1 -- 172.21.15.88:0/2516404747 learned_addr learned my addr 172.21.15.88:0/2516404747 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f6446b55640 1 -- 172.21.15.88:0/2516404747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64400b07f0 msgr2=0x7f644015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:38.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f6446b55640 1 --2- 172.21.15.88:0/2516404747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64400b07f0 0x7f644015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f6446b55640 1 -- 172.21.15.88:0/2516404747 >> v1:172.21.15.175:6789/0 conn(0x7f6440070c40 legacy=0x7f64400b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.609+0000 7f6446b55640 1 -- 172.21.15.88:0/2516404747 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6440071020 con 0x7f644015d690 2023-11-20T07:02:38.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f6446b55640 1 --2- 172.21.15.88:0/2516404747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f644015d690 0x7f6440164490 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6438009e50 tx=0x7f643801c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bf87725bacd4e84 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:38.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f6445352640 1 -- 172.21.15.88:0/2516404747 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380a5840 con 0x7f644015d690 2023-11-20T07:02:38.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f6445352640 1 -- 172.21.15.88:0/2516404747 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64380a59a0 con 0x7f644015d690 2023-11-20T07:02:38.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f6445352640 1 -- 172.21.15.88:0/2516404747 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380a5d30 con 0x7f644015d690 2023-11-20T07:02:38.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f64485b8640 1 -- 172.21.15.88:0/2516404747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f644015d690 msgr2=0x7f6440164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f64485b8640 1 --2- 172.21.15.88:0/2516404747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f644015d690 0x7f6440164490 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6438009e50 tx=0x7f643801c980 comp rx=0 tx=0).stop 2023-11-20T07:02:38.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f64485b8640 1 -- 172.21.15.88:0/2516404747 shutdown_connections 2023-11-20T07:02:38.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f64485b8640 1 --2- 172.21.15.88:0/2516404747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f644015d690 0x7f6440164490 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f64485b8640 1 --2- 172.21.15.88:0/2516404747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64400b07f0 0x7f644015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f64485b8640 1 -- 172.21.15.88:0/2516404747 >> 172.21.15.88:0/2516404747 conn(0x7f644006c190 msgr2=0x7f644006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:38.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f64485b8640 1 -- 172.21.15.88:0/2516404747 shutdown_connections 2023-11-20T07:02:38.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f64485b8640 1 -- 172.21.15.88:0/2516404747 wait complete. 2023-11-20T07:02:38.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f64485b8640 1 Processor -- start 2023-11-20T07:02:38.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.613+0000 7f64485b8640 1 -- start start 2023-11-20T07:02:38.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f64485b8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6440070c40 0x7f64401f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f64485b8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64400b07f0 0x7f6440159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f64485b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f644015d690 0x7f6440153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f64485b8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6440150a10 con 0x7f644015d690 2023-11-20T07:02:38.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f64485b8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6440152e20 con 0x7f64400b07f0 2023-11-20T07:02:38.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f64485b8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64401f5540 con 0x7f6440070c40 2023-11-20T07:02:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6446b55640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f644015d690 0x7f6440153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6446354640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6440070c40 0x7f64401f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6446b55640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f644015d690 0x7f6440153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50016/0 (socket says 172.21.15.88:50016) 2023-11-20T07:02:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6446b55640 1 -- 172.21.15.88:0/1442586985 learned_addr learned my addr 172.21.15.88:0/1442586985 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6445b53640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64400b07f0 0x7f6440159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6446b55640 1 -- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6440070c40 msgr2=0x7f64401f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6446b55640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6440070c40 0x7f64401f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6446b55640 1 -- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64400b07f0 msgr2=0x7f6440159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6446b55640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64400b07f0 0x7f6440159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6446b55640 1 -- 172.21.15.88:0/1442586985 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6438009b30 con 0x7f644015d690 2023-11-20T07:02:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6446b55640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f644015d690 0x7f6440153590 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f64380af040 tx=0x7f6438019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6436ffd640 1 -- 172.21.15.88:0/1442586985 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380b8670 con 0x7f644015d690 2023-11-20T07:02:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6436ffd640 1 -- 172.21.15.88:0/1442586985 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64380b87d0 con 0x7f644015d690 2023-11-20T07:02:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6436ffd640 1 -- 172.21.15.88:0/1442586985 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380b8b60 con 0x7f644015d690 2023-11-20T07:02:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f64485b8640 1 -- 172.21.15.88:0/1442586985 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64401f5820 con 0x7f644015d690 2023-11-20T07:02:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f64485b8640 1 -- 172.21.15.88:0/1442586985 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6440153070 con 0x7f644015d690 2023-11-20T07:02:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f64485b8640 1 -- 172.21.15.88:0/1442586985 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6440153260 con 0x7f644015d690 2023-11-20T07:02:38.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.617+0000 7f6436ffd640 1 -- 172.21.15.88:0/1442586985 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f64380b8cc0 con 0x7f644015d690 2023-11-20T07:02:38.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.621+0000 7f6436ffd640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f64240664a0 0x7f6424068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.621+0000 7f6436ffd640 1 -- 172.21.15.88:0/1442586985 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f643811eff0 con 0x7f644015d690 2023-11-20T07:02:38.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.621+0000 7f6446354640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f64240664a0 0x7f6424068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.621+0000 7f6446354640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f64240664a0 0x7f6424068960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f643c007fd0 tx=0x7f643c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:38.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.625+0000 7f6436ffd640 1 -- 172.21.15.88:0/1442586985 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f64380ec640 con 0x7f644015d690 2023-11-20T07:02:38.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.769+0000 7f64485b8640 1 -- 172.21.15.88:0/1442586985 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f644015bb80 con 0x7f64240664a0 2023-11-20T07:02:38.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.773+0000 7f6436ffd640 1 -- 172.21.15.88:0/1442586985 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50655 (secure 0 0 0) 0x7f643c0014f0 con 0x7f64240664a0 2023-11-20T07:02:38.774 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:38.775 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-20T07:02:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.777+0000 7f64485b8640 1 -- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f64240664a0 msgr2=0x7f6424068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.777+0000 7f64485b8640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f64240664a0 0x7f6424068960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f643c007fd0 tx=0x7f643c009040 comp rx=0 tx=0).stop 2023-11-20T07:02:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.777+0000 7f64485b8640 1 -- 172.21.15.88:0/1442586985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f644015d690 msgr2=0x7f6440153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.777+0000 7f64485b8640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f644015d690 0x7f6440153590 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f64380af040 tx=0x7f6438019720 comp rx=0 tx=0).stop 2023-11-20T07:02:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.777+0000 7f64485b8640 1 -- 172.21.15.88:0/1442586985 shutdown_connections 2023-11-20T07:02:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.777+0000 7f64485b8640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f64240664a0 0x7f6424068960 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.777+0000 7f64485b8640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f644015d690 0x7f6440153590 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.777+0000 7f64485b8640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64400b07f0 0x7f6440159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.777+0000 7f64485b8640 1 --2- 172.21.15.88:0/1442586985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6440070c40 0x7f64401f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.777+0000 7f64485b8640 1 -- 172.21.15.88:0/1442586985 >> 172.21.15.88:0/1442586985 conn(0x7f644006c190 msgr2=0x7f6440151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:38.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.777+0000 7f64485b8640 1 -- 172.21.15.88:0/1442586985 shutdown_connections 2023-11-20T07:02:38.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.777+0000 7f64485b8640 1 -- 172.21.15.88:0/1442586985 wait complete. 2023-11-20T07:02:38.795 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-11-20T07:02:37.556968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":221012,"kb_used_data":4832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753708,"statfs":{"total":773094113280,"available":772867796992,"internally_reserved":0,"allocated":4947968,"data_stored":2801464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2850,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-46,"num_write_kb":-15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000954"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-20T07:02:35.483616+0000","last_change":"2023-11-20T07:00:43.158695+0000","last_active":"2023-11-20T07:02:35.483616+0000","last_peered":"2023-11-20T07:02:35.483616+0000","last_clean":"2023-11-20T07:02:35.483616+0000","last_became_active":"2023-11-20T07:00:43.157454+0000","last_became_peered":"2023-11-20T07:00:43.157454+0000","last_unstale":"2023-11-20T07:02:35.483616+0000","last_undegraded":"2023-11-20T07:02:35.483616+0000","last_fullsized":"2023-11-20T07:02:35.483616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_clean_scrub_stamp":"2023-11-20T07:00:42.001721+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:44:20.907460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":798228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.63100000000000001}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.82199999999999995}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.83799999999999997}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.79500000000000004}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.71299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":201950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.69299999999999995}]},{"osd":1,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":0.625},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.754}]},{"osd":3,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.4830000000000001,"5min":2.4830000000000001,"15min":2.4830000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.73399999999999999}]},{"osd":4,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.499}]},{"osd":5,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.85299999999999998}]},{"osd":7,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.74299999999999999}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.60299999999999998}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.63100000000000001}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.52200000000000002}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.70599999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.75600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":201950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.752},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.69299999999999995}]},{"osd":1,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.79200000000000004}]},{"osd":3,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.83299999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.82099999999999995}]},{"osd":7,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.84899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":201950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.45000000000000001}]},{"osd":1,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.434},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.51400000000000001}]},{"osd":4,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.55200000000000005}]},{"osd":6,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.629},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.56499999999999995}]},{"osd":7,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.59299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":195639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.442}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.497}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47499999999999998}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79300000000000004}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.82699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":195659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.31}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.371},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.46600000000000003}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.495},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.751}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":798228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.504}]},{"osd":2,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.371}]},{"osd":3,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.67800000000000005}]},{"osd":7,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.70099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T07:02:38.796 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-20T07:02:38.796 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T07:02:38.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e1986b640 1 Processor -- start 2023-11-20T07:02:38.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e1986b640 1 -- start start 2023-11-20T07:02:38.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e1986b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e1415cf00 0x7f4e140cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e1986b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4e140cdee0 0x7f4e140d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e1986b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e140ce340 con 0x7f4e140d1240 2023-11-20T07:02:38.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e1986b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1415d2e0 con 0x7f4e1415cf00 2023-11-20T07:02:38.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e1986b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140d1690 con 0x7f4e140cdee0 2023-11-20T07:02:38.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e12ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e1415cf00 0x7f4e140cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e12ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e1415cf00 0x7f4e140cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50028/0 (socket says 172.21.15.88:50028) 2023-11-20T07:02:38.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e12ffd640 1 -- 172.21.15.88:0/1301420875 learned_addr learned my addr 172.21.15.88:0/1301420875 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:38.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e0a7fc640 1 --2- 172.21.15.88:0/1301420875 >> v2:172.21.15.175:3300/0 conn(0x7f4e140cdee0 0x7f4e140d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e12ffd640 1 -- 172.21.15.88:0/1301420875 >> v2:172.21.15.175:3300/0 conn(0x7f4e140cdee0 msgr2=0x7f4e140d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:38.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e12ffd640 1 --2- 172.21.15.88:0/1301420875 >> v2:172.21.15.175:3300/0 conn(0x7f4e140cdee0 0x7f4e140d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e12ffd640 1 -- 172.21.15.88:0/1301420875 >> v1:172.21.15.88:6789/0 conn(0x7f4e140d1240 legacy=0x7f4e1406ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e12ffd640 1 -- 172.21.15.88:0/1301420875 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140d1930 con 0x7f4e1415cf00 2023-11-20T07:02:38.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e0a7fc640 1 --2- 172.21.15.88:0/1301420875 >> v2:172.21.15.175:3300/0 conn(0x7f4e140cdee0 0x7f4e140d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:38.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.933+0000 7f4e127fc640 1 -- 172.21.15.88:0/1301420875 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167440975 0 0) 0x7f4e140ce340 con 0x7f4e140d1240 2023-11-20T07:02:38.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.937+0000 7f4e12ffd640 1 --2- 172.21.15.88:0/1301420875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1415cf00 0x7f4e140cd9a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4e140b5490 tx=0x7f4dfc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7538944e5640caad server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:38.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.937+0000 7f4e127fc640 1 -- 172.21.15.88:0/1301420875 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0ab670 con 0x7f4e1415cf00 2023-11-20T07:02:38.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.937+0000 7f4e127fc640 1 -- 172.21.15.88:0/1301420875 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc0ab7d0 con 0x7f4e1415cf00 2023-11-20T07:02:38.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.937+0000 7f4e127fc640 1 -- 172.21.15.88:0/1301420875 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0abb60 con 0x7f4e1415cf00 2023-11-20T07:02:38.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.937+0000 7f4e1986b640 1 -- 172.21.15.88:0/1301420875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1415cf00 msgr2=0x7f4e140cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.937+0000 7f4e1986b640 1 --2- 172.21.15.88:0/1301420875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1415cf00 0x7f4e140cd9a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4e140b5490 tx=0x7f4dfc01c470 comp rx=0 tx=0).stop 2023-11-20T07:02:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.937+0000 7f4e1986b640 1 -- 172.21.15.88:0/1301420875 shutdown_connections 2023-11-20T07:02:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.937+0000 7f4e1986b640 1 --2- 172.21.15.88:0/1301420875 >> v2:172.21.15.175:3300/0 conn(0x7f4e140cdee0 0x7f4e140d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.937+0000 7f4e1986b640 1 --2- 172.21.15.88:0/1301420875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e1415cf00 0x7f4e140cd9a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.937+0000 7f4e1986b640 1 -- 172.21.15.88:0/1301420875 >> 172.21.15.88:0/1301420875 conn(0x7f4e140b4470 msgr2=0x7f4e140b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.937+0000 7f4e1986b640 1 -- 172.21.15.88:0/1301420875 shutdown_connections 2023-11-20T07:02:38.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.937+0000 7f4e1986b640 1 -- 172.21.15.88:0/1301420875 wait complete. 2023-11-20T07:02:38.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e1986b640 1 Processor -- start 2023-11-20T07:02:38.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e1986b640 1 -- start start 2023-11-20T07:02:38.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e1986b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e140cdee0 0x7f4e14153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e1986b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e140d1240 0x7f4e14154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e1986b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e1415cf00 0x7f4e14157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e1986b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e14153750 con 0x7f4e140cdee0 2023-11-20T07:02:38.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e1986b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1415aa10 con 0x7f4e1415cf00 2023-11-20T07:02:38.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e1986b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1415a0e0 con 0x7f4e140d1240 2023-11-20T07:02:38.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e12ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e140cdee0 0x7f4e14153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e12ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e140cdee0 0x7f4e14153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50040/0 (socket says 172.21.15.88:50040) 2023-11-20T07:02:38.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e12ffd640 1 -- 172.21.15.88:0/497437178 learned_addr learned my addr 172.21.15.88:0/497437178 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:38.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e137fe640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e1415cf00 0x7f4e14157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e0a7fc640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e140d1240 0x7f4e14154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e12ffd640 1 -- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e140d1240 msgr2=0x7f4e14154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e12ffd640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e140d1240 0x7f4e14154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e12ffd640 1 -- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e1415cf00 msgr2=0x7f4e14157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:38.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e12ffd640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e1415cf00 0x7f4e14157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:38.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e12ffd640 1 -- 172.21.15.88:0/497437178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0094d0 con 0x7f4e140cdee0 2023-11-20T07:02:38.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e0a7fc640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e140d1240 0x7f4e14154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:38.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e12ffd640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e140cdee0 0x7f4e14153210 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc019080 tx=0x7f4dfc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:38.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e10ff9640 1 -- 172.21.15.88:0/497437178 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0b4800 con 0x7f4e140cdee0 2023-11-20T07:02:38.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e10ff9640 1 -- 172.21.15.88:0/497437178 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc0b4960 con 0x7f4e140cdee0 2023-11-20T07:02:38.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e10ff9640 1 -- 172.21.15.88:0/497437178 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0b4cf0 con 0x7f4e140cdee0 2023-11-20T07:02:38.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e1986b640 1 -- 172.21.15.88:0/497437178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1415a3c0 con 0x7f4e140cdee0 2023-11-20T07:02:38.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.941+0000 7f4e1986b640 1 -- 172.21.15.88:0/497437178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e140aad30 con 0x7f4e140cdee0 2023-11-20T07:02:38.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.945+0000 7f4e1986b640 1 -- 172.21.15.88:0/497437178 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e14074010 con 0x7f4e140cdee0 2023-11-20T07:02:38.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.945+0000 7f4e10ff9640 1 -- 172.21.15.88:0/497437178 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4dfc0c7440 con 0x7f4e140cdee0 2023-11-20T07:02:38.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.945+0000 7f4e10ff9640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4df4066470 0x7f4df4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:38.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.945+0000 7f4e10ff9640 1 -- 172.21.15.88:0/497437178 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4dfc11ea70 con 0x7f4e140cdee0 2023-11-20T07:02:38.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.945+0000 7f4e0a7fc640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4df4066470 0x7f4df4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:38.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.945+0000 7f4e0a7fc640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4df4066470 0x7f4df4068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4e140b3bc0 tx=0x7f4e04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:38.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:38.949+0000 7f4e10ff9640 1 -- 172.21.15.88:0/497437178 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4dfc0ec140 con 0x7f4e140cdee0 2023-11-20T07:02:39.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.097+0000 7f4e1986b640 1 -- 172.21.15.88:0/497437178 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e140b5de0 con 0x7f4df4066470 2023-11-20T07:02:39.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.097+0000 7f4e10ff9640 1 -- 172.21.15.88:0/497437178 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50655 (secure 0 0 0) 0x7f4e0400c040 con 0x7f4df4066470 2023-11-20T07:02:39.100 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:39.100 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-20T07:02:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.101+0000 7f4e1986b640 1 -- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4df4066470 msgr2=0x7f4df4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.101+0000 7f4e1986b640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4df4066470 0x7f4df4068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4e140b3bc0 tx=0x7f4e04008040 comp rx=0 tx=0).stop 2023-11-20T07:02:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.101+0000 7f4e1986b640 1 -- 172.21.15.88:0/497437178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e140cdee0 msgr2=0x7f4e14153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.101+0000 7f4e1986b640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e140cdee0 0x7f4e14153210 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc019080 tx=0x7f4dfc01acb0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.101+0000 7f4e1986b640 1 -- 172.21.15.88:0/497437178 shutdown_connections 2023-11-20T07:02:39.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.101+0000 7f4e1986b640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f4df4066470 0x7f4df4068930 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.101+0000 7f4e1986b640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e140d1240 0x7f4e14154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.101+0000 7f4e1986b640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e1415cf00 0x7f4e14157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.101+0000 7f4e1986b640 1 --2- 172.21.15.88:0/497437178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e140cdee0 0x7f4e14153210 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.101+0000 7f4e1986b640 1 -- 172.21.15.88:0/497437178 >> 172.21.15.88:0/497437178 conn(0x7f4e140b4470 msgr2=0x7f4e14156180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.101+0000 7f4e1986b640 1 -- 172.21.15.88:0/497437178 shutdown_connections 2023-11-20T07:02:39.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.101+0000 7f4e1986b640 1 -- 172.21.15.88:0/497437178 wait complete. 2023-11-20T07:02:39.120 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-11-20T07:02:37.556968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":221012,"kb_used_data":4832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753708,"statfs":{"total":773094113280,"available":772867796992,"internally_reserved":0,"allocated":4947968,"data_stored":2801464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2850,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-46,"num_write_kb":-15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000954"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-20T07:02:35.483616+0000","last_change":"2023-11-20T07:00:43.158695+0000","last_active":"2023-11-20T07:02:35.483616+0000","last_peered":"2023-11-20T07:02:35.483616+0000","last_clean":"2023-11-20T07:02:35.483616+0000","last_became_active":"2023-11-20T07:00:43.157454+0000","last_became_peered":"2023-11-20T07:00:43.157454+0000","last_unstale":"2023-11-20T07:02:35.483616+0000","last_undegraded":"2023-11-20T07:02:35.483616+0000","last_fullsized":"2023-11-20T07:02:35.483616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_clean_scrub_stamp":"2023-11-20T07:00:42.001721+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:44:20.907460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":798228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.63100000000000001}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.82199999999999995}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.83799999999999997}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.79500000000000004}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.71299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":201950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.69299999999999995}]},{"osd":1,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":0.625},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.754}]},{"osd":3,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.4830000000000001,"5min":2.4830000000000001,"15min":2.4830000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.73399999999999999}]},{"osd":4,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.499}]},{"osd":5,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.85299999999999998}]},{"osd":7,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.74299999999999999}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.60299999999999998}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.63100000000000001}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.52200000000000002}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.70599999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72499999999999998}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.75600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":201950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.752},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.69299999999999995}]},{"osd":1,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.79200000000000004}]},{"osd":3,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.83299999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.82099999999999995}]},{"osd":7,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.84899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":201950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.45000000000000001}]},{"osd":1,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.434},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.51400000000000001}]},{"osd":4,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.55200000000000005}]},{"osd":6,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.629},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.56499999999999995}]},{"osd":7,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.59299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":195639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.442}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.497}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.47499999999999998}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.73899999999999999}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79300000000000004}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.82699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":195659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.31}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.371},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.46600000000000003}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.495},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.751}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":798228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.504}]},{"osd":2,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.371}]},{"osd":3,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.66000000000000003}]},{"osd":5,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.67800000000000005}]},{"osd":7,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.70099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T07:02:39.122 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-20T07:02:39.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.257+0000 7fcacfc91640 1 Processor -- start 2023-11-20T07:02:39.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.257+0000 7fcacfc91640 1 -- start start 2023-11-20T07:02:39.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.257+0000 7fcacfc91640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcac80b07f0 0x7fcac815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:39.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.257+0000 7fcacfc91640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcac815d690 0x7fcac8164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:39.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.257+0000 7fcacfc91640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac815be60 con 0x7fcac8070c40 2023-11-20T07:02:39.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.261+0000 7fcacfc91640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac815b3b0 con 0x7fcac80b07f0 2023-11-20T07:02:39.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.261+0000 7fcacfc91640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac815c1f0 con 0x7fcac815d690 2023-11-20T07:02:39.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.261+0000 7fcacd22c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcac80b07f0 0x7fcac815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:39.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.261+0000 7fcacd22c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcac80b07f0 0x7fcac815ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50044/0 (socket says 172.21.15.88:50044) 2023-11-20T07:02:39.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.261+0000 7fcacd22c640 1 -- 172.21.15.88:0/4108910486 learned_addr learned my addr 172.21.15.88:0/4108910486 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:39.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.261+0000 7fcace22e640 1 --2- 172.21.15.88:0/4108910486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcac815d690 0x7fcac8164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:39.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.261+0000 7fcacd22c640 1 -- 172.21.15.88:0/4108910486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcac815d690 msgr2=0x7fcac8164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:39.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.261+0000 7fcacd22c640 1 --2- 172.21.15.88:0/4108910486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcac815d690 0x7fcac8164490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.261+0000 7fcacd22c640 1 -- 172.21.15.88:0/4108910486 >> v1:172.21.15.175:6789/0 conn(0x7fcac8070c40 legacy=0x7fcac80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:39.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.261+0000 7fcacd22c640 1 -- 172.21.15.88:0/4108910486 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac8071020 con 0x7fcac80b07f0 2023-11-20T07:02:39.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.261+0000 7fcacd22c640 1 --2- 172.21.15.88:0/4108910486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcac80b07f0 0x7fcac815ae70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009870 tx=0x7fcab801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70196c6f6a0d78e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:39.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.261+0000 7fcacca2b640 1 -- 172.21.15.88:0/4108910486 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab80ab620 con 0x7fcac80b07f0 2023-11-20T07:02:39.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacca2b640 1 -- 172.21.15.88:0/4108910486 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab80ab780 con 0x7fcac80b07f0 2023-11-20T07:02:39.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacca2b640 1 -- 172.21.15.88:0/4108910486 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab80abb10 con 0x7fcac80b07f0 2023-11-20T07:02:39.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 -- 172.21.15.88:0/4108910486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcac80b07f0 msgr2=0x7fcac815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:39.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 --2- 172.21.15.88:0/4108910486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcac80b07f0 0x7fcac815ae70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009870 tx=0x7fcab801c420 comp rx=0 tx=0).stop 2023-11-20T07:02:39.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 -- 172.21.15.88:0/4108910486 shutdown_connections 2023-11-20T07:02:39.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 --2- 172.21.15.88:0/4108910486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcac815d690 0x7fcac8164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 --2- 172.21.15.88:0/4108910486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcac80b07f0 0x7fcac815ae70 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 -- 172.21.15.88:0/4108910486 >> 172.21.15.88:0/4108910486 conn(0x7fcac806c190 msgr2=0x7fcac806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:39.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 -- 172.21.15.88:0/4108910486 shutdown_connections 2023-11-20T07:02:39.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 -- 172.21.15.88:0/4108910486 wait complete. 2023-11-20T07:02:39.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 Processor -- start 2023-11-20T07:02:39.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 -- start start 2023-11-20T07:02:39.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcac8070c40 0x7fcac8148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:39.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcac80b07f0 0x7fcac814a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:39.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcac815d690 0x7fcac81508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:39.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac814b420 con 0x7fcac8070c40 2023-11-20T07:02:39.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80b48a0 con 0x7fcac80b07f0 2023-11-20T07:02:39.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacfc91640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80b4b80 con 0x7fcac815d690 2023-11-20T07:02:39.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacda2d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcac8070c40 0x7fcac8148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:39.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacda2d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcac8070c40 0x7fcac8148ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50054/0 (socket says 172.21.15.88:50054) 2023-11-20T07:02:39.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.265+0000 7fcacda2d640 1 -- 172.21.15.88:0/3587893172 learned_addr learned my addr 172.21.15.88:0/3587893172 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:39.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcacd22c640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcac80b07f0 0x7fcac814a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:39.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcace22e640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcac815d690 0x7fcac81508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:39.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcacda2d640 1 -- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcac815d690 msgr2=0x7fcac81508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:39.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcacda2d640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcac815d690 0x7fcac81508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcacda2d640 1 -- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcac80b07f0 msgr2=0x7fcac814a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:39.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcacda2d640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcac80b07f0 0x7fcac814a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcacda2d640 1 -- 172.21.15.88:0/3587893172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab80094d0 con 0x7fcac8070c40 2023-11-20T07:02:39.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcace22e640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcac815d690 0x7fcac81508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:39.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcacd22c640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcac80b07f0 0x7fcac814a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:39.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcacda2d640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcac8070c40 0x7fcac8148ee0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcac400c3c0 tx=0x7fcac400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:39.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcabe7fc640 1 -- 172.21.15.88:0/3587893172 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40052d0 con 0x7fcac8070c40 2023-11-20T07:02:39.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcabe7fc640 1 -- 172.21.15.88:0/3587893172 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4005430 con 0x7fcac8070c40 2023-11-20T07:02:39.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcabe7fc640 1 -- 172.21.15.88:0/3587893172 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4003840 con 0x7fcac8070c40 2023-11-20T07:02:39.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcacfc91640 1 -- 172.21.15.88:0/3587893172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac80b4e60 con 0x7fcac8070c40 2023-11-20T07:02:39.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcacfc91640 1 -- 172.21.15.88:0/3587893172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac814b700 con 0x7fcac8070c40 2023-11-20T07:02:39.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcacfc91640 1 -- 172.21.15.88:0/3587893172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac80b50a0 con 0x7fcac8070c40 2023-11-20T07:02:39.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcabe7fc640 1 -- 172.21.15.88:0/3587893172 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcac40039a0 con 0x7fcac8070c40 2023-11-20T07:02:39.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcabe7fc640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcaac0664a0 0x7fcaac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:39.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.269+0000 7fcabe7fc640 1 -- 172.21.15.88:0/3587893172 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcac4083280 con 0x7fcac8070c40 2023-11-20T07:02:39.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.273+0000 7fcacd22c640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcaac0664a0 0x7fcaac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:39.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.273+0000 7fcacd22c640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcaac0664a0 0x7fcaac068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcab80af000 tx=0x7fcab8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:39.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.273+0000 7fcabe7fc640 1 -- 172.21.15.88:0/3587893172 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcac80b50a0 con 0x7fcac8070c40 2023-11-20T07:02:39.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.425+0000 7fcacfc91640 1 -- 172.21.15.88:0/3587893172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcac80b5050 con 0x7fcac8070c40 2023-11-20T07:02:39.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.425+0000 7fcabe7fc640 1 -- 172.21.15.88:0/3587893172 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13155 (secure 0 0 0) 0x7fcac4050820 con 0x7fcac8070c40 2023-11-20T07:02:39.428 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:39.428 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":41,"fsid":"81254148-3aea-4f86-927e-f8c4e1bfa591","created":"2023-11-20T07:00:28.513107+0000","modified":"2023-11-20T07:02:35.844341+0000","last_up_change":"2023-11-20T07:00:40.998799+0000","last_in_change":"2023-11-20T07:00:31.315058+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-20T07:00:41.592121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"16d24238-148f-4be4-8aec-63faf7dbd418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6809","nonce":2669156900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6811","nonce":2669156900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6815","nonce":2669156900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":2669156900},{"type":"v1","addr":"172.21.15.88:6813","nonce":2669156900}]},"public_addr":"172.21.15.88:6809/2669156900","cluster_addr":"172.21.15.88:6811/2669156900","heartbeat_back_addr":"172.21.15.88:6815/2669156900","heartbeat_front_addr":"172.21.15.88:6813/2669156900","state":["exists","up"]},{"osd":1,"uuid":"86beb9f6-e652-4fb2-9c37-d9729ae471d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6823","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6825","nonce":1785526127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6827","nonce":1785526127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6831","nonce":1785526127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1785526127},{"type":"v1","addr":"172.21.15.88:6829","nonce":1785526127}]},"public_addr":"172.21.15.88:6825/1785526127","cluster_addr":"172.21.15.88:6827/1785526127","heartbeat_back_addr":"172.21.15.88:6831/1785526127","heartbeat_front_addr":"172.21.15.88:6829/1785526127","state":["exists","up"]},{"osd":2,"uuid":"d4aa4be2-5d29-4ffe-9f46-9686156793b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6801","nonce":1256076870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6803","nonce":1256076870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6807","nonce":1256076870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1256076870},{"type":"v1","addr":"172.21.15.88:6805","nonce":1256076870}]},"public_addr":"172.21.15.88:6801/1256076870","cluster_addr":"172.21.15.88:6803/1256076870","heartbeat_back_addr":"172.21.15.88:6807/1256076870","heartbeat_front_addr":"172.21.15.88:6805/1256076870","state":["exists","up"]},{"osd":3,"uuid":"691307ae-a2c8-45f6-9638-01bccc6acb00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6817","nonce":1570500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6819","nonce":1570500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6824","nonce":1570500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1570500},{"type":"v1","addr":"172.21.15.88:6821","nonce":1570500}]},"public_addr":"172.21.15.88:6817/1570500","cluster_addr":"172.21.15.88:6819/1570500","heartbeat_back_addr":"172.21.15.88:6824/1570500","heartbeat_front_addr":"172.21.15.88:6821/1570500","state":["exists","up"]},{"osd":4,"uuid":"91acdcb0-85b3-40c5-aaa1-4737296fb794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6801","nonce":1731999626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6803","nonce":1731999626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6807","nonce":1731999626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1731999626},{"type":"v1","addr":"172.21.15.175:6805","nonce":1731999626}]},"public_addr":"172.21.15.175:6801/1731999626","cluster_addr":"172.21.15.175:6803/1731999626","heartbeat_back_addr":"172.21.15.175:6807/1731999626","heartbeat_front_addr":"172.21.15.175:6805/1731999626","state":["exists","up"]},{"osd":5,"uuid":"58ab5ad7-804b-44b6-9209-64921fc69496","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6812","nonce":2498780564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6817","nonce":2498780564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6825","nonce":2498780564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6819","nonce":2498780564},{"type":"v1","addr":"172.21.15.175:6821","nonce":2498780564}]},"public_addr":"172.21.15.175:6812/2498780564","cluster_addr":"172.21.15.175:6817/2498780564","heartbeat_back_addr":"172.21.15.175:6825/2498780564","heartbeat_front_addr":"172.21.15.175:6821/2498780564","state":["exists","up"]},{"osd":6,"uuid":"0a85757d-53b7-45c3-85a3-f52a00a1c6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6824","nonce":3652084907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6827","nonce":3652084907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6831","nonce":3652084907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3652084907},{"type":"v1","addr":"172.21.15.175:6829","nonce":3652084907}]},"public_addr":"172.21.15.175:6824/3652084907","cluster_addr":"172.21.15.175:6827/3652084907","heartbeat_back_addr":"172.21.15.175:6831/3652084907","heartbeat_front_addr":"172.21.15.175:6829/3652084907","state":["exists","up"]},{"osd":7,"uuid":"fff942b3-009a-4852-a4d6-acecc60cf2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6809","nonce":205055633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6811","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6813","nonce":205055633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6820","nonce":205055633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":205055633},{"type":"v1","addr":"172.21.15.175:6816","nonce":205055633}]},"public_addr":"172.21.15.175:6809/205055633","cluster_addr":"172.21.15.175:6813/205055633","heartbeat_back_addr":"172.21.15.175:6820/205055633","heartbeat_front_addr":"172.21.15.175:6816/205055633","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.283605+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.079710+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.944216+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.351620+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:36.894297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.314438+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.327048+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-20T07:00:37.369209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6835/2477383155":"2023-11-21T07:02:32.834370+0000","172.21.15.88:6833/2477383155":"2023-11-21T07:02:32.834370+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-20T07:02:39.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.429+0000 7fcacfc91640 1 -- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcaac0664a0 msgr2=0x7fcaac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:39.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.429+0000 7fcacfc91640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcaac0664a0 0x7fcaac068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcab80af000 tx=0x7fcab8008040 comp rx=0 tx=0).stop 2023-11-20T07:02:39.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.429+0000 7fcacfc91640 1 -- 172.21.15.88:0/3587893172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcac8070c40 msgr2=0x7fcac8148ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:39.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.429+0000 7fcacfc91640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcac8070c40 0x7fcac8148ee0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcac400c3c0 tx=0x7fcac400c880 comp rx=0 tx=0).stop 2023-11-20T07:02:39.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.429+0000 7fcacfc91640 1 -- 172.21.15.88:0/3587893172 shutdown_connections 2023-11-20T07:02:39.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.429+0000 7fcacfc91640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fcaac0664a0 0x7fcaac068960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.429+0000 7fcacfc91640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcac815d690 0x7fcac81508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.429+0000 7fcacfc91640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcac80b07f0 0x7fcac814a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.429+0000 7fcacfc91640 1 --2- 172.21.15.88:0/3587893172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcac8070c40 0x7fcac8148ee0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:39.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.429+0000 7fcacfc91640 1 -- 172.21.15.88:0/3587893172 >> 172.21.15.88:0/3587893172 conn(0x7fcac806c190 msgr2=0x7fcac80adb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:39.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.429+0000 7fcacfc91640 1 -- 172.21.15.88:0/3587893172 shutdown_connections 2023-11-20T07:02:39.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:39.429+0000 7fcacfc91640 1 -- 172.21.15.88:0/3587893172 wait complete. 2023-11-20T07:02:40.450 INFO:tasks.ceph:Scrubbing osd.0 2023-11-20T07:02:40.451 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-20T07:02:40.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.597+0000 7efd417d3640 1 Processor -- start 2023-11-20T07:02:40.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.597+0000 7efd417d3640 1 -- start start 2023-11-20T07:02:40.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd417d3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd3c0cfd20 0x7efd3c0d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd417d3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3c0ce460 con 0x7efd3c0cdc80 2023-11-20T07:02:40.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd417d3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3c15da30 con 0x7efd3c0d2570 2023-11-20T07:02:40.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd417d3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3c0cd830 con 0x7efd3c0cfd20 2023-11-20T07:02:40.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd327fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efd3c0cdc80 0x7efd3c0cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55844/0 (socket says 172.21.15.88:55844) 2023-11-20T07:02:40.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd327fc640 1 -- 172.21.15.88:0/3345245741 learned_addr learned my addr 172.21.15.88:0/3345245741 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:40.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3b7fe640 1 --2- 172.21.15.88:0/3345245741 >> v2:172.21.15.175:3300/0 conn(0x7efd3c0cfd20 0x7efd3c0d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914146710 0 0) 0x7efd3c0ce460 con 0x7efd3c0cdc80 2023-11-20T07:02:40.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd28003530 con 0x7efd3c0cdc80 2023-11-20T07:02:40.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2659826751 0 0) 0x7efd28003530 con 0x7efd3c0cdc80 2023-11-20T07:02:40.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 >> v2:172.21.15.175:3300/0 conn(0x7efd3c0cfd20 msgr2=0x7efd3c0d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:40.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 --2- 172.21.15.88:0/3345245741 >> v2:172.21.15.175:3300/0 conn(0x7efd3c0cfd20 0x7efd3c0d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 >> v1:172.21.15.175:6789/0 conn(0x7efd3c0d2570 legacy=0x7efd3c161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c0ce180 con 0x7efd3c0cdc80 2023-11-20T07:02:40.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7efd24001680 con 0x7efd3c0cdc80 2023-11-20T07:02:40.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 >> v1:172.21.15.88:6789/0 conn(0x7efd3c0cdc80 legacy=0x7efd3c0cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 --2- 172.21.15.88:0/3345245741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd28003980 0x7efd28003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 --2- 172.21.15.88:0/3345245741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd280047d0 0x7efd28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 --2- 172.21.15.88:0/3345245741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd28005190 0x7efd2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c0cd830 con 0x7efd280047d0 2023-11-20T07:02:40.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2800c030 con 0x7efd28005190 2023-11-20T07:02:40.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2800c1f0 con 0x7efd28003980 2023-11-20T07:02:40.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd327fc640 1 --2- 172.21.15.88:0/3345245741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd280047d0 0x7efd28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3b7fe640 1 --2- 172.21.15.88:0/3345245741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd28005190 0x7efd2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3affd640 1 --2- 172.21.15.88:0/3345245741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd28003980 0x7efd28003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd327fc640 1 -- 172.21.15.88:0/3345245741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd28003980 msgr2=0x7efd28003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd327fc640 1 --2- 172.21.15.88:0/3345245741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd28003980 0x7efd28003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd327fc640 1 -- 172.21.15.88:0/3345245741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd28005190 msgr2=0x7efd2800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd327fc640 1 --2- 172.21.15.88:0/3345245741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd28005190 0x7efd2800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd327fc640 1 -- 172.21.15.88:0/3345245741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28003530 con 0x7efd280047d0 2023-11-20T07:02:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3b7fe640 1 --2- 172.21.15.88:0/3345245741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd28005190 0x7efd2800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:40.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.601+0000 7efd3b7fe640 1 -- 172.21.15.88:0/3345245741 reap_dead start 2023-11-20T07:02:40.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.605+0000 7efd327fc640 1 --2- 172.21.15.88:0/3345245741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd280047d0 0x7efd28004c50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7efd2400c240 tx=0x7efd2401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34122c6059f6ee1b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.605+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24005ae0 con 0x7efd280047d0 2023-11-20T07:02:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.605+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd240ab070 con 0x7efd280047d0 2023-11-20T07:02:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.605+0000 7efd3a7fc640 1 -- 172.21.15.88:0/3345245741 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24007070 con 0x7efd280047d0 2023-11-20T07:02:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.605+0000 7efd417d3640 1 -- 172.21.15.88:0/3345245741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd280047d0 msgr2=0x7efd28004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.605+0000 7efd417d3640 1 --2- 172.21.15.88:0/3345245741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd280047d0 0x7efd28004c50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7efd2400c240 tx=0x7efd2401f370 comp rx=0 tx=0).stop 2023-11-20T07:02:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.605+0000 7efd417d3640 1 -- 172.21.15.88:0/3345245741 shutdown_connections 2023-11-20T07:02:40.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.605+0000 7efd417d3640 1 --2- 172.21.15.88:0/3345245741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd280047d0 0x7efd28004c50 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.605+0000 7efd417d3640 1 -- 172.21.15.88:0/3345245741 >> 172.21.15.88:0/3345245741 conn(0x7efd3c0715c0 msgr2=0x7efd3c0719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:40.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.605+0000 7efd417d3640 1 -- 172.21.15.88:0/3345245741 shutdown_connections 2023-11-20T07:02:40.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.605+0000 7efd417d3640 1 -- 172.21.15.88:0/3345245741 wait complete. 2023-11-20T07:02:40.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.605+0000 7efd417d3640 1 Processor -- start 2023-11-20T07:02:40.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd417d3640 1 -- start start 2023-11-20T07:02:40.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd417d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd280047d0 0x7efd3c1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd417d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd3c0cbef0 0x7efd3c160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd417d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd3c160b90 0x7efd3c1f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd417d3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c161010 con 0x7efd280047d0 2023-11-20T07:02:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd417d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c1f3010 con 0x7efd3c0cbef0 2023-11-20T07:02:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd417d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3c0cb130 con 0x7efd3c160b90 2023-11-20T07:02:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd3affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd280047d0 0x7efd3c1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd3affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd280047d0 0x7efd3c1573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50062/0 (socket says 172.21.15.88:50062) 2023-11-20T07:02:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd3affd640 1 -- 172.21.15.88:0/2948750919 learned_addr learned my addr 172.21.15.88:0/2948750919 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:40.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd3affd640 1 -- 172.21.15.88:0/2948750919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd3c160b90 msgr2=0x7efd3c1f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd3affd640 1 --2- 172.21.15.88:0/2948750919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd3c160b90 0x7efd3c1f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd3affd640 1 -- 172.21.15.88:0/2948750919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd3c0cbef0 msgr2=0x7efd3c160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd3affd640 1 --2- 172.21.15.88:0/2948750919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd3c0cbef0 0x7efd3c160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd3affd640 1 -- 172.21.15.88:0/2948750919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c0cb410 con 0x7efd280047d0 2023-11-20T07:02:40.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd3affd640 1 --2- 172.21.15.88:0/2948750919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd280047d0 0x7efd3c1573f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00e8f0 tx=0x7efd2c00edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd33fff640 1 -- 172.21.15.88:0/2948750919 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c003b90 con 0x7efd280047d0 2023-11-20T07:02:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd33fff640 1 -- 172.21.15.88:0/2948750919 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c003cf0 con 0x7efd280047d0 2023-11-20T07:02:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd33fff640 1 -- 172.21.15.88:0/2948750919 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c0052f0 con 0x7efd280047d0 2023-11-20T07:02:40.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd417d3640 1 -- 172.21.15.88:0/2948750919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3c0cb6f0 con 0x7efd280047d0 2023-11-20T07:02:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd417d3640 1 -- 172.21.15.88:0/2948750919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3c1f27e0 con 0x7efd280047d0 2023-11-20T07:02:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.609+0000 7efd417d3640 1 -- 172.21.15.88:0/2948750919 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd3c15d6c0 con 0x7efd280047d0 2023-11-20T07:02:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.613+0000 7efd33fff640 1 -- 172.21.15.88:0/2948750919 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efd2c005450 con 0x7efd280047d0 2023-11-20T07:02:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.613+0000 7efd33fff640 1 --2- 172.21.15.88:0/2948750919 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efd1c0664a0 0x7efd1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.613+0000 7efd33fff640 1 -- 172.21.15.88:0/2948750919 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7efd2c083db0 con 0x7efd280047d0 2023-11-20T07:02:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.613+0000 7efd33fff640 1 --2- 172.21.15.88:0/2948750919 >> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] conn(0x7efd1c06c7a0 0x7efd1c06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.613+0000 7efd33fff640 1 -- 172.21.15.88:0/2948750919 --> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd1c06f2b0 con 0x7efd1c06c7a0 2023-11-20T07:02:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.613+0000 7efd33fff640 1 -- 172.21.15.88:0/2948750919 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd2c086330 con 0x7efd280047d0 2023-11-20T07:02:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.613+0000 7efd327fc640 1 --2- 172.21.15.88:0/2948750919 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efd1c0664a0 0x7efd1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.613+0000 7efd3b7fe640 1 --2- 172.21.15.88:0/2948750919 >> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] conn(0x7efd1c06c7a0 0x7efd1c06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.613+0000 7efd3b7fe640 1 --2- 172.21.15.88:0/2948750919 >> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] conn(0x7efd1c06c7a0 0x7efd1c06ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.613+0000 7efd327fc640 1 --2- 172.21.15.88:0/2948750919 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efd1c0664a0 0x7efd1c068960 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efd240af000 tx=0x7efd24001a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:40.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.613+0000 7efd33fff640 1 -- 172.21.15.88:0/2948750919 <== osd.0 v2:172.21.15.88:6808/2669156900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efd1c06f2b0 con 0x7efd1c06c7a0 2023-11-20T07:02:40.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.625+0000 7efd417d3640 1 -- 172.21.15.88:0/2948750919 --> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efd3c15d3e0 con 0x7efd1c06c7a0 2023-11-20T07:02:40.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.625+0000 7efd33fff640 1 -- 172.21.15.88:0/2948750919 <== osd.0 v2:172.21.15.88:6808/2669156900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efd340059a0 con 0x7efd1c06c7a0 2023-11-20T07:02:40.627 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:02:40.628 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T07:02:40.628 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:02:40.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.625+0000 7efd417d3640 1 -- 172.21.15.88:0/2948750919 >> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] conn(0x7efd1c06c7a0 msgr2=0x7efd1c06ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.625+0000 7efd417d3640 1 --2- 172.21.15.88:0/2948750919 >> [v2:172.21.15.88:6808/2669156900,v1:172.21.15.88:6809/2669156900] conn(0x7efd1c06c7a0 0x7efd1c06ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.625+0000 7efd417d3640 1 -- 172.21.15.88:0/2948750919 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efd1c0664a0 msgr2=0x7efd1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.625+0000 7efd417d3640 1 --2- 172.21.15.88:0/2948750919 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7efd1c0664a0 0x7efd1c068960 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efd240af000 tx=0x7efd24001a10 comp rx=0 tx=0).stop 2023-11-20T07:02:40.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.625+0000 7efd417d3640 1 -- 172.21.15.88:0/2948750919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd280047d0 msgr2=0x7efd3c1573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.625+0000 7efd417d3640 1 --2- 172.21.15.88:0/2948750919 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd280047d0 0x7efd3c1573f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00e8f0 tx=0x7efd2c00edb0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.625+0000 7efd3b7fe640 1 -- 172.21.15.88:0/2948750919 reap_dead start 2023-11-20T07:02:40.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.625+0000 7efd417d3640 1 -- 172.21.15.88:0/2948750919 shutdown_connections 2023-11-20T07:02:40.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.625+0000 7efd417d3640 1 -- 172.21.15.88:0/2948750919 >> 172.21.15.88:0/2948750919 conn(0x7efd3c0715c0 msgr2=0x7efd3c15a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:40.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.629+0000 7efd417d3640 1 -- 172.21.15.88:0/2948750919 shutdown_connections 2023-11-20T07:02:40.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.629+0000 7efd417d3640 1 -- 172.21.15.88:0/2948750919 wait complete. 2023-11-20T07:02:40.646 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-20T07:02:40.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c17165640 1 Processor -- start 2023-11-20T07:02:40.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c17165640 1 -- start start 2023-11-20T07:02:40.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c17165640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2c100b21c0 0x7f2c100b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c17165640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2c100c4290 0x7f2c100c4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c17165640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c100c7110 con 0x7f2c1015a800 2023-11-20T07:02:40.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c17165640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c100b2b70 con 0x7f2c100c4290 2023-11-20T07:02:40.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c17165640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c100d04c0 con 0x7f2c100b21c0 2023-11-20T07:02:40.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c14f01640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2c1015a800 0x7f2c100cfdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55854/0 (socket says 172.21.15.88:55854) 2023-11-20T07:02:40.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c14f01640 1 -- 172.21.15.88:0/2620992824 learned_addr learned my addr 172.21.15.88:0/2620992824 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:40.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c15702640 1 --2- 172.21.15.88:0/2620992824 >> v2:172.21.15.88:3300/0 conn(0x7f2c100c4290 0x7f2c100c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c07fff640 1 --2- 172.21.15.88:0/2620992824 >> v2:172.21.15.175:3300/0 conn(0x7f2c100b21c0 0x7f2c100b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c077fe640 1 -- 172.21.15.88:0/2620992824 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805609858 0 0) 0x7f2c100c7110 con 0x7f2c1015a800 2023-11-20T07:02:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c077fe640 1 -- 172.21.15.88:0/2620992824 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf8003530 con 0x7f2c1015a800 2023-11-20T07:02:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c15702640 1 -- 172.21.15.88:0/2620992824 >> v2:172.21.15.175:3300/0 conn(0x7f2c100b21c0 msgr2=0x7f2c100b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c15702640 1 --2- 172.21.15.88:0/2620992824 >> v2:172.21.15.175:3300/0 conn(0x7f2c100b21c0 0x7f2c100b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c15702640 1 -- 172.21.15.88:0/2620992824 >> v1:172.21.15.88:6789/0 conn(0x7f2c1015a800 legacy=0x7f2c100cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.785+0000 7f2c15702640 1 -- 172.21.15.88:0/2620992824 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100cf820 con 0x7f2c100c4290 2023-11-20T07:02:40.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.789+0000 7f2c15702640 1 --2- 172.21.15.88:0/2620992824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c100c4290 0x7f2c100c4720 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2c1006f470 tx=0x7f2c0801c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c0625265efffb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:40.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.789+0000 7f2c077fe640 1 -- 172.21.15.88:0/2620992824 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080a58e0 con 0x7f2c100c4290 2023-11-20T07:02:40.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.789+0000 7f2c077fe640 1 -- 172.21.15.88:0/2620992824 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c080a5a40 con 0x7f2c100c4290 2023-11-20T07:02:40.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.789+0000 7f2c077fe640 1 -- 172.21.15.88:0/2620992824 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080a5dd0 con 0x7f2c100c4290 2023-11-20T07:02:40.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.789+0000 7f2c17165640 1 -- 172.21.15.88:0/2620992824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c100c4290 msgr2=0x7f2c100c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.789+0000 7f2c17165640 1 --2- 172.21.15.88:0/2620992824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c100c4290 0x7f2c100c4720 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2c1006f470 tx=0x7f2c0801c820 comp rx=0 tx=0).stop 2023-11-20T07:02:40.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.789+0000 7f2c17165640 1 -- 172.21.15.88:0/2620992824 shutdown_connections 2023-11-20T07:02:40.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.789+0000 7f2c17165640 1 --2- 172.21.15.88:0/2620992824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c100c4290 0x7f2c100c4720 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.789+0000 7f2c17165640 1 --2- 172.21.15.88:0/2620992824 >> v2:172.21.15.175:3300/0 conn(0x7f2c100b21c0 0x7f2c100b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.789+0000 7f2c17165640 1 -- 172.21.15.88:0/2620992824 >> 172.21.15.88:0/2620992824 conn(0x7f2c100cd1c0 msgr2=0x7f2c100cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:40.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.789+0000 7f2c17165640 1 -- 172.21.15.88:0/2620992824 shutdown_connections 2023-11-20T07:02:40.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.789+0000 7f2c17165640 1 -- 172.21.15.88:0/2620992824 wait complete. 2023-11-20T07:02:40.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c17165640 1 Processor -- start 2023-11-20T07:02:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c17165640 1 -- start start 2023-11-20T07:02:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c17165640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c100b21c0 0x7f2c101f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c17165640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c100c4290 0x7f2c100c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c17165640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1015a800 0x7f2c100c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c17165640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1015f660 con 0x7f2c100b21c0 2023-11-20T07:02:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c17165640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c101f3b00 con 0x7f2c100c4290 2023-11-20T07:02:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c17165640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10154d80 con 0x7f2c1015a800 2023-11-20T07:02:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c14f01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c100b21c0 0x7f2c101f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c14f01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c100b21c0 0x7f2c101f35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50072/0 (socket says 172.21.15.88:50072) 2023-11-20T07:02:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c14f01640 1 -- 172.21.15.88:0/2110061708 learned_addr learned my addr 172.21.15.88:0/2110061708 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:40.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c07fff640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c100c4290 0x7f2c100c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c14f01640 1 -- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1015a800 msgr2=0x7f2c100c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c15702640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1015a800 0x7f2c100c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c14f01640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1015a800 0x7f2c100c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c14f01640 1 -- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c100c4290 msgr2=0x7f2c100c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c14f01640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c100c4290 0x7f2c100c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c14f01640 1 -- 172.21.15.88:0/2110061708 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c08009a70 con 0x7f2c100b21c0 2023-11-20T07:02:40.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c07fff640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c100c4290 0x7f2c100c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:40.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c15702640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1015a800 0x7f2c100c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:40.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c14f01640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c100b21c0 0x7f2c101f35c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c3f0 tx=0x7f2c0c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c057fa640 1 -- 172.21.15.88:0/2110061708 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c005cf0 con 0x7f2c100b21c0 2023-11-20T07:02:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c057fa640 1 -- 172.21.15.88:0/2110061708 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c005e50 con 0x7f2c100b21c0 2023-11-20T07:02:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c057fa640 1 -- 172.21.15.88:0/2110061708 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0072f0 con 0x7f2c100b21c0 2023-11-20T07:02:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c17165640 1 -- 172.21.15.88:0/2110061708 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1015e640 con 0x7f2c100b21c0 2023-11-20T07:02:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.793+0000 7f2c17165640 1 -- 172.21.15.88:0/2110061708 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c10154730 con 0x7f2c100b21c0 2023-11-20T07:02:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.797+0000 7f2c17165640 1 -- 172.21.15.88:0/2110061708 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c10074010 con 0x7f2c100b21c0 2023-11-20T07:02:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.797+0000 7f2c057fa640 1 -- 172.21.15.88:0/2110061708 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2c0c007450 con 0x7f2c100b21c0 2023-11-20T07:02:40.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.797+0000 7f2c057fa640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2bfc0664a0 0x7f2bfc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:40.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.797+0000 7f2c057fa640 1 -- 172.21.15.88:0/2110061708 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2c0c0832f0 con 0x7f2c100b21c0 2023-11-20T07:02:40.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.797+0000 7f2c07fff640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2bfc0664a0 0x7f2bfc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:40.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.797+0000 7f2c07fff640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2bfc0664a0 0x7f2bfc068960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2c100b5430 tx=0x7f2c00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:40.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.801+0000 7f2c057fa640 1 -- 172.21.15.88:0/2110061708 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2c0c050930 con 0x7f2c100b21c0 2023-11-20T07:02:40.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.949+0000 7f2c17165640 1 -- 172.21.15.88:0/2110061708 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c100cf020 con 0x7f2bfc0664a0 2023-11-20T07:02:40.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.949+0000 7f2c057fa640 1 -- 172.21.15.88:0/2110061708 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2c00004020 con 0x7f2bfc0664a0 2023-11-20T07:02:40.951 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 0 to deep-scrub 2023-11-20T07:02:40.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.953+0000 7f2c17165640 1 -- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2bfc0664a0 msgr2=0x7f2bfc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.953+0000 7f2c17165640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2bfc0664a0 0x7f2bfc068960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2c100b5430 tx=0x7f2c00008040 comp rx=0 tx=0).stop 2023-11-20T07:02:40.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.953+0000 7f2c17165640 1 -- 172.21.15.88:0/2110061708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c100b21c0 msgr2=0x7f2c101f35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:40.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.953+0000 7f2c17165640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c100b21c0 0x7f2c101f35c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c3f0 tx=0x7f2c0c00c8b0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.953+0000 7f2c17165640 1 -- 172.21.15.88:0/2110061708 shutdown_connections 2023-11-20T07:02:40.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.953+0000 7f2c17165640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2bfc0664a0 0x7f2bfc068960 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.953+0000 7f2c17165640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1015a800 0x7f2c100c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.953+0000 7f2c17165640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c100c4290 0x7f2c100c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.953+0000 7f2c17165640 1 --2- 172.21.15.88:0/2110061708 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c100b21c0 0x7f2c101f35c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:40.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.953+0000 7f2c17165640 1 -- 172.21.15.88:0/2110061708 >> 172.21.15.88:0/2110061708 conn(0x7f2c100cd1c0 msgr2=0x7f2c100b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:40.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.953+0000 7f2c17165640 1 -- 172.21.15.88:0/2110061708 shutdown_connections 2023-11-20T07:02:40.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:40.953+0000 7f2c17165640 1 -- 172.21.15.88:0/2110061708 wait complete. 2023-11-20T07:02:40.972 INFO:tasks.ceph:Scrubbing osd.1 2023-11-20T07:02:40.972 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-20T07:02:41.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bcd19d640 1 Processor -- start 2023-11-20T07:02:41.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bcd19d640 1 -- start start 2023-11-20T07:02:41.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bcd19d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2bc81441a0 0x7f2bc80b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bcd19d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2bc80b1a90 0x7f2bc80cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bcd19d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc815e5f0 con 0x7f2bc80cb360 2023-11-20T07:02:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bcd19d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc80b1f20 con 0x7f2bc81441a0 2023-11-20T07:02:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bcd19d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc815e8d0 con 0x7f2bc80b1a90 2023-11-20T07:02:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bc6d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2bc81441a0 0x7f2bc80b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bc6d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2bc81441a0 0x7f2bc80b1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50078/0 (socket says 172.21.15.88:50078) 2023-11-20T07:02:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bc6d9d640 1 -- 172.21.15.88:0/1967188262 learned_addr learned my addr 172.21.15.88:0/1967188262 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:41.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bc659c640 1 --2- 172.21.15.88:0/1967188262 >> v2:172.21.15.175:3300/0 conn(0x7f2bc80b1a90 0x7f2bc80cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bc6d9d640 1 -- 172.21.15.88:0/1967188262 >> v2:172.21.15.175:3300/0 conn(0x7f2bc80b1a90 msgr2=0x7f2bc80cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bc6d9d640 1 --2- 172.21.15.88:0/1967188262 >> v2:172.21.15.175:3300/0 conn(0x7f2bc80b1a90 0x7f2bc80cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bc6d9d640 1 -- 172.21.15.88:0/1967188262 >> v1:172.21.15.175:6789/0 conn(0x7f2bc80cb360 legacy=0x7f2bc806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.113+0000 7f2bc6d9d640 1 -- 172.21.15.88:0/1967188262 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc815ebb0 con 0x7f2bc81441a0 2023-11-20T07:02:41.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.117+0000 7f2bc6d9d640 1 --2- 172.21.15.88:0/1967188262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc81441a0 0x7f2bc80b1550 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2bc806d580 tx=0x7f2bb801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311bf417fffd8c9c server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.117+0000 7f2bc5d9b640 1 -- 172.21.15.88:0/1967188262 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb80ab600 con 0x7f2bc81441a0 2023-11-20T07:02:41.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.117+0000 7f2bc5d9b640 1 -- 172.21.15.88:0/1967188262 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb80a7050 con 0x7f2bc81441a0 2023-11-20T07:02:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.117+0000 7f2bc5d9b640 1 -- 172.21.15.88:0/1967188262 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb80ab980 con 0x7f2bc81441a0 2023-11-20T07:02:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.117+0000 7f2bcd19d640 1 -- 172.21.15.88:0/1967188262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc81441a0 msgr2=0x7f2bc80b1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.117+0000 7f2bcd19d640 1 --2- 172.21.15.88:0/1967188262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc81441a0 0x7f2bc80b1550 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2bc806d580 tx=0x7f2bb801c500 comp rx=0 tx=0).stop 2023-11-20T07:02:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.117+0000 7f2bcd19d640 1 -- 172.21.15.88:0/1967188262 shutdown_connections 2023-11-20T07:02:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.117+0000 7f2bcd19d640 1 --2- 172.21.15.88:0/1967188262 >> v2:172.21.15.175:3300/0 conn(0x7f2bc80b1a90 0x7f2bc80cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.117+0000 7f2bcd19d640 1 --2- 172.21.15.88:0/1967188262 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc81441a0 0x7f2bc80b1550 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.117+0000 7f2bcd19d640 1 -- 172.21.15.88:0/1967188262 >> 172.21.15.88:0/1967188262 conn(0x7f2bc806a820 msgr2=0x7f2bc80b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.117+0000 7f2bcd19d640 1 -- 172.21.15.88:0/1967188262 shutdown_connections 2023-11-20T07:02:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.117+0000 7f2bcd19d640 1 -- 172.21.15.88:0/1967188262 wait complete. 2023-11-20T07:02:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bcd19d640 1 Processor -- start 2023-11-20T07:02:41.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bcd19d640 1 -- start start 2023-11-20T07:02:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bcd19d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc80b1a90 0x7f2bc8070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bcd19d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc80cb360 0x7f2bc813d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bcd19d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc81441a0 0x7f2bc81f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bcd19d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc813dda0 con 0x7f2bc80cb360 2023-11-20T07:02:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bcd19d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc813ebe0 con 0x7f2bc80b1a90 2023-11-20T07:02:41.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bcd19d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc813dfd0 con 0x7f2bc81441a0 2023-11-20T07:02:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bc659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc80cb360 0x7f2bc813d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bc659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc80cb360 0x7f2bc813d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50080/0 (socket says 172.21.15.88:50080) 2023-11-20T07:02:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bc659c640 1 -- 172.21.15.88:0/2132806698 learned_addr learned my addr 172.21.15.88:0/2132806698 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bc6d9d640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc80b1a90 0x7f2bc8070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bc759e640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc81441a0 0x7f2bc81f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bc6d9d640 1 -- 172.21.15.88:0/2132806698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc81441a0 msgr2=0x7f2bc81f82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bc6d9d640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc81441a0 0x7f2bc81f82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bc6d9d640 1 -- 172.21.15.88:0/2132806698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc80cb360 msgr2=0x7f2bc813d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bc6d9d640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc80cb360 0x7f2bc813d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bc6d9d640 1 -- 172.21.15.88:0/2132806698 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb80094d0 con 0x7f2bc80b1a90 2023-11-20T07:02:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bc659c640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bc80cb360 0x7f2bc813d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bc6d9d640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc80b1a90 0x7f2bc8070ba0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80ab000 tx=0x7f2bb80192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2baf7fe640 1 -- 172.21.15.88:0/2132806698 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb80b4420 con 0x7f2bc80b1a90 2023-11-20T07:02:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2baf7fe640 1 -- 172.21.15.88:0/2132806698 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb80b45a0 con 0x7f2bc80b1a90 2023-11-20T07:02:41.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bcd19d640 1 -- 172.21.15.88:0/2132806698 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc813e2b0 con 0x7f2bc80b1a90 2023-11-20T07:02:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2baf7fe640 1 -- 172.21.15.88:0/2132806698 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb80b4950 con 0x7f2bc80b1a90 2023-11-20T07:02:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bcd19d640 1 -- 172.21.15.88:0/2132806698 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc813e870 con 0x7f2bc80b1a90 2023-11-20T07:02:41.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.121+0000 7f2bcd19d640 1 -- 172.21.15.88:0/2132806698 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bc80c9fd0 con 0x7f2bc80b1a90 2023-11-20T07:02:41.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.125+0000 7f2baf7fe640 1 -- 172.21.15.88:0/2132806698 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2bb80b2070 con 0x7f2bc80b1a90 2023-11-20T07:02:41.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.125+0000 7f2baf7fe640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2bb40664a0 0x7f2bb4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.125+0000 7f2baf7fe640 1 -- 172.21.15.88:0/2132806698 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2bb811cfd0 con 0x7f2bc80b1a90 2023-11-20T07:02:41.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.125+0000 7f2baf7fe640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] conn(0x7f2bb406c7a0 0x7f2bb406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.125+0000 7f2baf7fe640 1 -- 172.21.15.88:0/2132806698 --> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2bb406f2b0 con 0x7f2bb406c7a0 2023-11-20T07:02:41.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.125+0000 7f2baf7fe640 1 -- 172.21.15.88:0/2132806698 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bb811d420 con 0x7f2bc80b1a90 2023-11-20T07:02:41.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.125+0000 7f2bc659c640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2bb40664a0 0x7f2bb4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.125+0000 7f2bc759e640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] conn(0x7f2bb406c7a0 0x7f2bb406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.125+0000 7f2bc759e640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] conn(0x7f2bb406c7a0 0x7f2bb406ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.125+0000 7f2bc659c640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2bb40664a0 0x7f2bb4068960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2bc813a8e0 tx=0x7f2bbc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.125+0000 7f2baf7fe640 1 -- 172.21.15.88:0/2132806698 <== osd.1 v2:172.21.15.88:6823/1785526127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2bb406f2b0 con 0x7f2bb406c7a0 2023-11-20T07:02:41.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2bcd19d640 1 -- 172.21.15.88:0/2132806698 --> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2bc804e170 con 0x7f2bb406c7a0 2023-11-20T07:02:41.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2baf7fe640 1 -- 172.21.15.88:0/2132806698 <== osd.1 v2:172.21.15.88:6823/1785526127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2bc804e170 con 0x7f2bb406c7a0 2023-11-20T07:02:41.141 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:02:41.141 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T07:02:41.141 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:02:41.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2bcd19d640 1 -- 172.21.15.88:0/2132806698 >> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] conn(0x7f2bb406c7a0 msgr2=0x7f2bb406ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2bcd19d640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.88:6823/1785526127,v1:172.21.15.88:6825/1785526127] conn(0x7f2bb406c7a0 0x7f2bb406ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2bcd19d640 1 -- 172.21.15.88:0/2132806698 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2bb40664a0 msgr2=0x7f2bb4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2bcd19d640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f2bb40664a0 0x7f2bb4068960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2bc813a8e0 tx=0x7f2bbc009190 comp rx=0 tx=0).stop 2023-11-20T07:02:41.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2bcd19d640 1 -- 172.21.15.88:0/2132806698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc80b1a90 msgr2=0x7f2bc8070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2bcd19d640 1 --2- 172.21.15.88:0/2132806698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc80b1a90 0x7f2bc8070ba0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80ab000 tx=0x7f2bb80192a0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2bc759e640 1 -- 172.21.15.88:0/2132806698 reap_dead start 2023-11-20T07:02:41.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2bcd19d640 1 -- 172.21.15.88:0/2132806698 shutdown_connections 2023-11-20T07:02:41.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2bcd19d640 1 -- 172.21.15.88:0/2132806698 >> 172.21.15.88:0/2132806698 conn(0x7f2bc806a820 msgr2=0x7f2bc80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:41.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2bcd19d640 1 -- 172.21.15.88:0/2132806698 shutdown_connections 2023-11-20T07:02:41.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.141+0000 7f2bcd19d640 1 -- 172.21.15.88:0/2132806698 wait complete. 2023-11-20T07:02:41.158 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-20T07:02:41.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f5961c68640 1 Processor -- start 2023-11-20T07:02:41.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f5961c68640 1 -- start start 2023-11-20T07:02:41.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f5961c68640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f595c15cd10 0x7f595c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f5961c68640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595c06a340 0x7f595c071990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f5961c68640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c15e390 con 0x7f595c069e90 2023-11-20T07:02:41.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f5961c68640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c161990 con 0x7f595c15cd10 2023-11-20T07:02:41.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f5961c68640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0ca150 con 0x7f595c06a340 2023-11-20T07:02:41.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f595b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f595c15cd10 0x7f595c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f595b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f595c15cd10 0x7f595c15de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50084/0 (socket says 172.21.15.88:50084) 2023-11-20T07:02:41.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f595b7fe640 1 -- 172.21.15.88:0/2596705850 learned_addr learned my addr 172.21.15.88:0/2596705850 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:41.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f595bfff640 1 --2- 172.21.15.88:0/2596705850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595c06a340 0x7f595c071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f595b7fe640 1 -- 172.21.15.88:0/2596705850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595c06a340 msgr2=0x7f595c071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:41.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f595b7fe640 1 --2- 172.21.15.88:0/2596705850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595c06a340 0x7f595c071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f595b7fe640 1 -- 172.21.15.88:0/2596705850 >> v1:172.21.15.175:6789/0 conn(0x7f595c069e90 legacy=0x7f595c071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f595b7fe640 1 -- 172.21.15.88:0/2596705850 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c06a790 con 0x7f595c15cd10 2023-11-20T07:02:41.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.297+0000 7f595bfff640 1 --2- 172.21.15.88:0/2596705850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595c06a340 0x7f595c071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:41.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f595b7fe640 1 --2- 172.21.15.88:0/2596705850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c15cd10 0x7f595c15de50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f594c009870 tx=0x7f594c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d999c7ec97db0bb server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f595a7fc640 1 -- 172.21.15.88:0/2596705850 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c0a9400 con 0x7f595c15cd10 2023-11-20T07:02:41.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f595a7fc640 1 -- 172.21.15.88:0/2596705850 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c0a9560 con 0x7f595c15cd10 2023-11-20T07:02:41.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f595a7fc640 1 -- 172.21.15.88:0/2596705850 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c0a98f0 con 0x7f595c15cd10 2023-11-20T07:02:41.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f5961c68640 1 -- 172.21.15.88:0/2596705850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c15cd10 msgr2=0x7f595c15de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f5961c68640 1 --2- 172.21.15.88:0/2596705850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c15cd10 0x7f595c15de50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f594c009870 tx=0x7f594c01c540 comp rx=0 tx=0).stop 2023-11-20T07:02:41.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f5961c68640 1 -- 172.21.15.88:0/2596705850 shutdown_connections 2023-11-20T07:02:41.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f5961c68640 1 --2- 172.21.15.88:0/2596705850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595c06a340 0x7f595c071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f5961c68640 1 --2- 172.21.15.88:0/2596705850 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c15cd10 0x7f595c15de50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f5961c68640 1 -- 172.21.15.88:0/2596705850 >> 172.21.15.88:0/2596705850 conn(0x7f595c06d310 msgr2=0x7f595c06d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:41.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f5961c68640 1 -- 172.21.15.88:0/2596705850 shutdown_connections 2023-11-20T07:02:41.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f5961c68640 1 -- 172.21.15.88:0/2596705850 wait complete. 2023-11-20T07:02:41.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.301+0000 7f5961c68640 1 Processor -- start 2023-11-20T07:02:41.304 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5961c68640 1 -- start start 2023-11-20T07:02:41.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5961c68640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c069e90 0x7f595c14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5961c68640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595c06a340 0x7f595c155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5961c68640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595c15cd10 0x7f595c156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5961c68640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c14c820 con 0x7f595c069e90 2023-11-20T07:02:41.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5961c68640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0af420 con 0x7f595c06a340 2023-11-20T07:02:41.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5961c68640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0c4660 con 0x7f595c15cd10 2023-11-20T07:02:41.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f595b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c069e90 0x7f595c14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f595b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c069e90 0x7f595c14c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50100/0 (socket says 172.21.15.88:50100) 2023-11-20T07:02:41.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f595b7fe640 1 -- 172.21.15.88:0/3174446773 learned_addr learned my addr 172.21.15.88:0/3174446773 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:41.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f595bfff640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595c15cd10 0x7f595c156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f595affd640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595c06a340 0x7f595c155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f595b7fe640 1 -- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595c15cd10 msgr2=0x7f595c156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f595b7fe640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595c15cd10 0x7f595c156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f595b7fe640 1 -- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595c06a340 msgr2=0x7f595c155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f595b7fe640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595c06a340 0x7f595c155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f595b7fe640 1 -- 172.21.15.88:0/3174446773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f594c0094d0 con 0x7f595c069e90 2023-11-20T07:02:41.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f595b7fe640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c069e90 0x7f595c14c2e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f594c01abf0 tx=0x7f594c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5943fff640 1 -- 172.21.15.88:0/3174446773 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c0a9400 con 0x7f595c069e90 2023-11-20T07:02:41.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5943fff640 1 -- 172.21.15.88:0/3174446773 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c0b1800 con 0x7f595c069e90 2023-11-20T07:02:41.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5943fff640 1 -- 172.21.15.88:0/3174446773 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c0b1bb0 con 0x7f595c069e90 2023-11-20T07:02:41.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5961c68640 1 -- 172.21.15.88:0/3174446773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c0af6c0 con 0x7f595c069e90 2023-11-20T07:02:41.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5961c68640 1 -- 172.21.15.88:0/3174446773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c0afc80 con 0x7f595c069e90 2023-11-20T07:02:41.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.305+0000 7f5961c68640 1 -- 172.21.15.88:0/3174446773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595c0afe70 con 0x7f595c069e90 2023-11-20T07:02:41.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.309+0000 7f5943fff640 1 -- 172.21.15.88:0/3174446773 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f594c0b1d10 con 0x7f595c069e90 2023-11-20T07:02:41.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.309+0000 7f5943fff640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f59480664a0 0x7f5948068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.309+0000 7f5943fff640 1 -- 172.21.15.88:0/3174446773 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f594c11e3d0 con 0x7f595c069e90 2023-11-20T07:02:41.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.309+0000 7f595affd640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f59480664a0 0x7f5948068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.309+0000 7f595affd640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f59480664a0 0x7f5948068960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f595c0c2580 tx=0x7f5950009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.313+0000 7f5943fff640 1 -- 172.21.15.88:0/3174446773 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f594c0ebb30 con 0x7f595c069e90 2023-11-20T07:02:41.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 -- 172.21.15.88:0/3174446773 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f595c1616b0 con 0x7f59480664a0 2023-11-20T07:02:41.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5943fff640 1 -- 172.21.15.88:0/3174446773 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f59500050d0 con 0x7f59480664a0 2023-11-20T07:02:41.462 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 1 to deep-scrub 2023-11-20T07:02:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 -- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f59480664a0 msgr2=0x7f5948068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f59480664a0 0x7f5948068960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f595c0c2580 tx=0x7f5950009040 comp rx=0 tx=0).stop 2023-11-20T07:02:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 -- 172.21.15.88:0/3174446773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c069e90 msgr2=0x7f595c14c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c069e90 0x7f595c14c2e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f594c01abf0 tx=0x7f594c01ad80 comp rx=0 tx=0).stop 2023-11-20T07:02:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 -- 172.21.15.88:0/3174446773 shutdown_connections 2023-11-20T07:02:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f59480664a0 0x7f5948068960 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f595c15cd10 0x7f595c156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f595c06a340 0x7f595c155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 --2- 172.21.15.88:0/3174446773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f595c069e90 0x7f595c14c2e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 -- 172.21.15.88:0/3174446773 >> 172.21.15.88:0/3174446773 conn(0x7f595c06d310 msgr2=0x7f595c15e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 -- 172.21.15.88:0/3174446773 shutdown_connections 2023-11-20T07:02:41.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.461+0000 7f5961c68640 1 -- 172.21.15.88:0/3174446773 wait complete. 2023-11-20T07:02:41.483 INFO:tasks.ceph:Scrubbing osd.2 2023-11-20T07:02:41.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-20T07:02:41.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.625+0000 7fe810b0f640 1 Processor -- start 2023-11-20T07:02:41.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.625+0000 7fe810b0f640 1 -- start start 2023-11-20T07:02:41.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.625+0000 7fe810b0f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe80c1595a0 0x7fe80c06c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.625+0000 7fe810b0f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c0c8a20 con 0x7fe80c0b42d0 2023-11-20T07:02:41.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.625+0000 7fe810b0f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c0c8c10 con 0x7fe80c159980 2023-11-20T07:02:41.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.625+0000 7fe810b0f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c0c8ef0 con 0x7fe80c1595a0 2023-11-20T07:02:41.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.629+0000 7fe80ad9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe80c0b42d0 0x7fe80c15d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55862/0 (socket says 172.21.15.88:55862) 2023-11-20T07:02:41.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.629+0000 7fe80ad9d640 1 -- 172.21.15.88:0/1537170499 learned_addr learned my addr 172.21.15.88:0/1537170499 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:41.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.629+0000 7fe80a59c640 1 --2- 172.21.15.88:0/1537170499 >> v2:172.21.15.175:3300/0 conn(0x7fe80c1595a0 0x7fe80c06c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.629+0000 7fe80959a640 1 -- 172.21.15.88:0/1537170499 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970329534 0 0) 0x7fe80c0c8a20 con 0x7fe80c0b42d0 2023-11-20T07:02:41.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.629+0000 7fe80959a640 1 -- 172.21.15.88:0/1537170499 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f4005740 con 0x7fe80c0b42d0 2023-11-20T07:02:41.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.629+0000 7fe80a59c640 1 -- 172.21.15.88:0/1537170499 >> v1:172.21.15.175:6789/0 conn(0x7fe80c159980 legacy=0x7fe80c0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.629+0000 7fe80a59c640 1 -- 172.21.15.88:0/1537170499 >> v1:172.21.15.88:6789/0 conn(0x7fe80c0b42d0 legacy=0x7fe80c15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.629+0000 7fe80a59c640 1 -- 172.21.15.88:0/1537170499 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c0c91d0 con 0x7fe80c1595a0 2023-11-20T07:02:41.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.629+0000 7fe80a59c640 1 --2- 172.21.15.88:0/1537170499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c1595a0 0x7fe80c06c4b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0097c0 tx=0x7fe7fc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6300591dcbb588e server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.629+0000 7fe80959a640 1 -- 172.21.15.88:0/1537170499 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0ab600 con 0x7fe80c1595a0 2023-11-20T07:02:41.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.629+0000 7fe80959a640 1 -- 172.21.15.88:0/1537170499 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc0a7050 con 0x7fe80c1595a0 2023-11-20T07:02:41.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.629+0000 7fe80959a640 1 -- 172.21.15.88:0/1537170499 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0ab980 con 0x7fe80c1595a0 2023-11-20T07:02:41.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 -- 172.21.15.88:0/1537170499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c1595a0 msgr2=0x7fe80c06c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 --2- 172.21.15.88:0/1537170499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c1595a0 0x7fe80c06c4b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0097c0 tx=0x7fe7fc01c3c0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 -- 172.21.15.88:0/1537170499 shutdown_connections 2023-11-20T07:02:41.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 --2- 172.21.15.88:0/1537170499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c1595a0 0x7fe80c06c4b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 -- 172.21.15.88:0/1537170499 >> 172.21.15.88:0/1537170499 conn(0x7fe80c06a820 msgr2=0x7fe80c0b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 -- 172.21.15.88:0/1537170499 shutdown_connections 2023-11-20T07:02:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 -- 172.21.15.88:0/1537170499 wait complete. 2023-11-20T07:02:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 Processor -- start 2023-11-20T07:02:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 -- start start 2023-11-20T07:02:41.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe80c0b42d0 0x7fe80c15ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c1595a0 0x7fe80c14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c14c3c0 0x7fe80c15e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c15ef40 con 0x7fe80c0b42d0 2023-11-20T07:02:41.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c15f220 con 0x7fe80c14c3c0 2023-11-20T07:02:41.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.633+0000 7fe810b0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c15f500 con 0x7fe80c1595a0 2023-11-20T07:02:41.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe80a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe80c0b42d0 0x7fe80c15ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe80a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe80c0b42d0 0x7fe80c15ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50106/0 (socket says 172.21.15.88:50106) 2023-11-20T07:02:41.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe80a59c640 1 -- 172.21.15.88:0/1308981010 learned_addr learned my addr 172.21.15.88:0/1308981010 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe80ad9d640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c14c3c0 0x7fe80c15e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe809d9b640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c1595a0 0x7fe80c14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe80a59c640 1 -- 172.21.15.88:0/1308981010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c1595a0 msgr2=0x7fe80c14be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe80a59c640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c1595a0 0x7fe80c14be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe80a59c640 1 -- 172.21.15.88:0/1308981010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c14c3c0 msgr2=0x7fe80c15e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe80a59c640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c14c3c0 0x7fe80c15e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe80a59c640 1 -- 172.21.15.88:0/1308981010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc009420 con 0x7fe80c0b42d0 2023-11-20T07:02:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe80a59c640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe80c0b42d0 0x7fe80c15ffe0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc018fd0 tx=0x7fe7fc01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe7faffd640 1 -- 172.21.15.88:0/1308981010 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0b7450 con 0x7fe80c0b42d0 2023-11-20T07:02:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe7faffd640 1 -- 172.21.15.88:0/1308981010 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc0b75b0 con 0x7fe80c0b42d0 2023-11-20T07:02:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe810b0f640 1 -- 172.21.15.88:0/1308981010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c15f7e0 con 0x7fe80c0b42d0 2023-11-20T07:02:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe7faffd640 1 -- 172.21.15.88:0/1308981010 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc0b7960 con 0x7fe80c0b42d0 2023-11-20T07:02:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe810b0f640 1 -- 172.21.15.88:0/1308981010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c0afaa0 con 0x7fe80c0b42d0 2023-11-20T07:02:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe810b0f640 1 -- 172.21.15.88:0/1308981010 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe80c15f390 con 0x7fe80c0b42d0 2023-11-20T07:02:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe7faffd640 1 -- 172.21.15.88:0/1308981010 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe7fc0b7ac0 con 0x7fe80c0b42d0 2023-11-20T07:02:41.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.637+0000 7fe7faffd640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe7ec0664d0 0x7fe7ec068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.641+0000 7fe7faffd640 1 -- 172.21.15.88:0/1308981010 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe7fc11e380 con 0x7fe80c0b42d0 2023-11-20T07:02:41.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.641+0000 7fe7faffd640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] conn(0x7fe7ec06c7d0 0x7fe7ec06ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.641+0000 7fe7faffd640 1 -- 172.21.15.88:0/1308981010 --> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7ec06f2e0 con 0x7fe7ec06c7d0 2023-11-20T07:02:41.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.641+0000 7fe7faffd640 1 -- 172.21.15.88:0/1308981010 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7fc120960 con 0x7fe80c0b42d0 2023-11-20T07:02:41.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.641+0000 7fe809d9b640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe7ec0664d0 0x7fe7ec068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.641+0000 7fe80ad9d640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] conn(0x7fe7ec06c7d0 0x7fe7ec06ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.641+0000 7fe80ad9d640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] conn(0x7fe7ec06c7d0 0x7fe7ec06ec10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.641+0000 7fe809d9b640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe7ec0664d0 0x7fe7ec068990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0705a0 tx=0x7fe800009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.641+0000 7fe7faffd640 1 -- 172.21.15.88:0/1308981010 <== osd.2 v2:172.21.15.88:6800/1256076870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe7ec06f2e0 con 0x7fe7ec06c7d0 2023-11-20T07:02:41.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe810b0f640 1 -- 172.21.15.88:0/1308981010 --> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe80c0cb040 con 0x7fe7ec06c7d0 2023-11-20T07:02:41.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe7faffd640 1 -- 172.21.15.88:0/1308981010 <== osd.2 v2:172.21.15.88:6800/1256076870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe804001fb0 con 0x7fe7ec06c7d0 2023-11-20T07:02:41.655 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:02:41.656 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T07:02:41.656 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:02:41.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe810b0f640 1 -- 172.21.15.88:0/1308981010 >> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] conn(0x7fe7ec06c7d0 msgr2=0x7fe7ec06ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe810b0f640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.88:6800/1256076870,v1:172.21.15.88:6801/1256076870] conn(0x7fe7ec06c7d0 0x7fe7ec06ec10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe810b0f640 1 -- 172.21.15.88:0/1308981010 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe7ec0664d0 msgr2=0x7fe7ec068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe810b0f640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe7ec0664d0 0x7fe7ec068990 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0705a0 tx=0x7fe800009040 comp rx=0 tx=0).stop 2023-11-20T07:02:41.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe810b0f640 1 -- 172.21.15.88:0/1308981010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe80c0b42d0 msgr2=0x7fe80c15ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe810b0f640 1 --2- 172.21.15.88:0/1308981010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe80c0b42d0 0x7fe80c15ffe0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc018fd0 tx=0x7fe7fc01ac00 comp rx=0 tx=0).stop 2023-11-20T07:02:41.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe80ad9d640 1 -- 172.21.15.88:0/1308981010 reap_dead start 2023-11-20T07:02:41.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe810b0f640 1 -- 172.21.15.88:0/1308981010 shutdown_connections 2023-11-20T07:02:41.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe810b0f640 1 -- 172.21.15.88:0/1308981010 >> 172.21.15.88:0/1308981010 conn(0x7fe80c06a820 msgr2=0x7fe80c14d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:41.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe810b0f640 1 -- 172.21.15.88:0/1308981010 shutdown_connections 2023-11-20T07:02:41.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.653+0000 7fe810b0f640 1 -- 172.21.15.88:0/1308981010 wait complete. 2023-11-20T07:02:41.673 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-20T07:02:41.811 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.809+0000 7fc2bd580640 1 Processor -- start 2023-11-20T07:02:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.809+0000 7fc2bd580640 1 -- start start 2023-11-20T07:02:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2bd580640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80b2d50 0x7fc2b80cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2bd580640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2b80b37e0 0x7fc2b80cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2bd580640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b80ce960 con 0x7fc2b80b3d30 2023-11-20T07:02:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2bd580640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b80b3130 con 0x7fc2b80b37e0 2023-11-20T07:02:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2bd580640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b80d1980 con 0x7fc2b80b2d50 2023-11-20T07:02:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2b67fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc2b80b3d30 0x7fc2b81608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55868/0 (socket says 172.21.15.88:55868) 2023-11-20T07:02:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2b67fc640 1 -- 172.21.15.88:0/2252688776 learned_addr learned my addr 172.21.15.88:0/2252688776 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2b6ffd640 1 --2- 172.21.15.88:0/2252688776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80b2d50 0x7fc2b80cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2b77fe640 1 --2- 172.21.15.88:0/2252688776 >> v2:172.21.15.175:3300/0 conn(0x7fc2b80b37e0 0x7fc2b80cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2b5ffb640 1 -- 172.21.15.88:0/2252688776 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762287153 0 0) 0x7fc2b80ce960 con 0x7fc2b80b3d30 2023-11-20T07:02:41.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2b5ffb640 1 -- 172.21.15.88:0/2252688776 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2a0003530 con 0x7fc2b80b3d30 2023-11-20T07:02:41.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2b6ffd640 1 -- 172.21.15.88:0/2252688776 >> v2:172.21.15.175:3300/0 conn(0x7fc2b80b37e0 msgr2=0x7fc2b80cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:41.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2b6ffd640 1 --2- 172.21.15.88:0/2252688776 >> v2:172.21.15.175:3300/0 conn(0x7fc2b80b37e0 0x7fc2b80cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2b6ffd640 1 -- 172.21.15.88:0/2252688776 >> v1:172.21.15.88:6789/0 conn(0x7fc2b80b3d30 legacy=0x7fc2b81608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2b6ffd640 1 -- 172.21.15.88:0/2252688776 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b80d0570 con 0x7fc2b80b2d50 2023-11-20T07:02:41.816 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.813+0000 7fc2b5ffb640 1 -- 172.21.15.88:0/2252688776 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1444611415 0 0) 0x7fc2a0003530 con 0x7fc2b80b3d30 2023-11-20T07:02:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.817+0000 7fc2b6ffd640 1 --2- 172.21.15.88:0/2252688776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80b2d50 0x7fc2b80cf1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80097c0 tx=0x7fc2a801c280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0327ad8c378563f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.817+0000 7fc2b5ffb640 1 -- 172.21.15.88:0/2252688776 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac001680 con 0x7fc2b80b2d50 2023-11-20T07:02:41.817 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.817+0000 7fc2b5ffb640 1 -- 172.21.15.88:0/2252688776 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a80a7050 con 0x7fc2b80b2d50 2023-11-20T07:02:41.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.817+0000 7fc2b5ffb640 1 -- 172.21.15.88:0/2252688776 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a80ab620 con 0x7fc2b80b2d50 2023-11-20T07:02:41.818 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.817+0000 7fc2bd580640 1 -- 172.21.15.88:0/2252688776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80b2d50 msgr2=0x7fc2b80cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.817+0000 7fc2bd580640 1 --2- 172.21.15.88:0/2252688776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80b2d50 0x7fc2b80cf1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80097c0 tx=0x7fc2a801c280 comp rx=0 tx=0).stop 2023-11-20T07:02:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.817+0000 7fc2bd580640 1 -- 172.21.15.88:0/2252688776 shutdown_connections 2023-11-20T07:02:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.817+0000 7fc2bd580640 1 --2- 172.21.15.88:0/2252688776 >> v2:172.21.15.175:3300/0 conn(0x7fc2b80b37e0 0x7fc2b80cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.817+0000 7fc2bd580640 1 --2- 172.21.15.88:0/2252688776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80b2d50 0x7fc2b80cf1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.817+0000 7fc2bd580640 1 -- 172.21.15.88:0/2252688776 >> 172.21.15.88:0/2252688776 conn(0x7fc2b80d2790 msgr2=0x7fc2b80d2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.817+0000 7fc2bd580640 1 -- 172.21.15.88:0/2252688776 shutdown_connections 2023-11-20T07:02:41.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.817+0000 7fc2bd580640 1 -- 172.21.15.88:0/2252688776 wait complete. 2023-11-20T07:02:41.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2bd580640 1 Processor -- start 2023-11-20T07:02:41.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2bd580640 1 -- start start 2023-11-20T07:02:41.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2bd580640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b80b2d50 0x7fc2b8157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2bd580640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80b37e0 0x7fc2b80b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.822 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2bd580640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2b80b3d30 0x7fc2b80b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2bd580640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8158a20 con 0x7fc2b80b3d30 2023-11-20T07:02:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2bd580640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81519d0 con 0x7fc2b80b2d50 2023-11-20T07:02:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2bd580640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b80b2270 con 0x7fc2b80b37e0 2023-11-20T07:02:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2b77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2b80b3d30 0x7fc2b80b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2b77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2b80b3d30 0x7fc2b80b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50122/0 (socket says 172.21.15.88:50122) 2023-11-20T07:02:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2b77fe640 1 -- 172.21.15.88:0/2325631360 learned_addr learned my addr 172.21.15.88:0/2325631360 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2b6ffd640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b80b2d50 0x7fc2b8157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2b67fc640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80b37e0 0x7fc2b80b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2b77fe640 1 -- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80b37e0 msgr2=0x7fc2b80b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2b77fe640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80b37e0 0x7fc2b80b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2b77fe640 1 -- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b80b2d50 msgr2=0x7fc2b8157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2b77fe640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b80b2d50 0x7fc2b8157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2b77fe640 1 -- 172.21.15.88:0/2325631360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8009420 con 0x7fc2b80b3d30 2023-11-20T07:02:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2b67fc640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80b37e0 0x7fc2b80b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:41.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2b77fe640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2b80b3d30 0x7fc2b80b5e10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009d30 tx=0x7fc2b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc29f7fe640 1 -- 172.21.15.88:0/2325631360 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0009ba0 con 0x7fc2b80b3d30 2023-11-20T07:02:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc29f7fe640 1 -- 172.21.15.88:0/2325631360 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b000f040 con 0x7fc2b80b3d30 2023-11-20T07:02:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2bd580640 1 -- 172.21.15.88:0/2325631360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b8158460 con 0x7fc2b80b3d30 2023-11-20T07:02:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc29f7fe640 1 -- 172.21.15.88:0/2325631360 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00146c0 con 0x7fc2b80b3d30 2023-11-20T07:02:41.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2bd580640 1 -- 172.21.15.88:0/2325631360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b81515f0 con 0x7fc2b80b3d30 2023-11-20T07:02:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.821+0000 7fc2bd580640 1 -- 172.21.15.88:0/2325631360 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b8151450 con 0x7fc2b80b3d30 2023-11-20T07:02:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.825+0000 7fc29f7fe640 1 -- 172.21.15.88:0/2325631360 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc2b0014820 con 0x7fc2b80b3d30 2023-11-20T07:02:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.825+0000 7fc29f7fe640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc2a40664a0 0x7fc2a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.825+0000 7fc29f7fe640 1 -- 172.21.15.88:0/2325631360 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc2b00845e0 con 0x7fc2b80b3d30 2023-11-20T07:02:41.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.825+0000 7fc2b6ffd640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc2a40664a0 0x7fc2a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:41.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.825+0000 7fc2b6ffd640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc2a40664a0 0x7fc2a4068960 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80ad000 tx=0x7fc2a80a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:41.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.829+0000 7fc29f7fe640 1 -- 172.21.15.88:0/2325631360 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc2b8151450 con 0x7fc2b80b3d30 2023-11-20T07:02:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.977+0000 7fc2bd580640 1 -- 172.21.15.88:0/2325631360 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2b80d34c0 con 0x7fc2a40664a0 2023-11-20T07:02:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc29f7fe640 1 -- 172.21.15.88:0/2325631360 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc2a80ab5e0 con 0x7fc2a40664a0 2023-11-20T07:02:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 2 to deep-scrub 2023-11-20T07:02:41.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc2bd580640 1 -- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc2a40664a0 msgr2=0x7fc2a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc2bd580640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc2a40664a0 0x7fc2a4068960 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80ad000 tx=0x7fc2a80a6000 comp rx=0 tx=0).stop 2023-11-20T07:02:41.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc2bd580640 1 -- 172.21.15.88:0/2325631360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2b80b3d30 msgr2=0x7fc2b80b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:41.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc2bd580640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2b80b3d30 0x7fc2b80b5e10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009d30 tx=0x7fc2b000c490 comp rx=0 tx=0).stop 2023-11-20T07:02:41.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc2bd580640 1 -- 172.21.15.88:0/2325631360 shutdown_connections 2023-11-20T07:02:41.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc2bd580640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fc2a40664a0 0x7fc2a4068960 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc2bd580640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80b37e0 0x7fc2b80b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc2bd580640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2b80b3d30 0x7fc2b80b5e10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc2bd580640 1 --2- 172.21.15.88:0/2325631360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b80b2d50 0x7fc2b8157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc2bd580640 1 -- 172.21.15.88:0/2325631360 >> 172.21.15.88:0/2325631360 conn(0x7fc2b80d2790 msgr2=0x7fc2b80cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc2bd580640 1 -- 172.21.15.88:0/2325631360 shutdown_connections 2023-11-20T07:02:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:41.981+0000 7fc2bd580640 1 -- 172.21.15.88:0/2325631360 wait complete. 2023-11-20T07:02:42.001 INFO:tasks.ceph:Scrubbing osd.3 2023-11-20T07:02:42.001 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-20T07:02:42.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.141+0000 7f3473a54640 1 Processor -- start 2023-11-20T07:02:42.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.141+0000 7f3473a54640 1 -- start start 2023-11-20T07:02:42.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.141+0000 7f3473a54640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c15cc90 0x7f346c065d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f3473a54640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f346c06cd40 0x7f346c06a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f3473a54640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c0ae030 con 0x7f346c0ae230 2023-11-20T07:02:42.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f3473a54640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c161290 con 0x7f346c06cd40 2023-11-20T07:02:42.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f3473a54640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c1617c0 con 0x7f346c15cc90 2023-11-20T07:02:42.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f3471ff1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f346c06cd40 0x7f346c06a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f34717f0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c15cc90 0x7f346c065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f3471ff1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f346c06cd40 0x7f346c06a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:39520/0 (socket says 172.21.15.88:39520) 2023-11-20T07:02:42.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f3471ff1640 1 -- 172.21.15.88:0/2598401720 learned_addr learned my addr 172.21.15.88:0/2598401720 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:42.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f34717f0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c15cc90 0x7f346c065d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:34000/0 (socket says 172.21.15.88:34000) 2023-11-20T07:02:42.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f3471ff1640 1 -- 172.21.15.88:0/2598401720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c15cc90 msgr2=0x7f346c065d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:42.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f3471ff1640 1 --2- 172.21.15.88:0/2598401720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c15cc90 0x7f346c065d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f3471ff1640 1 -- 172.21.15.88:0/2598401720 >> v1:172.21.15.175:6789/0 conn(0x7f346c0ae230 legacy=0x7f346c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f3471ff1640 1 -- 172.21.15.88:0/2598401720 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c06a330 con 0x7f346c06cd40 2023-11-20T07:02:42.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.145+0000 7f3471ff1640 1 --2- 172.21.15.88:0/2598401720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c06cd40 0x7f346c06a7c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3464009e50 tx=0x7f346401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe113f9b448ccc32 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3463fff640 1 -- 172.21.15.88:0/2598401720 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640a5720 con 0x7f346c06cd40 2023-11-20T07:02:42.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3463fff640 1 -- 172.21.15.88:0/2598401720 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34640a5880 con 0x7f346c06cd40 2023-11-20T07:02:42.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3463fff640 1 -- 172.21.15.88:0/2598401720 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640a5c10 con 0x7f346c06cd40 2023-11-20T07:02:42.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3473a54640 1 -- 172.21.15.88:0/2598401720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c06cd40 msgr2=0x7f346c06a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3473a54640 1 --2- 172.21.15.88:0/2598401720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c06cd40 0x7f346c06a7c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3464009e50 tx=0x7f346401c950 comp rx=0 tx=0).stop 2023-11-20T07:02:42.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3473a54640 1 -- 172.21.15.88:0/2598401720 shutdown_connections 2023-11-20T07:02:42.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3473a54640 1 --2- 172.21.15.88:0/2598401720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c06cd40 0x7f346c06a7c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3473a54640 1 --2- 172.21.15.88:0/2598401720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c15cc90 0x7f346c065d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3473a54640 1 -- 172.21.15.88:0/2598401720 >> 172.21.15.88:0/2598401720 conn(0x7f346c0b0920 msgr2=0x7f346c0b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:42.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3473a54640 1 -- 172.21.15.88:0/2598401720 shutdown_connections 2023-11-20T07:02:42.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3473a54640 1 -- 172.21.15.88:0/2598401720 wait complete. 2023-11-20T07:02:42.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3473a54640 1 Processor -- start 2023-11-20T07:02:42.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.149+0000 7f3473a54640 1 -- start start 2023-11-20T07:02:42.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3473a54640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c06cd40 0x7f346c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3473a54640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c0ae230 0x7f346c15e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3473a54640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c15cc90 0x7f346c14f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3473a54640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0c8cc0 con 0x7f346c06cd40 2023-11-20T07:02:42.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3473a54640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c160200 con 0x7f346c0ae230 2023-11-20T07:02:42.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3473a54640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c15f160 con 0x7f346c15cc90 2023-11-20T07:02:42.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f34717f0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c06cd40 0x7f346c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f34717f0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c06cd40 0x7f346c0ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50124/0 (socket says 172.21.15.88:50124) 2023-11-20T07:02:42.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f34717f0640 1 -- 172.21.15.88:0/1215287946 learned_addr learned my addr 172.21.15.88:0/1215287946 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:42.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3470fef640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c0ae230 0x7f346c15e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3471ff1640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c15cc90 0x7f346c14f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f34717f0640 1 -- 172.21.15.88:0/1215287946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c15cc90 msgr2=0x7f346c14f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f34717f0640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c15cc90 0x7f346c14f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f34717f0640 1 -- 172.21.15.88:0/1215287946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c0ae230 msgr2=0x7f346c15e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f34717f0640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c0ae230 0x7f346c15e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f34717f0640 1 -- 172.21.15.88:0/1215287946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464009b30 con 0x7f346c06cd40 2023-11-20T07:02:42.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f34717f0640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c06cd40 0x7f346c0ccf90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f346800e870 tx=0x7f346800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3461ffb640 1 -- 172.21.15.88:0/1215287946 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468009510 con 0x7f346c06cd40 2023-11-20T07:02:42.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3461ffb640 1 -- 172.21.15.88:0/1215287946 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346800eec0 con 0x7f346c06cd40 2023-11-20T07:02:42.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3461ffb640 1 -- 172.21.15.88:0/1215287946 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346800cb40 con 0x7f346c06cd40 2023-11-20T07:02:42.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3473a54640 1 -- 172.21.15.88:0/1215287946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c15d1f0 con 0x7f346c06cd40 2023-11-20T07:02:42.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3473a54640 1 -- 172.21.15.88:0/1215287946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c15fa00 con 0x7f346c06cd40 2023-11-20T07:02:42.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3473a54640 1 -- 172.21.15.88:0/1215287946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f346c15d070 con 0x7f346c06cd40 2023-11-20T07:02:42.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.153+0000 7f3461ffb640 1 -- 172.21.15.88:0/1215287946 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f346800cca0 con 0x7f346c06cd40 2023-11-20T07:02:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.157+0000 7f3461ffb640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34500664a0 0x7f3450068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.157+0000 7f3461ffb640 1 -- 172.21.15.88:0/1215287946 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3468083de0 con 0x7f346c06cd40 2023-11-20T07:02:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.157+0000 7f3461ffb640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] conn(0x7f345006c7a0 0x7f345006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.157+0000 7f3461ffb640 1 -- 172.21.15.88:0/1215287946 --> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f345006f2b0 con 0x7f345006c7a0 2023-11-20T07:02:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.157+0000 7f3461ffb640 1 -- 172.21.15.88:0/1215287946 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3468088030 con 0x7f346c06cd40 2023-11-20T07:02:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.157+0000 7f3470fef640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34500664a0 0x7f3450068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.157+0000 7f3471ff1640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] conn(0x7f345006c7a0 0x7f345006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.157+0000 7f3471ff1640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] conn(0x7f345006c7a0 0x7f345006ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.157+0000 7f3470fef640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34500664a0 0x7f3450068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f346c0c5c90 tx=0x7f345c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.157+0000 7f3461ffb640 1 -- 172.21.15.88:0/1215287946 <== osd.3 v2:172.21.15.88:6816/1570500 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f345006f2b0 con 0x7f345006c7a0 2023-11-20T07:02:42.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3473a54640 1 -- 172.21.15.88:0/1215287946 --> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f346c0c95c0 con 0x7f345006c7a0 2023-11-20T07:02:42.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3461ffb640 1 -- 172.21.15.88:0/1215287946 <== osd.3 v2:172.21.15.88:6816/1570500 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f34640090d0 con 0x7f345006c7a0 2023-11-20T07:02:42.171 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:02:42.171 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T07:02:42.171 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:02:42.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3473a54640 1 -- 172.21.15.88:0/1215287946 >> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] conn(0x7f345006c7a0 msgr2=0x7f345006ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3473a54640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.88:6816/1570500,v1:172.21.15.88:6817/1570500] conn(0x7f345006c7a0 0x7f345006ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3473a54640 1 -- 172.21.15.88:0/1215287946 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34500664a0 msgr2=0x7f3450068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3473a54640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f34500664a0 0x7f3450068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f346c0c5c90 tx=0x7f345c009040 comp rx=0 tx=0).stop 2023-11-20T07:02:42.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3473a54640 1 -- 172.21.15.88:0/1215287946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c06cd40 msgr2=0x7f346c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3473a54640 1 --2- 172.21.15.88:0/1215287946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c06cd40 0x7f346c0ccf90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f346800e870 tx=0x7f346800ec70 comp rx=0 tx=0).stop 2023-11-20T07:02:42.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3471ff1640 1 -- 172.21.15.88:0/1215287946 reap_dead start 2023-11-20T07:02:42.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3473a54640 1 -- 172.21.15.88:0/1215287946 shutdown_connections 2023-11-20T07:02:42.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3473a54640 1 -- 172.21.15.88:0/1215287946 >> 172.21.15.88:0/1215287946 conn(0x7f346c0b0920 msgr2=0x7f346c0ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:42.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3473a54640 1 -- 172.21.15.88:0/1215287946 shutdown_connections 2023-11-20T07:02:42.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.169+0000 7f3473a54640 1 -- 172.21.15.88:0/1215287946 wait complete. 2023-11-20T07:02:42.189 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-20T07:02:42.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.325+0000 7f98b2f3e640 1 Processor -- start 2023-11-20T07:02:42.328 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.325+0000 7f98b2f3e640 1 -- start start 2023-11-20T07:02:42.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98b2f3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98ac0b2ad0 0x7f98ac06b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98b2f3e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98ac15cf90 0x7f98ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.329 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98b2f3e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f98ac0ce310 0x7f98ac0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98b2f3e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0cece0 con 0x7f98ac15cf90 2023-11-20T07:02:42.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98b2f3e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac160580 con 0x7f98ac0ce310 2023-11-20T07:02:42.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98b2f3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac15d4e0 con 0x7f98ac0b2ad0 2023-11-20T07:02:42.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98a3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98ac15cf90 0x7f98ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98a3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98ac15cf90 0x7f98ac06c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50128/0 (socket says 172.21.15.88:50128) 2023-11-20T07:02:42.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98a3fff640 1 -- 172.21.15.88:0/237286697 learned_addr learned my addr 172.21.15.88:0/237286697 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:42.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98b0cda640 1 --2- 172.21.15.88:0/237286697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98ac0b2ad0 0x7f98ac06b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98b14db640 1 --2- 172.21.15.88:0/237286697 >> v2:172.21.15.175:3300/0 conn(0x7f98ac0ce310 0x7f98ac0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98a3fff640 1 -- 172.21.15.88:0/237286697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98ac0b2ad0 msgr2=0x7f98ac06b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:42.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98a3fff640 1 --2- 172.21.15.88:0/237286697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98ac0b2ad0 0x7f98ac06b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98a3fff640 1 -- 172.21.15.88:0/237286697 >> v2:172.21.15.175:3300/0 conn(0x7f98ac0ce310 msgr2=0x7f98ac0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:42.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98a3fff640 1 --2- 172.21.15.88:0/237286697 >> v2:172.21.15.175:3300/0 conn(0x7f98ac0ce310 0x7f98ac0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.329+0000 7f98a3fff640 1 -- 172.21.15.88:0/237286697 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac15d7c0 con 0x7f98ac15cf90 2023-11-20T07:02:42.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98a3fff640 1 --2- 172.21.15.88:0/237286697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac15cf90 0x7f98ac06c8f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f98ac06c620 tx=0x7f989c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1e286dd9685951 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98a37fe640 1 -- 172.21.15.88:0/237286697 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c0aa5f0 con 0x7f98ac15cf90 2023-11-20T07:02:42.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98a37fe640 1 -- 172.21.15.88:0/237286697 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c0aa750 con 0x7f98ac15cf90 2023-11-20T07:02:42.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98a37fe640 1 -- 172.21.15.88:0/237286697 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c0aaae0 con 0x7f98ac15cf90 2023-11-20T07:02:42.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 -- 172.21.15.88:0/237286697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac15cf90 msgr2=0x7f98ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 --2- 172.21.15.88:0/237286697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac15cf90 0x7f98ac06c8f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f98ac06c620 tx=0x7f989c01c4d0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 -- 172.21.15.88:0/237286697 shutdown_connections 2023-11-20T07:02:42.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 --2- 172.21.15.88:0/237286697 >> v2:172.21.15.175:3300/0 conn(0x7f98ac0ce310 0x7f98ac0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 --2- 172.21.15.88:0/237286697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac15cf90 0x7f98ac06c8f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 --2- 172.21.15.88:0/237286697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98ac0b2ad0 0x7f98ac06b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 -- 172.21.15.88:0/237286697 >> 172.21.15.88:0/237286697 conn(0x7f98ac0cd1c0 msgr2=0x7f98ac0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:42.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 -- 172.21.15.88:0/237286697 shutdown_connections 2023-11-20T07:02:42.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 -- 172.21.15.88:0/237286697 wait complete. 2023-11-20T07:02:42.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 Processor -- start 2023-11-20T07:02:42.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 -- start start 2023-11-20T07:02:42.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98ac0b2ad0 0x7f98ac153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98ac0ce310 0x7f98ac1587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac15cf90 0x7f98ac158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0b5d90 con 0x7f98ac15cf90 2023-11-20T07:02:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac154dc0 con 0x7f98ac0b2ad0 2023-11-20T07:02:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.333+0000 7f98b2f3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac1550a0 con 0x7f98ac0ce310 2023-11-20T07:02:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b14db640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac15cf90 0x7f98ac158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b14db640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac15cf90 0x7f98ac158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50138/0 (socket says 172.21.15.88:50138) 2023-11-20T07:02:42.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b14db640 1 -- 172.21.15.88:0/3399954107 learned_addr learned my addr 172.21.15.88:0/3399954107 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:42.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b0cda640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98ac0b2ad0 0x7f98ac153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98a3fff640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98ac0ce310 0x7f98ac1587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b14db640 1 -- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98ac0ce310 msgr2=0x7f98ac1587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b14db640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98ac0ce310 0x7f98ac1587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b14db640 1 -- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98ac0b2ad0 msgr2=0x7f98ac153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b14db640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98ac0b2ad0 0x7f98ac153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b14db640 1 -- 172.21.15.88:0/3399954107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c0094d0 con 0x7f98ac15cf90 2023-11-20T07:02:42.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b14db640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac15cf90 0x7f98ac158d20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f98a4007e60 tx=0x7f98a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98a17fa640 1 -- 172.21.15.88:0/3399954107 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4014420 con 0x7f98ac15cf90 2023-11-20T07:02:42.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98a17fa640 1 -- 172.21.15.88:0/3399954107 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a40145a0 con 0x7f98ac15cf90 2023-11-20T07:02:42.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98a17fa640 1 -- 172.21.15.88:0/3399954107 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4014950 con 0x7f98ac15cf90 2023-11-20T07:02:42.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b2f3e640 1 -- 172.21.15.88:0/3399954107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac155380 con 0x7f98ac15cf90 2023-11-20T07:02:42.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b2f3e640 1 -- 172.21.15.88:0/3399954107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac154090 con 0x7f98ac15cf90 2023-11-20T07:02:42.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98b2f3e640 1 -- 172.21.15.88:0/3399954107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac074010 con 0x7f98ac15cf90 2023-11-20T07:02:42.340 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.337+0000 7f98a17fa640 1 -- 172.21.15.88:0/3399954107 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f98a4014ab0 con 0x7f98ac15cf90 2023-11-20T07:02:42.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.341+0000 7f98a17fa640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98980664a0 0x7f9898068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.341+0000 7f98a17fa640 1 -- 172.21.15.88:0/3399954107 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f98a4084440 con 0x7f98ac15cf90 2023-11-20T07:02:42.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.341+0000 7f98b0cda640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98980664a0 0x7f9898068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.341+0000 7f98b0cda640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98980664a0 0x7f9898068960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f98ac15f7b0 tx=0x7f98a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.341+0000 7f98a17fa640 1 -- 172.21.15.88:0/3399954107 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f98a4051b30 con 0x7f98ac15cf90 2023-11-20T07:02:42.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.493+0000 7f98b2f3e640 1 -- 172.21.15.88:0/3399954107 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f98ac154f30 con 0x7f98980664a0 2023-11-20T07:02:42.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98a17fa640 1 -- 172.21.15.88:0/3399954107 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f98ac154f30 con 0x7f98980664a0 2023-11-20T07:02:42.496 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 3 to deep-scrub 2023-11-20T07:02:42.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98b2f3e640 1 -- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98980664a0 msgr2=0x7f9898068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98b2f3e640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98980664a0 0x7f9898068960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f98ac15f7b0 tx=0x7f98a8008040 comp rx=0 tx=0).stop 2023-11-20T07:02:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98b2f3e640 1 -- 172.21.15.88:0/3399954107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac15cf90 msgr2=0x7f98ac158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98b2f3e640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac15cf90 0x7f98ac158d20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f98a4007e60 tx=0x7f98a400e4b0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98b2f3e640 1 -- 172.21.15.88:0/3399954107 shutdown_connections 2023-11-20T07:02:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98b2f3e640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f98980664a0 0x7f9898068960 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98b2f3e640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98ac0ce310 0x7f98ac1587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98b2f3e640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac15cf90 0x7f98ac158d20 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98b2f3e640 1 --2- 172.21.15.88:0/3399954107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98ac0b2ad0 0x7f98ac153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98b2f3e640 1 -- 172.21.15.88:0/3399954107 >> 172.21.15.88:0/3399954107 conn(0x7f98ac0cd1c0 msgr2=0x7f98ac15b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98b2f3e640 1 -- 172.21.15.88:0/3399954107 shutdown_connections 2023-11-20T07:02:42.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.497+0000 7f98b2f3e640 1 -- 172.21.15.88:0/3399954107 wait complete. 2023-11-20T07:02:42.517 INFO:tasks.ceph:Scrubbing osd.4 2023-11-20T07:02:42.517 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-20T07:02:42.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f4e5c5640 1 Processor -- start 2023-11-20T07:02:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f4e5c5640 1 -- start start 2023-11-20T07:02:42.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f4e5c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f480cfd20 0x7f8f480d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f4e5c5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f480ce460 con 0x7f8f480cdc80 2023-11-20T07:02:42.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f4e5c5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4815da30 con 0x7f8f480d2570 2023-11-20T07:02:42.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f4e5c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f480cd830 con 0x7f8f480cfd20 2023-11-20T07:02:42.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f477fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8f480cdc80 0x7f8f480cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55880/0 (socket says 172.21.15.88:55880) 2023-11-20T07:02:42.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f477fe640 1 -- 172.21.15.88:0/108638038 learned_addr learned my addr 172.21.15.88:0/108638038 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:42.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f4cb62640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f480cfd20 0x7f8f480d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162957052 0 0) 0x7f8f480ce460 con 0x7f8f480cdc80 2023-11-20T07:02:42.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f30003530 con 0x7f8f480cdc80 2023-11-20T07:02:42.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932133450 0 0) 0x7f8f4815da30 con 0x7f8f480d2570 2023-11-20T07:02:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f480ce460 con 0x7f8f480d2570 2023-11-20T07:02:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3785526996 0 0) 0x7f8f30003530 con 0x7f8f480cdc80 2023-11-20T07:02:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f480cfd20 msgr2=0x7f8f480d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f480cfd20 0x7f8f480d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 >> v1:172.21.15.175:6789/0 conn(0x7f8f480d2570 legacy=0x7f8f48161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f480ce180 con 0x7f8f480cdc80 2023-11-20T07:02:42.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7f8f3c001600 con 0x7f8f480cdc80 2023-11-20T07:02:42.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 >> v1:172.21.15.88:6789/0 conn(0x7f8f480cdc80 legacy=0x7f8f480cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f30003b40 0x7f8f30003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f300047d0 0x7f8f30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.661+0000 7f8f46ffd640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f480cfd20 0x7f8f30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f480cd830 con 0x7f8f30003b40 2023-11-20T07:02:42.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3000ba40 con 0x7f8f300047d0 2023-11-20T07:02:42.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3000bc00 con 0x7f8f480cfd20 2023-11-20T07:02:42.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f47fff640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f30003b40 0x7f8f30003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f477fe640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f300047d0 0x7f8f30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f4cb62640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f480cfd20 0x7f8f30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f47fff640 1 -- 172.21.15.88:0/108638038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f480cfd20 msgr2=0x7f8f30005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:42.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f47fff640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f480cfd20 0x7f8f30005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f47fff640 1 -- 172.21.15.88:0/108638038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f300047d0 msgr2=0x7f8f30004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:42.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f47fff640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f300047d0 0x7f8f30004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f47fff640 1 -- 172.21.15.88:0/108638038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30003530 con 0x7f8f30003b40 2023-11-20T07:02:42.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f4cb62640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f480cfd20 0x7f8f30005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:42.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f47fff640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f30003b40 0x7f8f30003f40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8f380018d0 tx=0x7f8f3801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1c659ab23471ca server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f380052d0 con 0x7f8f30003b40 2023-11-20T07:02:42.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f38005450 con 0x7f8f30003b40 2023-11-20T07:02:42.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.665+0000 7f8f46ffd640 1 -- 172.21.15.88:0/108638038 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38003840 con 0x7f8f30003b40 2023-11-20T07:02:42.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/108638038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f30003b40 msgr2=0x7f8f30003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 --2- 172.21.15.88:0/108638038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f30003b40 0x7f8f30003f40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8f380018d0 tx=0x7f8f3801c530 comp rx=0 tx=0).stop 2023-11-20T07:02:42.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4cb62640 1 -- 172.21.15.88:0/108638038 reap_dead start 2023-11-20T07:02:42.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/108638038 shutdown_connections 2023-11-20T07:02:42.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/108638038 >> 172.21.15.88:0/108638038 conn(0x7f8f480715c0 msgr2=0x7f8f480719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:42.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/108638038 shutdown_connections 2023-11-20T07:02:42.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/108638038 wait complete. 2023-11-20T07:02:42.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 Processor -- start 2023-11-20T07:02:42.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 -- start start 2023-11-20T07:02:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f30003b40 0x7f8f4814a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f4814aa50 0x7f8f48153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f480c8ac0 0x7f8f480c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48152bc0 con 0x7f8f480c8ac0 2023-11-20T07:02:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48153740 con 0x7f8f4814aa50 2023-11-20T07:02:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4e5c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48152e10 con 0x7f8f30003b40 2023-11-20T07:02:42.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4cb62640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f480c8ac0 0x7f8f480c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4cb62640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f480c8ac0 0x7f8f480c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50152/0 (socket says 172.21.15.88:50152) 2023-11-20T07:02:42.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4cb62640 1 -- 172.21.15.88:0/4091339383 learned_addr learned my addr 172.21.15.88:0/4091339383 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:42.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f47fff640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f30003b40 0x7f8f4814a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f477fe640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f4814aa50 0x7f8f48153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4cb62640 1 -- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f30003b40 msgr2=0x7f8f4814a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4cb62640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f30003b40 0x7f8f4814a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4cb62640 1 -- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f4814aa50 msgr2=0x7f8f48153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.669+0000 7f8f4cb62640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f4814aa50 0x7f8f48153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f4cb62640 1 -- 172.21.15.88:0/4091339383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f481530f0 con 0x7f8f480c8ac0 2023-11-20T07:02:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f4cb62640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f480c8ac0 0x7f8f480c8f40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8f48066490 tx=0x7f8f4000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f44ff9640 1 -- 172.21.15.88:0/4091339383 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40017400 con 0x7f8f480c8ac0 2023-11-20T07:02:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f44ff9640 1 -- 172.21.15.88:0/4091339383 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f40011040 con 0x7f8f480c8ac0 2023-11-20T07:02:42.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f44ff9640 1 -- 172.21.15.88:0/4091339383 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40017780 con 0x7f8f480c8ac0 2023-11-20T07:02:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/4091339383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f481533d0 con 0x7f8f480c8ac0 2023-11-20T07:02:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/4091339383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f480c9480 con 0x7f8f480c8ac0 2023-11-20T07:02:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/4091339383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8f480d2950 con 0x7f8f480c8ac0 2023-11-20T07:02:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f44ff9640 1 -- 172.21.15.88:0/4091339383 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8f400203b0 con 0x7f8f480c8ac0 2023-11-20T07:02:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f44ff9640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8f340664d0 0x7f8f34068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f44ff9640 1 -- 172.21.15.88:0/4091339383 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8f40083f30 con 0x7f8f480c8ac0 2023-11-20T07:02:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f44ff9640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] conn(0x7f8f3406c7d0 0x7f8f3406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f44ff9640 1 -- 172.21.15.88:0/4091339383 --> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f3406f2e0 con 0x7f8f3406c7d0 2023-11-20T07:02:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f44ff9640 1 -- 172.21.15.88:0/4091339383 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f400865f0 con 0x7f8f480c8ac0 2023-11-20T07:02:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.673+0000 7f8f47fff640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8f340664d0 0x7f8f34068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.677+0000 7f8f477fe640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] conn(0x7f8f3406c7d0 0x7f8f3406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.677+0000 7f8f47fff640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8f340664d0 0x7f8f34068990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8f380ad000 tx=0x7f8f380a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.677+0000 7f8f477fe640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] conn(0x7f8f3406c7d0 0x7f8f3406ec10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.677+0000 7f8f44ff9640 1 -- 172.21.15.88:0/4091339383 <== osd.4 v2:172.21.15.175:6800/1731999626 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8f3406f2e0 con 0x7f8f3406c7d0 2023-11-20T07:02:42.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/4091339383 --> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8f4804e170 con 0x7f8f3406c7d0 2023-11-20T07:02:42.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f44ff9640 1 -- 172.21.15.88:0/4091339383 <== osd.4 v2:172.21.15.175:6800/1731999626 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8f4804e170 con 0x7f8f3406c7d0 2023-11-20T07:02:42.691 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:02:42.691 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T07:02:42.691 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:02:42.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] conn(0x7f8f3406c7d0 msgr2=0x7f8f3406ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f4e5c5640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:6800/1731999626,v1:172.21.15.175:6801/1731999626] conn(0x7f8f3406c7d0 0x7f8f3406ec10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8f340664d0 msgr2=0x7f8f34068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f4e5c5640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8f340664d0 0x7f8f34068990 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8f380ad000 tx=0x7f8f380a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:42.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/4091339383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f480c8ac0 msgr2=0x7f8f480c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f4e5c5640 1 --2- 172.21.15.88:0/4091339383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f480c8ac0 0x7f8f480c8f40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8f48066490 tx=0x7f8f4000f4a0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f4cb62640 1 -- 172.21.15.88:0/4091339383 reap_dead start 2023-11-20T07:02:42.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/4091339383 shutdown_connections 2023-11-20T07:02:42.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/4091339383 >> 172.21.15.88:0/4091339383 conn(0x7f8f480715c0 msgr2=0x7f8f480b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:42.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/4091339383 shutdown_connections 2023-11-20T07:02:42.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.689+0000 7f8f4e5c5640 1 -- 172.21.15.88:0/4091339383 wait complete. 2023-11-20T07:02:42.709 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-20T07:02:42.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.845+0000 7fd1550c9640 1 Processor -- start 2023-11-20T07:02:42.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.845+0000 7fd1550c9640 1 -- start start 2023-11-20T07:02:42.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.845+0000 7fd1550c9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd15015cd10 0x7fd15015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.845+0000 7fd1550c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd150069e90 0x7fd15006a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.845+0000 7fd1550c9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15015e390 con 0x7fd150071280 2023-11-20T07:02:42.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.845+0000 7fd1550c9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15006a850 con 0x7fd15015cd10 2023-11-20T07:02:42.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.845+0000 7fd1550c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd150161990 con 0x7fd150069e90 2023-11-20T07:02:42.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.849+0000 7fd14659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd150069e90 0x7fd15006a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.849+0000 7fd14ed9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd15015cd10 0x7fd15015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.849+0000 7fd14659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd150069e90 0x7fd15006a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:34090/0 (socket says 172.21.15.88:34090) 2023-11-20T07:02:42.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.849+0000 7fd14659c640 1 -- 172.21.15.88:0/3815924205 learned_addr learned my addr 172.21.15.88:0/3815924205 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:42.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.849+0000 7fd14659c640 1 -- 172.21.15.88:0/3815924205 >> v2:172.21.15.175:3300/0 conn(0x7fd15015cd10 msgr2=0x7fd15015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:42.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.849+0000 7fd14659c640 1 --2- 172.21.15.88:0/3815924205 >> v2:172.21.15.175:3300/0 conn(0x7fd15015cd10 0x7fd15015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.849+0000 7fd14659c640 1 -- 172.21.15.88:0/3815924205 >> v1:172.21.15.175:6789/0 conn(0x7fd150071280 legacy=0x7fd1500716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.849+0000 7fd14659c640 1 -- 172.21.15.88:0/3815924205 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1500ca150 con 0x7fd150069e90 2023-11-20T07:02:42.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.849+0000 7fd14ed9d640 1 --2- 172.21.15.88:0/3815924205 >> v2:172.21.15.175:3300/0 conn(0x7fd15015cd10 0x7fd15015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:42.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.849+0000 7fd14659c640 1 --2- 172.21.15.88:0/3815924205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd150069e90 0x7fd15006a310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd138009870 tx=0x7fd13801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=741225ded6a1cec4 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd14e59c640 1 -- 172.21.15.88:0/3815924205 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380a9400 con 0x7fd150069e90 2023-11-20T07:02:42.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd14e59c640 1 -- 172.21.15.88:0/3815924205 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1380a9560 con 0x7fd150069e90 2023-11-20T07:02:42.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd14e59c640 1 -- 172.21.15.88:0/3815924205 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380a98f0 con 0x7fd150069e90 2023-11-20T07:02:42.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 -- 172.21.15.88:0/3815924205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd150069e90 msgr2=0x7fd15006a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 --2- 172.21.15.88:0/3815924205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd150069e90 0x7fd15006a310 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd138009870 tx=0x7fd13801c540 comp rx=0 tx=0).stop 2023-11-20T07:02:42.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 -- 172.21.15.88:0/3815924205 shutdown_connections 2023-11-20T07:02:42.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 --2- 172.21.15.88:0/3815924205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd150069e90 0x7fd15006a310 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 --2- 172.21.15.88:0/3815924205 >> v2:172.21.15.175:3300/0 conn(0x7fd15015cd10 0x7fd15015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 -- 172.21.15.88:0/3815924205 >> 172.21.15.88:0/3815924205 conn(0x7fd15006d310 msgr2=0x7fd15006d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:42.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 -- 172.21.15.88:0/3815924205 shutdown_connections 2023-11-20T07:02:42.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 -- 172.21.15.88:0/3815924205 wait complete. 2023-11-20T07:02:42.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 Processor -- start 2023-11-20T07:02:42.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 -- start start 2023-11-20T07:02:42.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd150069e90 0x7fd150152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd150071280 0x7fd150156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd15015cd10 0x7fd150157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500c8770 con 0x7fd15015cd10 2023-11-20T07:02:42.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15014f480 con 0x7fd150069e90 2023-11-20T07:02:42.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.853+0000 7fd1550c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500c7af0 con 0x7fd150071280 2023-11-20T07:02:42.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd14f59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd15015cd10 0x7fd150157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd14f59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd15015cd10 0x7fd150157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50162/0 (socket says 172.21.15.88:50162) 2023-11-20T07:02:42.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd14f59e640 1 -- 172.21.15.88:0/2413846911 learned_addr learned my addr 172.21.15.88:0/2413846911 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:42.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd14ed9d640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd150069e90 0x7fd150152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd14659c640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd150071280 0x7fd150156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd14f59e640 1 -- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd150071280 msgr2=0x7fd150156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd14f59e640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd150071280 0x7fd150156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd14f59e640 1 -- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd150069e90 msgr2=0x7fd150152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:42.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd14f59e640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd150069e90 0x7fd150152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:42.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd14f59e640 1 -- 172.21.15.88:0/2413846911 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd140009a70 con 0x7fd15015cd10 2023-11-20T07:02:42.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd14f59e640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd15015cd10 0x7fd150157130 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd14800c430 tx=0x7fd14800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd147fff640 1 -- 172.21.15.88:0/2413846911 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148005220 con 0x7fd15015cd10 2023-11-20T07:02:42.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd147fff640 1 -- 172.21.15.88:0/2413846911 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd148005380 con 0x7fd15015cd10 2023-11-20T07:02:42.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd147fff640 1 -- 172.21.15.88:0/2413846911 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148007270 con 0x7fd15015cd10 2023-11-20T07:02:42.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd1550c9640 1 -- 172.21.15.88:0/2413846911 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1380094d0 con 0x7fd15015cd10 2023-11-20T07:02:42.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd1550c9640 1 -- 172.21.15.88:0/2413846911 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1500c80b0 con 0x7fd15015cd10 2023-11-20T07:02:42.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd1550c9640 1 -- 172.21.15.88:0/2413846911 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1500c88b0 con 0x7fd15015cd10 2023-11-20T07:02:42.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.857+0000 7fd147fff640 1 -- 172.21.15.88:0/2413846911 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd1480073d0 con 0x7fd15015cd10 2023-11-20T07:02:42.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.861+0000 7fd147fff640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd1300664a0 0x7fd130068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:42.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.861+0000 7fd147fff640 1 -- 172.21.15.88:0/2413846911 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd148083070 con 0x7fd15015cd10 2023-11-20T07:02:42.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.861+0000 7fd14ed9d640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd1300664a0 0x7fd130068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:42.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.861+0000 7fd14ed9d640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd1300664a0 0x7fd130068960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd140009fd0 tx=0x7fd14000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:42.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:42.865+0000 7fd147fff640 1 -- 172.21.15.88:0/2413846911 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1500c88b0 con 0x7fd15015cd10 2023-11-20T07:02:43.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.009+0000 7fd1550c9640 1 -- 172.21.15.88:0/2413846911 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1501616b0 con 0x7fd1300664a0 2023-11-20T07:02:43.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd147fff640 1 -- 172.21.15.88:0/2413846911 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd14000f040 con 0x7fd1300664a0 2023-11-20T07:02:43.013 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 4 to deep-scrub 2023-11-20T07:02:43.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd1550c9640 1 -- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd1300664a0 msgr2=0x7fd130068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd1550c9640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd1300664a0 0x7fd130068960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd140009fd0 tx=0x7fd14000b040 comp rx=0 tx=0).stop 2023-11-20T07:02:43.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd1550c9640 1 -- 172.21.15.88:0/2413846911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd15015cd10 msgr2=0x7fd150157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd1550c9640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd15015cd10 0x7fd150157130 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd14800c430 tx=0x7fd14800c8f0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd1550c9640 1 -- 172.21.15.88:0/2413846911 shutdown_connections 2023-11-20T07:02:43.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd1550c9640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fd1300664a0 0x7fd130068960 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd1550c9640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd150071280 0x7fd150156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd1550c9640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd15015cd10 0x7fd150157130 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd1550c9640 1 --2- 172.21.15.88:0/2413846911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd150069e90 0x7fd150152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd1550c9640 1 -- 172.21.15.88:0/2413846911 >> 172.21.15.88:0/2413846911 conn(0x7fd15006d310 msgr2=0x7fd1500cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd1550c9640 1 -- 172.21.15.88:0/2413846911 shutdown_connections 2023-11-20T07:02:43.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.013+0000 7fd1550c9640 1 -- 172.21.15.88:0/2413846911 wait complete. 2023-11-20T07:02:43.033 INFO:tasks.ceph:Scrubbing osd.5 2023-11-20T07:02:43.033 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-20T07:02:43.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.173+0000 7f6e99617640 1 Processor -- start 2023-11-20T07:02:43.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.173+0000 7f6e99617640 1 -- start start 2023-11-20T07:02:43.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e99617640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6e940d2570 0x7f6e94161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e99617640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e940cdc80 0x7f6e940cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e99617640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e940ce460 con 0x7f6e9415dec0 2023-11-20T07:02:43.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e99617640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e940cd830 con 0x7f6e940d2570 2023-11-20T07:02:43.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e99617640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9415da30 con 0x7f6e940cdc80 2023-11-20T07:02:43.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e92ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6e940d2570 0x7f6e94161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e92ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6e940d2570 0x7f6e94161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50170/0 (socket says 172.21.15.88:50170) 2023-11-20T07:02:43.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e92ffd640 1 -- 172.21.15.88:0/2027237884 learned_addr learned my addr 172.21.15.88:0/2027237884 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:43.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e927fc640 1 --2- 172.21.15.88:0/2027237884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e940cdc80 0x7f6e940cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e92ffd640 1 -- 172.21.15.88:0/2027237884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e940cdc80 msgr2=0x7f6e940cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:43.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e92ffd640 1 --2- 172.21.15.88:0/2027237884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e940cdc80 0x7f6e940cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e92ffd640 1 -- 172.21.15.88:0/2027237884 >> v1:172.21.15.88:6789/0 conn(0x7f6e9415dec0 legacy=0x7f6e940d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e92ffd640 1 -- 172.21.15.88:0/2027237884 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e94161750 con 0x7f6e940d2570 2023-11-20T07:02:43.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e927fc640 1 --2- 172.21.15.88:0/2027237884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e940cdc80 0x7f6e940cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:43.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e91ffb640 1 -- 172.21.15.88:0/2027237884 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413263384 0 0) 0x7f6e940ce460 con 0x7f6e9415dec0 2023-11-20T07:02:43.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.177+0000 7f6e92ffd640 1 --2- 172.21.15.88:0/2027237884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e940d2570 0x7f6e94161210 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6e84009870 tx=0x7f6e8401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad897f69862c35f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e91ffb640 1 -- 172.21.15.88:0/2027237884 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e840ab620 con 0x7f6e940d2570 2023-11-20T07:02:43.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e91ffb640 1 -- 172.21.15.88:0/2027237884 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e840ab780 con 0x7f6e940d2570 2023-11-20T07:02:43.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e91ffb640 1 -- 172.21.15.88:0/2027237884 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e840abb10 con 0x7f6e940d2570 2023-11-20T07:02:43.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 -- 172.21.15.88:0/2027237884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e940d2570 msgr2=0x7f6e94161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 --2- 172.21.15.88:0/2027237884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e940d2570 0x7f6e94161210 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6e84009870 tx=0x7f6e8401c510 comp rx=0 tx=0).stop 2023-11-20T07:02:43.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 -- 172.21.15.88:0/2027237884 shutdown_connections 2023-11-20T07:02:43.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 --2- 172.21.15.88:0/2027237884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e940cdc80 0x7f6e940cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 --2- 172.21.15.88:0/2027237884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e940d2570 0x7f6e94161210 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 -- 172.21.15.88:0/2027237884 >> 172.21.15.88:0/2027237884 conn(0x7f6e940715c0 msgr2=0x7f6e940719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:43.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 -- 172.21.15.88:0/2027237884 shutdown_connections 2023-11-20T07:02:43.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 -- 172.21.15.88:0/2027237884 wait complete. 2023-11-20T07:02:43.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 Processor -- start 2023-11-20T07:02:43.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 -- start start 2023-11-20T07:02:43.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e940cdc80 0x7f6e9414e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e940d2570 0x7f6e941521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e9415dec0 0x7f6e94152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9414ef00 con 0x7f6e940d2570 2023-11-20T07:02:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94150660 con 0x7f6e9415dec0 2023-11-20T07:02:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e99617640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9414f170 con 0x7f6e940cdc80 2023-11-20T07:02:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e927fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e940d2570 0x7f6e941521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e927fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e940d2570 0x7f6e941521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50174/0 (socket says 172.21.15.88:50174) 2023-11-20T07:02:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.181+0000 7f6e927fc640 1 -- 172.21.15.88:0/2039560082 learned_addr learned my addr 172.21.15.88:0/2039560082 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:43.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e92ffd640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e940cdc80 0x7f6e9414e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e937fe640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e9415dec0 0x7f6e94152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e927fc640 1 -- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e940cdc80 msgr2=0x7f6e9414e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e927fc640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e940cdc80 0x7f6e9414e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e927fc640 1 -- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e9415dec0 msgr2=0x7f6e94152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e927fc640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e9415dec0 0x7f6e94152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e927fc640 1 -- 172.21.15.88:0/2039560082 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840094d0 con 0x7f6e940d2570 2023-11-20T07:02:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e937fe640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e9415dec0 0x7f6e94152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-20T07:02:43.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e927fc640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e940d2570 0x7f6e941521d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800d800 tx=0x7f6e8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e7b7fe640 1 -- 172.21.15.88:0/2039560082 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e880096c0 con 0x7f6e940d2570 2023-11-20T07:02:43.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e7b7fe640 1 -- 172.21.15.88:0/2039560082 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e88009820 con 0x7f6e940d2570 2023-11-20T07:02:43.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e99617640 1 -- 172.21.15.88:0/2039560082 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9414f450 con 0x7f6e940d2570 2023-11-20T07:02:43.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e7b7fe640 1 -- 172.21.15.88:0/2039560082 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88009bd0 con 0x7f6e940d2570 2023-11-20T07:02:43.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e99617640 1 -- 172.21.15.88:0/2039560082 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9414fa10 con 0x7f6e940d2570 2023-11-20T07:02:43.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e99617640 1 -- 172.21.15.88:0/2039560082 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e940d2950 con 0x7f6e940d2570 2023-11-20T07:02:43.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e7b7fe640 1 -- 172.21.15.88:0/2039560082 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6e88009d30 con 0x7f6e940d2570 2023-11-20T07:02:43.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e7b7fe640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6e800664a0 0x7f6e80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e7b7fe640 1 -- 172.21.15.88:0/2039560082 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6e880848d0 con 0x7f6e940d2570 2023-11-20T07:02:43.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.185+0000 7f6e7b7fe640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] conn(0x7f6e8006c7a0 0x7f6e8006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.189+0000 7f6e7b7fe640 1 -- 172.21.15.88:0/2039560082 --> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e8006f2b0 con 0x7f6e8006c7a0 2023-11-20T07:02:43.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.189+0000 7f6e7b7fe640 1 -- 172.21.15.88:0/2039560082 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e88084d20 con 0x7f6e940d2570 2023-11-20T07:02:43.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.189+0000 7f6e92ffd640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6e800664a0 0x7f6e80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.189+0000 7f6e937fe640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] conn(0x7f6e8006c7a0 0x7f6e8006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.189+0000 7f6e92ffd640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6e800664a0 0x7f6e80068960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6e840af000 tx=0x7f6e840b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.189+0000 7f6e937fe640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] conn(0x7f6e8006c7a0 0x7f6e8006ebe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.189+0000 7f6e7b7fe640 1 -- 172.21.15.88:0/2039560082 <== osd.5 v2:172.21.15.175:6810/2498780564 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6e8006f2b0 con 0x7f6e8006c7a0 2023-11-20T07:02:43.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e99617640 1 -- 172.21.15.88:0/2039560082 --> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6e9415d6c0 con 0x7f6e8006c7a0 2023-11-20T07:02:43.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e7b7fe640 1 -- 172.21.15.88:0/2039560082 <== osd.5 v2:172.21.15.175:6810/2498780564 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6e8c001fc0 con 0x7f6e8006c7a0 2023-11-20T07:02:43.203 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:02:43.203 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T07:02:43.203 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:02:43.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e99617640 1 -- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] conn(0x7f6e8006c7a0 msgr2=0x7f6e8006ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e99617640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:6810/2498780564,v1:172.21.15.175:6812/2498780564] conn(0x7f6e8006c7a0 0x7f6e8006ebe0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e99617640 1 -- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6e800664a0 msgr2=0x7f6e80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e99617640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f6e800664a0 0x7f6e80068960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6e840af000 tx=0x7f6e840b6040 comp rx=0 tx=0).stop 2023-11-20T07:02:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e99617640 1 -- 172.21.15.88:0/2039560082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e940d2570 msgr2=0x7f6e941521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e99617640 1 --2- 172.21.15.88:0/2039560082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e940d2570 0x7f6e941521d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800d800 tx=0x7f6e8800dcc0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e937fe640 1 -- 172.21.15.88:0/2039560082 reap_dead start 2023-11-20T07:02:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e99617640 1 -- 172.21.15.88:0/2039560082 shutdown_connections 2023-11-20T07:02:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e99617640 1 -- 172.21.15.88:0/2039560082 >> 172.21.15.88:0/2039560082 conn(0x7f6e940715c0 msgr2=0x7f6e9415e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e99617640 1 -- 172.21.15.88:0/2039560082 shutdown_connections 2023-11-20T07:02:43.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.201+0000 7f6e99617640 1 -- 172.21.15.88:0/2039560082 wait complete. 2023-11-20T07:02:43.221 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-20T07:02:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fba194640 1 Processor -- start 2023-11-20T07:02:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fba194640 1 -- start start 2023-11-20T07:02:43.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fba194640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb41597c0 0x7f8fb40ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fba194640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8fb4159ba0 0x7f8fb40cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fba194640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb40723d0 con 0x7f8fb40adc10 2023-11-20T07:02:43.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fba194640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb40717c0 con 0x7f8fb4159ba0 2023-11-20T07:02:43.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fba194640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4071aa0 con 0x7f8fb41597c0 2023-11-20T07:02:43.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fb3fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8fb40adc10 0x7f8fb40cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55900/0 (socket says 172.21.15.88:55900) 2023-11-20T07:02:43.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fb3fff640 1 -- 172.21.15.88:0/4004095917 learned_addr learned my addr 172.21.15.88:0/4004095917 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:43.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fb37fe640 1 --2- 172.21.15.88:0/4004095917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb41597c0 0x7f8fb40ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fb2ffd640 1 --2- 172.21.15.88:0/4004095917 >> v2:172.21.15.175:3300/0 conn(0x7f8fb4159ba0 0x7f8fb40cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fb27fc640 1 -- 172.21.15.88:0/4004095917 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251125098 0 0) 0x7f8fb40723d0 con 0x7f8fb40adc10 2023-11-20T07:02:43.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fb27fc640 1 -- 172.21.15.88:0/4004095917 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f9c003530 con 0x7f8fb40adc10 2023-11-20T07:02:43.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fb37fe640 1 -- 172.21.15.88:0/4004095917 >> v2:172.21.15.175:3300/0 conn(0x7f8fb4159ba0 msgr2=0x7f8fb40cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:43.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fb37fe640 1 --2- 172.21.15.88:0/4004095917 >> v2:172.21.15.175:3300/0 conn(0x7f8fb4159ba0 0x7f8fb40cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fb37fe640 1 -- 172.21.15.88:0/4004095917 >> v1:172.21.15.88:6789/0 conn(0x7f8fb40adc10 legacy=0x7f8fb40cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fb37fe640 1 -- 172.21.15.88:0/4004095917 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb4071d80 con 0x7f8fb41597c0 2023-11-20T07:02:43.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.361+0000 7f8fb2ffd640 1 --2- 172.21.15.88:0/4004095917 >> v2:172.21.15.175:3300/0 conn(0x7f8fb4159ba0 0x7f8fb40cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:02:43.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.365+0000 7f8fb37fe640 1 --2- 172.21.15.88:0/4004095917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb41597c0 0x7f8fb40ad6d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40097c0 tx=0x7f8fa401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1cd89d212f416de server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.365+0000 7f8fb27fc640 1 -- 172.21.15.88:0/4004095917 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40ab620 con 0x7f8fb41597c0 2023-11-20T07:02:43.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.365+0000 7f8fb27fc640 1 -- 172.21.15.88:0/4004095917 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa40ab780 con 0x7f8fb41597c0 2023-11-20T07:02:43.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.365+0000 7f8fb27fc640 1 -- 172.21.15.88:0/4004095917 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40abaf0 con 0x7f8fb41597c0 2023-11-20T07:02:43.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.365+0000 7f8fba194640 1 -- 172.21.15.88:0/4004095917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb41597c0 msgr2=0x7f8fb40ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.365+0000 7f8fba194640 1 --2- 172.21.15.88:0/4004095917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb41597c0 0x7f8fb40ad6d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40097c0 tx=0x7f8fa401c480 comp rx=0 tx=0).stop 2023-11-20T07:02:43.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.365+0000 7f8fba194640 1 -- 172.21.15.88:0/4004095917 shutdown_connections 2023-11-20T07:02:43.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.365+0000 7f8fba194640 1 --2- 172.21.15.88:0/4004095917 >> v2:172.21.15.175:3300/0 conn(0x7f8fb4159ba0 0x7f8fb40cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.365+0000 7f8fba194640 1 --2- 172.21.15.88:0/4004095917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb41597c0 0x7f8fb40ad6d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.365+0000 7f8fba194640 1 -- 172.21.15.88:0/4004095917 >> 172.21.15.88:0/4004095917 conn(0x7f8fb406c190 msgr2=0x7f8fb406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:43.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.365+0000 7f8fba194640 1 -- 172.21.15.88:0/4004095917 shutdown_connections 2023-11-20T07:02:43.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.365+0000 7f8fba194640 1 -- 172.21.15.88:0/4004095917 wait complete. 2023-11-20T07:02:43.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fba194640 1 Processor -- start 2023-11-20T07:02:43.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fba194640 1 -- start start 2023-11-20T07:02:43.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fba194640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb40adc10 0x7f8fb40ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fba194640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb41597c0 0x7f8fb4156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fba194640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb4159ba0 0x7f8fb4156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fba194640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb41572e0 con 0x7f8fb41597c0 2023-11-20T07:02:43.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fba194640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40c5730 con 0x7f8fb4159ba0 2023-11-20T07:02:43.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fba194640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40c5940 con 0x7f8fb40adc10 2023-11-20T07:02:43.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fb37fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb40adc10 0x7f8fb40ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fb2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb41597c0 0x7f8fb4156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fb37fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb40adc10 0x7f8fb40ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:34130/0 (socket says 172.21.15.88:34130) 2023-11-20T07:02:43.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fb37fe640 1 -- 172.21.15.88:0/949575896 learned_addr learned my addr 172.21.15.88:0/949575896 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:43.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fb3fff640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb4159ba0 0x7f8fb4156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fb2ffd640 1 -- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb40adc10 msgr2=0x7f8fb40ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fb2ffd640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb40adc10 0x7f8fb40ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fb2ffd640 1 -- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb4159ba0 msgr2=0x7f8fb4156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fb2ffd640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb4159ba0 0x7f8fb4156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fb2ffd640 1 -- 172.21.15.88:0/949575896 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa8009420 con 0x7f8fb41597c0 2023-11-20T07:02:43.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fb2ffd640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb41597c0 0x7f8fb4156860 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800e8e0 tx=0x7f8fa800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8f9bfff640 1 -- 172.21.15.88:0/949575896 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800c8e0 con 0x7f8fb41597c0 2023-11-20T07:02:43.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8f9bfff640 1 -- 172.21.15.88:0/949575896 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800ca40 con 0x7f8fb41597c0 2023-11-20T07:02:43.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fba194640 1 -- 172.21.15.88:0/949575896 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa4009420 con 0x7f8fb41597c0 2023-11-20T07:02:43.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8f9bfff640 1 -- 172.21.15.88:0/949575896 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800cdf0 con 0x7f8fb41597c0 2023-11-20T07:02:43.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.369+0000 7f8fba194640 1 -- 172.21.15.88:0/949575896 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb40c61e0 con 0x7f8fb41597c0 2023-11-20T07:02:43.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.373+0000 7f8fba194640 1 -- 172.21.15.88:0/949575896 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb4074010 con 0x7f8fb41597c0 2023-11-20T07:02:43.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.373+0000 7f8f9bfff640 1 -- 172.21.15.88:0/949575896 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8fa8013470 con 0x7f8fb41597c0 2023-11-20T07:02:43.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.373+0000 7f8f9bfff640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8fa00664a0 0x7f8fa0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.373+0000 7f8f9bfff640 1 -- 172.21.15.88:0/949575896 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8fa8083f20 con 0x7f8fb41597c0 2023-11-20T07:02:43.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.373+0000 7f8fb37fe640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8fa00664a0 0x7f8fa0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.373+0000 7f8fb37fe640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8fa00664a0 0x7f8fa0068960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8fa401a0b0 tx=0x7f8fa40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.379 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.377+0000 7f8f9bfff640 1 -- 172.21.15.88:0/949575896 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8fa8051570 con 0x7f8fb41597c0 2023-11-20T07:02:43.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 -- 172.21.15.88:0/949575896 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fb40cd3f0 con 0x7f8fa00664a0 2023-11-20T07:02:43.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8f9bfff640 1 -- 172.21.15.88:0/949575896 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8fb40cd3f0 con 0x7f8fa00664a0 2023-11-20T07:02:43.530 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 5 to deep-scrub 2023-11-20T07:02:43.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 -- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8fa00664a0 msgr2=0x7f8fa0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8fa00664a0 0x7f8fa0068960 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8fa401a0b0 tx=0x7f8fa40a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:43.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 -- 172.21.15.88:0/949575896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb41597c0 msgr2=0x7f8fb4156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb41597c0 0x7f8fb4156860 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800e8e0 tx=0x7f8fa800eda0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 -- 172.21.15.88:0/949575896 shutdown_connections 2023-11-20T07:02:43.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f8fa00664a0 0x7f8fa0068960 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb4159ba0 0x7f8fb4156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fb41597c0 0x7f8fb4156860 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 --2- 172.21.15.88:0/949575896 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb40adc10 0x7f8fb40ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 -- 172.21.15.88:0/949575896 >> 172.21.15.88:0/949575896 conn(0x7f8fb406c190 msgr2=0x7f8fb40cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:43.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 -- 172.21.15.88:0/949575896 shutdown_connections 2023-11-20T07:02:43.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.529+0000 7f8fba194640 1 -- 172.21.15.88:0/949575896 wait complete. 2023-11-20T07:02:43.550 INFO:tasks.ceph:Scrubbing osd.6 2023-11-20T07:02:43.551 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-20T07:02:43.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1ffc79640 1 Processor -- start 2023-11-20T07:02:43.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1ffc79640 1 -- start start 2023-11-20T07:02:43.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1ffc79640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb1f80cd540 0x7fb1f815ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1ffc79640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb1f80cd920 0x7fb1f80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1ffc79640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f80ce6b0 con 0x7fb1f80d13f0 2023-11-20T07:02:43.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1ffc79640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f80cebe0 con 0x7fb1f80cd540 2023-11-20T07:02:43.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1ffc79640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f80cc6d0 con 0x7fb1f80cd920 2023-11-20T07:02:43.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1fda15640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb1f80cd540 0x7fb1f815ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1fda15640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb1f80cd540 0x7fb1f815ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50200/0 (socket says 172.21.15.88:50200) 2023-11-20T07:02:43.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1fda15640 1 -- 172.21.15.88:0/3038951435 learned_addr learned my addr 172.21.15.88:0/3038951435 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:43.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1fe216640 1 --2- 172.21.15.88:0/3038951435 >> v2:172.21.15.175:3300/0 conn(0x7fb1f80cd920 0x7fb1f80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1fda15640 1 -- 172.21.15.88:0/3038951435 >> v2:172.21.15.175:3300/0 conn(0x7fb1f80cd920 msgr2=0x7fb1f80ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:43.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1fda15640 1 --2- 172.21.15.88:0/3038951435 >> v2:172.21.15.175:3300/0 conn(0x7fb1f80cd920 0x7fb1f80ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1fda15640 1 -- 172.21.15.88:0/3038951435 >> v1:172.21.15.88:6789/0 conn(0x7fb1f80d13f0 legacy=0x7fb1f815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1fda15640 1 -- 172.21.15.88:0/3038951435 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f80ce900 con 0x7fb1f80cd540 2023-11-20T07:02:43.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.693+0000 7fb1fca13640 1 -- 172.21.15.88:0/3038951435 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512719782 0 0) 0x7fb1f80ce6b0 con 0x7fb1f80d13f0 2023-11-20T07:02:43.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.697+0000 7fb1fda15640 1 --2- 172.21.15.88:0/3038951435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80cd540 0x7fb1f815ea30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8071b80 tx=0x7fb1f401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb9a4032c98472a server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.697+0000 7fb1fca13640 1 -- 172.21.15.88:0/3038951435 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40ac640 con 0x7fb1f80cd540 2023-11-20T07:02:43.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.697+0000 7fb1fca13640 1 -- 172.21.15.88:0/3038951435 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f40ac7a0 con 0x7fb1f80cd540 2023-11-20T07:02:43.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.697+0000 7fb1fca13640 1 -- 172.21.15.88:0/3038951435 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40acb30 con 0x7fb1f80cd540 2023-11-20T07:02:43.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.697+0000 7fb1ffc79640 1 -- 172.21.15.88:0/3038951435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80cd540 msgr2=0x7fb1f815ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.697+0000 7fb1ffc79640 1 --2- 172.21.15.88:0/3038951435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80cd540 0x7fb1f815ea30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8071b80 tx=0x7fb1f401c4d0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.697+0000 7fb1ffc79640 1 -- 172.21.15.88:0/3038951435 shutdown_connections 2023-11-20T07:02:43.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.697+0000 7fb1ffc79640 1 --2- 172.21.15.88:0/3038951435 >> v2:172.21.15.175:3300/0 conn(0x7fb1f80cd920 0x7fb1f80ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.697+0000 7fb1ffc79640 1 --2- 172.21.15.88:0/3038951435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80cd540 0x7fb1f815ea30 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.697+0000 7fb1ffc79640 1 -- 172.21.15.88:0/3038951435 >> 172.21.15.88:0/3038951435 conn(0x7fb1f80d08d0 msgr2=0x7fb1f80d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:43.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.697+0000 7fb1ffc79640 1 -- 172.21.15.88:0/3038951435 shutdown_connections 2023-11-20T07:02:43.700 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.697+0000 7fb1ffc79640 1 -- 172.21.15.88:0/3038951435 wait complete. 2023-11-20T07:02:43.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ffc79640 1 Processor -- start 2023-11-20T07:02:43.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ffc79640 1 -- start start 2023-11-20T07:02:43.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ffc79640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f80cd540 0x7fb1f815ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ffc79640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1f80cd920 0x7fb1f80c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ffc79640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80d13f0 0x7fb1f80c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ffc79640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80ca890 con 0x7fb1f80d13f0 2023-11-20T07:02:43.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ffc79640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80c9a00 con 0x7fb1f80cd920 2023-11-20T07:02:43.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ffc79640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80c9c80 con 0x7fb1f80cd540 2023-11-20T07:02:43.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1fe216640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80d13f0 0x7fb1f80c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1fe216640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80d13f0 0x7fb1f80c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50214/0 (socket says 172.21.15.88:50214) 2023-11-20T07:02:43.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1fe216640 1 -- 172.21.15.88:0/1265217620 learned_addr learned my addr 172.21.15.88:0/1265217620 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:43.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1fd214640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1f80cd920 0x7fb1f80c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1fda15640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f80cd540 0x7fb1f815ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1fe216640 1 -- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f80cd540 msgr2=0x7fb1f815ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1fe216640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1f80cd540 0x7fb1f815ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1fe216640 1 -- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1f80cd920 msgr2=0x7fb1f80c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1fe216640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1f80cd920 0x7fb1f80c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1fe216640 1 -- 172.21.15.88:0/1265217620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40094d0 con 0x7fb1f80d13f0 2023-11-20T07:02:43.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1fe216640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80d13f0 0x7fb1f80c7ee0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0007e70 tx=0x7fb1f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ee7fc640 1 -- 172.21.15.88:0/1265217620 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0014620 con 0x7fb1f80d13f0 2023-11-20T07:02:43.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ee7fc640 1 -- 172.21.15.88:0/1265217620 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f00147a0 con 0x7fb1f80d13f0 2023-11-20T07:02:43.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ee7fc640 1 -- 172.21.15.88:0/1265217620 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0014b50 con 0x7fb1f80d13f0 2023-11-20T07:02:43.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ffc79640 1 -- 172.21.15.88:0/1265217620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f80c9f60 con 0x7fb1f80d13f0 2023-11-20T07:02:43.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.701+0000 7fb1ffc79640 1 -- 172.21.15.88:0/1265217620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f80ca520 con 0x7fb1f80d13f0 2023-11-20T07:02:43.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.705+0000 7fb1ffc79640 1 -- 172.21.15.88:0/1265217620 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1f815f680 con 0x7fb1f80d13f0 2023-11-20T07:02:43.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.705+0000 7fb1ee7fc640 1 -- 172.21.15.88:0/1265217620 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb1f0014cb0 con 0x7fb1f80d13f0 2023-11-20T07:02:43.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.705+0000 7fb1ee7fc640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb1dc0664a0 0x7fb1dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.705+0000 7fb1ee7fc640 1 -- 172.21.15.88:0/1265217620 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb1f0084770 con 0x7fb1f80d13f0 2023-11-20T07:02:43.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.705+0000 7fb1ee7fc640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] conn(0x7fb1dc06c7a0 0x7fb1dc06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.705+0000 7fb1ee7fc640 1 -- 172.21.15.88:0/1265217620 --> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1dc06f2b0 con 0x7fb1dc06c7a0 2023-11-20T07:02:43.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.705+0000 7fb1ee7fc640 1 -- 172.21.15.88:0/1265217620 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1f0086d50 con 0x7fb1f80d13f0 2023-11-20T07:02:43.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.705+0000 7fb1fda15640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb1dc0664a0 0x7fb1dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.705+0000 7fb1fd214640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] conn(0x7fb1dc06c7a0 0x7fb1dc06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.705+0000 7fb1fda15640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb1dc0664a0 0x7fb1dc068960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40ae000 tx=0x7fb1f40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.705+0000 7fb1fd214640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] conn(0x7fb1dc06c7a0 0x7fb1dc06ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.709+0000 7fb1ee7fc640 1 -- 172.21.15.88:0/1265217620 <== osd.6 v2:172.21.15.175:6822/3652084907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb1dc06f2b0 con 0x7fb1dc06c7a0 2023-11-20T07:02:43.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1ffc79640 1 -- 172.21.15.88:0/1265217620 --> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb1f80ca6e0 con 0x7fb1dc06c7a0 2023-11-20T07:02:43.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1ee7fc640 1 -- 172.21.15.88:0/1265217620 <== osd.6 v2:172.21.15.175:6822/3652084907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb1f80ca6e0 con 0x7fb1dc06c7a0 2023-11-20T07:02:43.722 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:02:43.722 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T07:02:43.722 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:02:43.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1ffc79640 1 -- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] conn(0x7fb1dc06c7a0 msgr2=0x7fb1dc06ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1ffc79640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:6822/3652084907,v1:172.21.15.175:6824/3652084907] conn(0x7fb1dc06c7a0 0x7fb1dc06ebe0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1ffc79640 1 -- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb1dc0664a0 msgr2=0x7fb1dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1ffc79640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fb1dc0664a0 0x7fb1dc068960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40ae000 tx=0x7fb1f40a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:43.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1ffc79640 1 -- 172.21.15.88:0/1265217620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80d13f0 msgr2=0x7fb1f80c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1ffc79640 1 --2- 172.21.15.88:0/1265217620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f80d13f0 0x7fb1f80c7ee0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0007e70 tx=0x7fb1f000e4b0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1fe216640 1 -- 172.21.15.88:0/1265217620 reap_dead start 2023-11-20T07:02:43.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1ffc79640 1 -- 172.21.15.88:0/1265217620 shutdown_connections 2023-11-20T07:02:43.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1ffc79640 1 -- 172.21.15.88:0/1265217620 >> 172.21.15.88:0/1265217620 conn(0x7fb1f80d08d0 msgr2=0x7fb1f8159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:43.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1ffc79640 1 -- 172.21.15.88:0/1265217620 shutdown_connections 2023-11-20T07:02:43.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.721+0000 7fb1ffc79640 1 -- 172.21.15.88:0/1265217620 wait complete. 2023-11-20T07:02:43.741 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-20T07:02:43.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.881+0000 7f5bdcb3e640 1 Processor -- start 2023-11-20T07:02:43.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.881+0000 7f5bdcb3e640 1 -- start start 2023-11-20T07:02:43.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bdcb3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd81597c0 0x7f5bd80ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bdcb3e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5bd80adc10 0x7f5bd80cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bdcb3e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd80723d0 con 0x7f5bd8159ba0 2023-11-20T07:02:43.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bdcb3e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd80717c0 con 0x7f5bd80adc10 2023-11-20T07:02:43.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bdcb3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd8071aa0 con 0x7f5bd81597c0 2023-11-20T07:02:43.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bd6d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5bd80adc10 0x7f5bd80cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bd6d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5bd80adc10 0x7f5bd80cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50220/0 (socket says 172.21.15.88:50220) 2023-11-20T07:02:43.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bd6d9d640 1 -- 172.21.15.88:0/539253113 learned_addr learned my addr 172.21.15.88:0/539253113 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:43.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bcdd9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5bd8159ba0 0x7f5bd80cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55926/0 (socket says 172.21.15.88:55926) 2023-11-20T07:02:43.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bd659c640 1 --2- 172.21.15.88:0/539253113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd81597c0 0x7f5bd80ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bd6d9d640 1 -- 172.21.15.88:0/539253113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd81597c0 msgr2=0x7f5bd80ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:43.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bd6d9d640 1 --2- 172.21.15.88:0/539253113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd81597c0 0x7f5bd80ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bd6d9d640 1 -- 172.21.15.88:0/539253113 >> v1:172.21.15.88:6789/0 conn(0x7f5bd8159ba0 legacy=0x7f5bd80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bd6d9d640 1 -- 172.21.15.88:0/539253113 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8071d80 con 0x7f5bd80adc10 2023-11-20T07:02:43.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bd5d9b640 1 -- 172.21.15.88:0/539253113 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766321350 0 0) 0x7f5bd80723d0 con 0x7f5bd8159ba0 2023-11-20T07:02:43.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bd6d9d640 1 --2- 172.21.15.88:0/539253113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd80adc10 0x7f5bd80cb520 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009e50 tx=0x7f5bd001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef38f2374a6dbc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.885+0000 7f5bd5d9b640 1 -- 172.21.15.88:0/539253113 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00a5880 con 0x7f5bd80adc10 2023-11-20T07:02:43.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bd5d9b640 1 -- 172.21.15.88:0/539253113 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd00a59e0 con 0x7f5bd80adc10 2023-11-20T07:02:43.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bd5d9b640 1 -- 172.21.15.88:0/539253113 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00a5d70 con 0x7f5bd80adc10 2023-11-20T07:02:43.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/539253113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd80adc10 msgr2=0x7f5bd80cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 --2- 172.21.15.88:0/539253113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd80adc10 0x7f5bd80cb520 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009e50 tx=0x7f5bd001ca10 comp rx=0 tx=0).stop 2023-11-20T07:02:43.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/539253113 shutdown_connections 2023-11-20T07:02:43.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 --2- 172.21.15.88:0/539253113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd80adc10 0x7f5bd80cb520 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 --2- 172.21.15.88:0/539253113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd81597c0 0x7f5bd80ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/539253113 >> 172.21.15.88:0/539253113 conn(0x7f5bd806c190 msgr2=0x7f5bd806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:43.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/539253113 shutdown_connections 2023-11-20T07:02:43.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/539253113 wait complete. 2023-11-20T07:02:43.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 Processor -- start 2023-11-20T07:02:43.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 -- start start 2023-11-20T07:02:43.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd80adc10 0x7f5bd8157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd81597c0 0x7f5bd80ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd8159ba0 0x7f5bd80c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80ac7c0 con 0x7f5bd80adc10 2023-11-20T07:02:43.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80ac9f0 con 0x7f5bd81597c0 2023-11-20T07:02:43.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bdcb3e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd80accd0 con 0x7f5bd8159ba0 2023-11-20T07:02:43.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bd659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd80adc10 0x7f5bd8157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bd659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd80adc10 0x7f5bd8157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50230/0 (socket says 172.21.15.88:50230) 2023-11-20T07:02:43.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.889+0000 7f5bd659c640 1 -- 172.21.15.88:0/3467252261 learned_addr learned my addr 172.21.15.88:0/3467252261 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:43.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bd6d9d640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd8159ba0 0x7f5bd80c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bcdd9b640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd81597c0 0x7f5bd80ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bd659c640 1 -- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd8159ba0 msgr2=0x7f5bd80c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bd659c640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd8159ba0 0x7f5bd80c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bd659c640 1 -- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd81597c0 msgr2=0x7f5bd80ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:43.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bd659c640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd81597c0 0x7f5bd80ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:43.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bd659c640 1 -- 172.21.15.88:0/3467252261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0009b30 con 0x7f5bd80adc10 2023-11-20T07:02:43.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bd6d9d640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd8159ba0 0x7f5bd80c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:43.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bcdd9b640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd81597c0 0x7f5bd80ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:43.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bd659c640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd80adc10 0x7f5bd8157ac0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800d800 tx=0x7f5bc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bcf7fe640 1 -- 172.21.15.88:0/3467252261 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc800b6c0 con 0x7f5bd80adc10 2023-11-20T07:02:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bcf7fe640 1 -- 172.21.15.88:0/3467252261 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc800b820 con 0x7f5bd80adc10 2023-11-20T07:02:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bcf7fe640 1 -- 172.21.15.88:0/3467252261 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc800bb90 con 0x7f5bd80adc10 2023-11-20T07:02:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/3467252261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd80acfb0 con 0x7f5bd80adc10 2023-11-20T07:02:43.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/3467252261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd80c4e80 con 0x7f5bd80adc10 2023-11-20T07:02:43.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/3467252261 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd8074010 con 0x7f5bd80adc10 2023-11-20T07:02:43.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bcf7fe640 1 -- 172.21.15.88:0/3467252261 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5bc800bcf0 con 0x7f5bd80adc10 2023-11-20T07:02:43.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bcf7fe640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bb80664a0 0x7f5bb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:43.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.893+0000 7f5bcf7fe640 1 -- 172.21.15.88:0/3467252261 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5bc8084260 con 0x7f5bd80adc10 2023-11-20T07:02:43.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.897+0000 7f5bcdd9b640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bb80664a0 0x7f5bb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:43.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.897+0000 7f5bcdd9b640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bb80664a0 0x7f5bb8068960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0007fd0 tx=0x7f5bc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:43.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:43.897+0000 7f5bcf7fe640 1 -- 172.21.15.88:0/3467252261 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5bc8051890 con 0x7f5bd80adc10 2023-11-20T07:02:44.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.049+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/3467252261 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bd8164830 con 0x7f5bb80664a0 2023-11-20T07:02:44.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.049+0000 7f5bcf7fe640 1 -- 172.21.15.88:0/3467252261 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5bc00013b0 con 0x7f5bb80664a0 2023-11-20T07:02:44.050 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 6 to deep-scrub 2023-11-20T07:02:44.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.049+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bb80664a0 msgr2=0x7f5bb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.049+0000 7f5bdcb3e640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bb80664a0 0x7f5bb8068960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0007fd0 tx=0x7f5bc0009040 comp rx=0 tx=0).stop 2023-11-20T07:02:44.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.049+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/3467252261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd80adc10 msgr2=0x7f5bd8157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.049+0000 7f5bdcb3e640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd80adc10 0x7f5bd8157ac0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800d800 tx=0x7f5bc800dcc0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.049+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/3467252261 shutdown_connections 2023-11-20T07:02:44.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.049+0000 7f5bdcb3e640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5bb80664a0 0x7f5bb8068960 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.049+0000 7f5bdcb3e640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd8159ba0 0x7f5bd80c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.049+0000 7f5bdcb3e640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd81597c0 0x7f5bd80ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.049+0000 7f5bdcb3e640 1 --2- 172.21.15.88:0/3467252261 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bd80adc10 0x7f5bd8157ac0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.049+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/3467252261 >> 172.21.15.88:0/3467252261 conn(0x7f5bd806c190 msgr2=0x7f5bd80ae1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:44.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.053+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/3467252261 shutdown_connections 2023-11-20T07:02:44.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.053+0000 7f5bdcb3e640 1 -- 172.21.15.88:0/3467252261 wait complete. 2023-11-20T07:02:44.071 INFO:tasks.ceph:Scrubbing osd.7 2023-11-20T07:02:44.072 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-20T07:02:44.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68e5409640 1 Processor -- start 2023-11-20T07:02:44.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68e5409640 1 -- start start 2023-11-20T07:02:44.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68e5409640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f68e00d2570 0x7f68e0161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68e5409640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68e00cdc80 0x7f68e00cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68e5409640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e00ce460 con 0x7f68e015dec0 2023-11-20T07:02:44.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68e5409640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e00cd830 con 0x7f68e00d2570 2023-11-20T07:02:44.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68e5409640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e015da30 con 0x7f68e00cdc80 2023-11-20T07:02:44.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68deffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f68e00d2570 0x7f68e0161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68deffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f68e00d2570 0x7f68e0161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50236/0 (socket says 172.21.15.88:50236) 2023-11-20T07:02:44.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68deffd640 1 -- 172.21.15.88:0/42924690 learned_addr learned my addr 172.21.15.88:0/42924690 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:44.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68d67fc640 1 --2- 172.21.15.88:0/42924690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68e00cdc80 0x7f68e00cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68deffd640 1 -- 172.21.15.88:0/42924690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68e00cdc80 msgr2=0x7f68e00cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:44.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68deffd640 1 --2- 172.21.15.88:0/42924690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68e00cdc80 0x7f68e00cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68deffd640 1 -- 172.21.15.88:0/42924690 >> v1:172.21.15.175:6789/0 conn(0x7f68e015dec0 legacy=0x7f68e00d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:44.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.217+0000 7f68deffd640 1 -- 172.21.15.88:0/42924690 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0161750 con 0x7f68e00d2570 2023-11-20T07:02:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.221+0000 7f68deffd640 1 --2- 172.21.15.88:0/42924690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68e00d2570 0x7f68e0161210 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009870 tx=0x7f68d001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411ed253188a8e63 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:44.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.221+0000 7f68de7fc640 1 -- 172.21.15.88:0/42924690 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00ac600 con 0x7f68e00d2570 2023-11-20T07:02:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.221+0000 7f68de7fc640 1 -- 172.21.15.88:0/42924690 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d00a8050 con 0x7f68e00d2570 2023-11-20T07:02:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.221+0000 7f68de7fc640 1 -- 172.21.15.88:0/42924690 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00ac980 con 0x7f68e00d2570 2023-11-20T07:02:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.221+0000 7f68e5409640 1 -- 172.21.15.88:0/42924690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68e00d2570 msgr2=0x7f68e0161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.221+0000 7f68e5409640 1 --2- 172.21.15.88:0/42924690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68e00d2570 0x7f68e0161210 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009870 tx=0x7f68d001c4d0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.221+0000 7f68e5409640 1 -- 172.21.15.88:0/42924690 shutdown_connections 2023-11-20T07:02:44.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.221+0000 7f68e5409640 1 --2- 172.21.15.88:0/42924690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68e00cdc80 0x7f68e00cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.221+0000 7f68e5409640 1 --2- 172.21.15.88:0/42924690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68e00d2570 0x7f68e0161210 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.221+0000 7f68e5409640 1 -- 172.21.15.88:0/42924690 >> 172.21.15.88:0/42924690 conn(0x7f68e00715c0 msgr2=0x7f68e00719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:44.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.221+0000 7f68e5409640 1 -- 172.21.15.88:0/42924690 shutdown_connections 2023-11-20T07:02:44.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.221+0000 7f68e5409640 1 -- 172.21.15.88:0/42924690 wait complete. 2023-11-20T07:02:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68e5409640 1 Processor -- start 2023-11-20T07:02:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68e5409640 1 -- start start 2023-11-20T07:02:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68e5409640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68e00cdc80 0x7f68e01494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68e5409640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68e00d2570 0x7f68e01548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68e5409640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68e015dec0 0x7f68e01532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68e5409640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e014fb00 con 0x7f68e015dec0 2023-11-20T07:02:44.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68e5409640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e014ff20 con 0x7f68e00d2570 2023-11-20T07:02:44.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68e5409640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e014f160 con 0x7f68e00cdc80 2023-11-20T07:02:44.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68df7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68e015dec0 0x7f68e01532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68df7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68e015dec0 0x7f68e01532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50246/0 (socket says 172.21.15.88:50246) 2023-11-20T07:02:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68df7fe640 1 -- 172.21.15.88:0/3664382948 learned_addr learned my addr 172.21.15.88:0/3664382948 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68d67fc640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68e00d2570 0x7f68e01548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68deffd640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68e00cdc80 0x7f68e01494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68df7fe640 1 -- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68e00cdc80 msgr2=0x7f68e01494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68df7fe640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68e00cdc80 0x7f68e01494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68df7fe640 1 -- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68e00d2570 msgr2=0x7f68e01548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68df7fe640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68e00d2570 0x7f68e01548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68df7fe640 1 -- 172.21.15.88:0/3664382948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d00094d0 con 0x7f68e015dec0 2023-11-20T07:02:44.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68df7fe640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68e015dec0 0x7f68e01532e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f68d800c3c0 tx=0x7f68d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:44.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68d7fff640 1 -- 172.21.15.88:0/3664382948 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d8011790 con 0x7f68e015dec0 2023-11-20T07:02:44.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68d7fff640 1 -- 172.21.15.88:0/3664382948 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d80118f0 con 0x7f68e015dec0 2023-11-20T07:02:44.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68d7fff640 1 -- 172.21.15.88:0/3664382948 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d8011ca0 con 0x7f68e015dec0 2023-11-20T07:02:44.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68e5409640 1 -- 172.21.15.88:0/3664382948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e014f440 con 0x7f68e015dec0 2023-11-20T07:02:44.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.225+0000 7f68e5409640 1 -- 172.21.15.88:0/3664382948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e0149a30 con 0x7f68e015dec0 2023-11-20T07:02:44.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.229+0000 7f68e5409640 1 -- 172.21.15.88:0/3664382948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68e00d2950 con 0x7f68e015dec0 2023-11-20T07:02:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.229+0000 7f68d7fff640 1 -- 172.21.15.88:0/3664382948 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f68d801c460 con 0x7f68e015dec0 2023-11-20T07:02:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.229+0000 7f68d7fff640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f68c00664a0 0x7f68c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.229+0000 7f68d7fff640 1 -- 172.21.15.88:0/3664382948 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f68d80839e0 con 0x7f68e015dec0 2023-11-20T07:02:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.229+0000 7f68d7fff640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] conn(0x7f68c006c7a0 0x7f68c006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.229+0000 7f68d7fff640 1 -- 172.21.15.88:0/3664382948 --> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68c006f2b0 con 0x7f68c006c7a0 2023-11-20T07:02:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.229+0000 7f68d7fff640 1 -- 172.21.15.88:0/3664382948 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68d80882a0 con 0x7f68e015dec0 2023-11-20T07:02:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.229+0000 7f68deffd640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f68c00664a0 0x7f68c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.229+0000 7f68d67fc640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] conn(0x7f68c006c7a0 0x7f68c006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.229+0000 7f68deffd640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f68c00664a0 0x7f68c0068960 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f68d00ae000 tx=0x7f68d00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.229+0000 7f68d67fc640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] conn(0x7f68c006c7a0 0x7f68c006ebe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:44.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.233+0000 7f68d7fff640 1 -- 172.21.15.88:0/3664382948 <== osd.7 v2:172.21.15.175:6808/205055633 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f68c006f2b0 con 0x7f68c006c7a0 2023-11-20T07:02:44.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68e5409640 1 -- 172.21.15.88:0/3664382948 --> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f68e015d6c0 con 0x7f68c006c7a0 2023-11-20T07:02:44.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68d7fff640 1 -- 172.21.15.88:0/3664382948 <== osd.7 v2:172.21.15.175:6808/205055633 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f68c8009d20 con 0x7f68c006c7a0 2023-11-20T07:02:44.246 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-11-20T07:02:44.246 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-20T07:02:44.246 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-11-20T07:02:44.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68e5409640 1 -- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] conn(0x7f68c006c7a0 msgr2=0x7f68c006ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68e5409640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:6808/205055633,v1:172.21.15.175:6809/205055633] conn(0x7f68c006c7a0 0x7f68c006ebe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68e5409640 1 -- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f68c00664a0 msgr2=0x7f68c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68e5409640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f68c00664a0 0x7f68c0068960 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f68d00ae000 tx=0x7f68d00a7000 comp rx=0 tx=0).stop 2023-11-20T07:02:44.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68e5409640 1 -- 172.21.15.88:0/3664382948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68e015dec0 msgr2=0x7f68e01532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68e5409640 1 --2- 172.21.15.88:0/3664382948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f68e015dec0 0x7f68e01532e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f68d800c3c0 tx=0x7f68d800c880 comp rx=0 tx=0).stop 2023-11-20T07:02:44.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68df7fe640 1 -- 172.21.15.88:0/3664382948 reap_dead start 2023-11-20T07:02:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68e5409640 1 -- 172.21.15.88:0/3664382948 shutdown_connections 2023-11-20T07:02:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68e5409640 1 -- 172.21.15.88:0/3664382948 >> 172.21.15.88:0/3664382948 conn(0x7f68e00715c0 msgr2=0x7f68e0156ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68e5409640 1 -- 172.21.15.88:0/3664382948 shutdown_connections 2023-11-20T07:02:44.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.245+0000 7f68e5409640 1 -- 172.21.15.88:0/3664382948 wait complete. 2023-11-20T07:02:44.264 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-20T07:02:44.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee9b246640 1 Processor -- start 2023-11-20T07:02:44.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee9b246640 1 -- start start 2023-11-20T07:02:44.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee9b246640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fee94070c40 0x7fee9415ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee9b246640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee940b07f0 0x7fee94164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee9b246640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9415be60 con 0x7fee940b4020 2023-11-20T07:02:44.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee9b246640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9415b3b0 con 0x7fee94070c40 2023-11-20T07:02:44.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee9b246640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9415c1f0 con 0x7fee940b07f0 2023-11-20T07:02:44.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fee940b4020 0x7fee940b00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55942/0 (socket says 172.21.15.88:55942) 2023-11-20T07:02:44.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8bfff640 1 -- 172.21.15.88:0/3853086244 learned_addr learned my addr 172.21.15.88:0/3853086244 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:44.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee98fe2640 1 --2- 172.21.15.88:0/3853086244 >> v2:172.21.15.175:3300/0 conn(0x7fee94070c40 0x7fee9415ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee997e3640 1 --2- 172.21.15.88:0/3853086244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee940b07f0 0x7fee94164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875549908 0 0) 0x7fee9415be60 con 0x7fee940b4020 2023-11-20T07:02:44.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee7c003530 con 0x7fee940b4020 2023-11-20T07:02:44.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1464505059 0 0) 0x7fee7c003530 con 0x7fee940b4020 2023-11-20T07:02:44.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee940b07f0 msgr2=0x7fee94164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:44.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 --2- 172.21.15.88:0/3853086244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee940b07f0 0x7fee94164490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 >> v2:172.21.15.175:3300/0 conn(0x7fee94070c40 msgr2=0x7fee9415ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:44.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 --2- 172.21.15.88:0/3853086244 >> v2:172.21.15.175:3300/0 conn(0x7fee94070c40 0x7fee9415ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94071020 con 0x7fee940b4020 2023-11-20T07:02:44.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1242639563 0 0) 0x7fee84001680 con 0x7fee940b4020 2023-11-20T07:02:44.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 >> v1:172.21.15.88:6789/0 conn(0x7fee940b4020 legacy=0x7fee940b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 --2- 172.21.15.88:0/3853086244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee7c003980 0x7fee7c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 --2- 172.21.15.88:0/3853086244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee940b07f0 0x7fee7c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 --2- 172.21.15.88:0/3853086244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c004d10 0x7fee7c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9415b3b0 con 0x7fee7c004d10 2023-11-20T07:02:44.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9415c1f0 con 0x7fee7c003980 2023-11-20T07:02:44.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c00b9c0 con 0x7fee940b07f0 2023-11-20T07:02:44.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee997e3640 1 --2- 172.21.15.88:0/3853086244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c004d10 0x7fee7c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee98fe2640 1 --2- 172.21.15.88:0/3853086244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee7c003980 0x7fee7c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee8bfff640 1 --2- 172.21.15.88:0/3853086244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee940b07f0 0x7fee7c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee997e3640 1 -- 172.21.15.88:0/3853086244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee940b07f0 msgr2=0x7fee7c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee997e3640 1 --2- 172.21.15.88:0/3853086244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee940b07f0 0x7fee7c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee997e3640 1 -- 172.21.15.88:0/3853086244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee7c003980 msgr2=0x7fee7c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee997e3640 1 --2- 172.21.15.88:0/3853086244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee7c003980 0x7fee7c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.409+0000 7fee997e3640 1 -- 172.21.15.88:0/3853086244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c003530 con 0x7fee7c004d10 2023-11-20T07:02:44.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.413+0000 7fee997e3640 1 --2- 172.21.15.88:0/3853086244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c004d10 0x7fee7c005190 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009f90 tx=0x7fee8c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a3bc50feb3327f server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:44.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.413+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c0a5c30 con 0x7fee7c004d10 2023-11-20T07:02:44.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.413+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c00f040 con 0x7fee7c004d10 2023-11-20T07:02:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.413+0000 7fee8b7fe640 1 -- 172.21.15.88:0/3853086244 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c0ad440 con 0x7fee7c004d10 2023-11-20T07:02:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.413+0000 7fee9b246640 1 -- 172.21.15.88:0/3853086244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c004d10 msgr2=0x7fee7c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.413+0000 7fee9b246640 1 --2- 172.21.15.88:0/3853086244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c004d10 0x7fee7c005190 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009f90 tx=0x7fee8c01cc20 comp rx=0 tx=0).stop 2023-11-20T07:02:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.413+0000 7fee997e3640 1 -- 172.21.15.88:0/3853086244 reap_dead start 2023-11-20T07:02:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.413+0000 7fee9b246640 1 -- 172.21.15.88:0/3853086244 shutdown_connections 2023-11-20T07:02:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.413+0000 7fee9b246640 1 -- 172.21.15.88:0/3853086244 >> 172.21.15.88:0/3853086244 conn(0x7fee9406c190 msgr2=0x7fee9406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.413+0000 7fee9b246640 1 -- 172.21.15.88:0/3853086244 shutdown_connections 2023-11-20T07:02:44.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.413+0000 7fee9b246640 1 -- 172.21.15.88:0/3853086244 wait complete. 2023-11-20T07:02:44.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee9b246640 1 Processor -- start 2023-11-20T07:02:44.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee9b246640 1 -- start start 2023-11-20T07:02:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee9b246640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee940ad0f0 0x7fee941f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee9b246640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee940c94b0 0x7fee940c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee9b246640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee941f5030 0x7fee941f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee9b246640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee941f5a20 con 0x7fee940ad0f0 2023-11-20T07:02:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee9b246640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee940c5eb0 con 0x7fee940c94b0 2023-11-20T07:02:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee9b246640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee940c9c20 con 0x7fee941f5030 2023-11-20T07:02:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee98fe2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee940ad0f0 0x7fee941f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee98fe2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee940ad0f0 0x7fee941f1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50260/0 (socket says 172.21.15.88:50260) 2023-11-20T07:02:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee98fe2640 1 -- 172.21.15.88:0/1761901080 learned_addr learned my addr 172.21.15.88:0/1761901080 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee8bfff640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee940c94b0 0x7fee940c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee997e3640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee941f5030 0x7fee941f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee98fe2640 1 -- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee941f5030 msgr2=0x7fee941f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee98fe2640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee941f5030 0x7fee941f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee98fe2640 1 -- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee940c94b0 msgr2=0x7fee940c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee98fe2640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee940c94b0 0x7fee940c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee98fe2640 1 -- 172.21.15.88:0/1761901080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee940c9940 con 0x7fee940ad0f0 2023-11-20T07:02:44.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee98fe2640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee940ad0f0 0x7fee941f1a70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fee900119d0 tx=0x7fee90011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:44.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee897fa640 1 -- 172.21.15.88:0/1761901080 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9000fb50 con 0x7fee940ad0f0 2023-11-20T07:02:44.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee897fa640 1 -- 172.21.15.88:0/1761901080 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9000fcb0 con 0x7fee940ad0f0 2023-11-20T07:02:44.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee897fa640 1 -- 172.21.15.88:0/1761901080 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90014440 con 0x7fee940ad0f0 2023-11-20T07:02:44.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee9b246640 1 -- 172.21.15.88:0/1761901080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee940c5860 con 0x7fee940ad0f0 2023-11-20T07:02:44.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.417+0000 7fee9b246640 1 -- 172.21.15.88:0/1761901080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee940c8650 con 0x7fee940ad0f0 2023-11-20T07:02:44.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.421+0000 7fee9b246640 1 -- 172.21.15.88:0/1761901080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee940c88d0 con 0x7fee940ad0f0 2023-11-20T07:02:44.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.421+0000 7fee897fa640 1 -- 172.21.15.88:0/1761901080 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fee900145a0 con 0x7fee940ad0f0 2023-11-20T07:02:44.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.421+0000 7fee897fa640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fee800664a0 0x7fee80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.421+0000 7fee897fa640 1 -- 172.21.15.88:0/1761901080 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fee90084590 con 0x7fee940ad0f0 2023-11-20T07:02:44.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.421+0000 7fee8bfff640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fee800664a0 0x7fee80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.421+0000 7fee8bfff640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fee800664a0 0x7fee80068960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fee9415a250 tx=0x7fee84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:44.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.425+0000 7fee897fa640 1 -- 172.21.15.88:0/1761901080 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fee90051c80 con 0x7fee940ad0f0 2023-11-20T07:02:44.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 -- 172.21.15.88:0/1761901080 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fee9415b8a0 con 0x7fee800664a0 2023-11-20T07:02:44.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee897fa640 1 -- 172.21.15.88:0/1761901080 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fee840056d0 con 0x7fee800664a0 2023-11-20T07:02:44.577 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 7 to deep-scrub 2023-11-20T07:02:44.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 -- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fee800664a0 msgr2=0x7fee80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fee800664a0 0x7fee80068960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fee9415a250 tx=0x7fee84009040 comp rx=0 tx=0).stop 2023-11-20T07:02:44.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 -- 172.21.15.88:0/1761901080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee940ad0f0 msgr2=0x7fee941f1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee940ad0f0 0x7fee941f1a70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fee900119d0 tx=0x7fee90011e90 comp rx=0 tx=0).stop 2023-11-20T07:02:44.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 -- 172.21.15.88:0/1761901080 shutdown_connections 2023-11-20T07:02:44.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fee800664a0 0x7fee80068960 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee941f5030 0x7fee941f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee940c94b0 0x7fee940c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 --2- 172.21.15.88:0/1761901080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee940ad0f0 0x7fee941f1a70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 -- 172.21.15.88:0/1761901080 >> 172.21.15.88:0/1761901080 conn(0x7fee9406c190 msgr2=0x7fee9415d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:44.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 -- 172.21.15.88:0/1761901080 shutdown_connections 2023-11-20T07:02:44.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.577+0000 7fee9b246640 1 -- 172.21.15.88:0/1761901080 wait complete. 2023-11-20T07:02:44.599 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T07:02:44.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b0ce09640 1 Processor -- start 2023-11-20T07:02:44.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b0ce09640 1 -- start start 2023-11-20T07:02:44.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b0ce09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0815cb90 0x7f5b080cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b0ce09640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5b080d15d0 0x7f5b080c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b0ce09640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b080ce770 con 0x7f5b080d3010 2023-11-20T07:02:44.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b0ce09640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b080d0600 con 0x7f5b080d15d0 2023-11-20T07:02:44.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b0ce09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080c6450 con 0x7f5b0815cb90 2023-11-20T07:02:44.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5afdd9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5b080d3010 0x7f5b080d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55950/0 (socket says 172.21.15.88:55950) 2023-11-20T07:02:44.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b06d9d640 1 --2- 172.21.15.88:0/4149407189 >> v2:172.21.15.88:3300/0 conn(0x7f5b080d15d0 0x7f5b080c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5afdd9b640 1 -- 172.21.15.88:0/4149407189 learned_addr learned my addr 172.21.15.88:0/4149407189 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:02:44.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b0659c640 1 --2- 172.21.15.88:0/4149407189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0815cb90 0x7f5b080cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b06d9d640 1 -- 172.21.15.88:0/4149407189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0815cb90 msgr2=0x7f5b080cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:02:44.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b06d9d640 1 --2- 172.21.15.88:0/4149407189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0815cb90 0x7f5b080cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b05d9b640 1 -- 172.21.15.88:0/4149407189 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950204637 0 0) 0x7f5b080ce770 con 0x7f5b080d3010 2023-11-20T07:02:44.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b06d9d640 1 -- 172.21.15.88:0/4149407189 >> v1:172.21.15.88:6789/0 conn(0x7f5b080d3010 legacy=0x7f5b080d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.737+0000 7f5b06d9d640 1 -- 172.21.15.88:0/4149407189 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b080d08a0 con 0x7f5b080d15d0 2023-11-20T07:02:44.741 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.741+0000 7f5b06d9d640 1 --2- 172.21.15.88:0/4149407189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b080d15d0 0x7f5b080c6c10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009d90 tx=0x7f5b0001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abbd1f076b97027 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:44.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.741+0000 7f5b05d9b640 1 -- 172.21.15.88:0/4149407189 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b000a5950 con 0x7f5b080d15d0 2023-11-20T07:02:44.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.741+0000 7f5b05d9b640 1 -- 172.21.15.88:0/4149407189 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b000a5ab0 con 0x7f5b080d15d0 2023-11-20T07:02:44.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.741+0000 7f5b05d9b640 1 -- 172.21.15.88:0/4149407189 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b000a5e40 con 0x7f5b080d15d0 2023-11-20T07:02:44.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.741+0000 7f5b0ce09640 1 -- 172.21.15.88:0/4149407189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b080d15d0 msgr2=0x7f5b080c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.741+0000 7f5b0ce09640 1 --2- 172.21.15.88:0/4149407189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b080d15d0 0x7f5b080c6c10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009d90 tx=0x7f5b0001c890 comp rx=0 tx=0).stop 2023-11-20T07:02:44.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.741+0000 7f5b0ce09640 1 -- 172.21.15.88:0/4149407189 shutdown_connections 2023-11-20T07:02:44.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.741+0000 7f5b0ce09640 1 --2- 172.21.15.88:0/4149407189 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b080d15d0 0x7f5b080c6c10 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.741+0000 7f5b0ce09640 1 --2- 172.21.15.88:0/4149407189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0815cb90 0x7f5b080cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.741+0000 7f5b0ce09640 1 -- 172.21.15.88:0/4149407189 >> 172.21.15.88:0/4149407189 conn(0x7f5b0809bc50 msgr2=0x7f5b080d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.741+0000 7f5b0ce09640 1 -- 172.21.15.88:0/4149407189 shutdown_connections 2023-11-20T07:02:44.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.741+0000 7f5b0ce09640 1 -- 172.21.15.88:0/4149407189 wait complete. 2023-11-20T07:02:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b0ce09640 1 Processor -- start 2023-11-20T07:02:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b0ce09640 1 -- start start 2023-11-20T07:02:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b0ce09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b080d15d0 0x7f5b081f8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b0ce09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b080d3010 0x7f5b080cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b0ce09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0815cb90 0x7f5b080b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b0ce09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b080b5520 con 0x7f5b080d3010 2023-11-20T07:02:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b0ce09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b081f88e0 con 0x7f5b080d15d0 2023-11-20T07:02:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b0ce09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b081f8bc0 con 0x7f5b0815cb90 2023-11-20T07:02:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5afdd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b080d3010 0x7f5b080cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5afdd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b080d3010 0x7f5b080cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50276/0 (socket says 172.21.15.88:50276) 2023-11-20T07:02:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5afdd9b640 1 -- 172.21.15.88:0/1923003469 learned_addr learned my addr 172.21.15.88:0/1923003469 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:02:44.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b06d9d640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0815cb90 0x7f5b080b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b0659c640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b080d15d0 0x7f5b081f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5afdd9b640 1 -- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0815cb90 msgr2=0x7f5b080b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5afdd9b640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0815cb90 0x7f5b080b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5afdd9b640 1 -- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b080d15d0 msgr2=0x7f5b081f8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5afdd9b640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b080d15d0 0x7f5b081f8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5afdd9b640 1 -- 172.21.15.88:0/1923003469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b00009a70 con 0x7f5b080d3010 2023-11-20T07:02:44.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b0659c640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b080d15d0 0x7f5b081f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:02:44.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5afdd9b640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b080d3010 0x7f5b080cb8f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5af80011f0 tx=0x7f5af800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:44.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5aff7fe640 1 -- 172.21.15.88:0/1923003469 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af80074e0 con 0x7f5b080d3010 2023-11-20T07:02:44.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5aff7fe640 1 -- 172.21.15.88:0/1923003469 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af8007640 con 0x7f5b080d3010 2023-11-20T07:02:44.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5aff7fe640 1 -- 172.21.15.88:0/1923003469 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8004a10 con 0x7f5b080d3010 2023-11-20T07:02:44.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b0ce09640 1 -- 172.21.15.88:0/1923003469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b081f8ea0 con 0x7f5b080d3010 2023-11-20T07:02:44.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.745+0000 7f5b0ce09640 1 -- 172.21.15.88:0/1923003469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b081f85d0 con 0x7f5b080d3010 2023-11-20T07:02:44.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.749+0000 7f5b0ce09640 1 -- 172.21.15.88:0/1923003469 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b08074010 con 0x7f5b080d3010 2023-11-20T07:02:44.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.749+0000 7f5aff7fe640 1 -- 172.21.15.88:0/1923003469 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5af8004b70 con 0x7f5b080d3010 2023-11-20T07:02:44.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.749+0000 7f5aff7fe640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5ae80664a0 0x7f5ae8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:02:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.749+0000 7f5aff7fe640 1 -- 172.21.15.88:0/1923003469 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5af8083060 con 0x7f5b080d3010 2023-11-20T07:02:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.749+0000 7f5b0659c640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5ae80664a0 0x7f5ae8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:02:44.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.749+0000 7f5b0659c640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5ae80664a0 0x7f5ae8068960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5af0006fd0 tx=0x7f5af0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:02:44.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.753+0000 7f5aff7fe640 1 -- 172.21.15.88:0/1923003469 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5af80b4090 con 0x7f5b080d3010 2023-11-20T07:02:44.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.897+0000 7f5b0ce09640 1 -- 172.21.15.88:0/1923003469 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b0815cf70 con 0x7f5ae80664a0 2023-11-20T07:02:44.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5aff7fe640 1 -- 172.21.15.88:0/1923003469 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50623 (secure 0 0 0) 0x7f5af0009530 con 0x7f5ae80664a0 2023-11-20T07:02:44.902 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:02:44.902 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-20T07:02:44.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5b0ce09640 1 -- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5ae80664a0 msgr2=0x7f5ae8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5b0ce09640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5ae80664a0 0x7f5ae8068960 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5af0006fd0 tx=0x7f5af0008040 comp rx=0 tx=0).stop 2023-11-20T07:02:44.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5b0ce09640 1 -- 172.21.15.88:0/1923003469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b080d3010 msgr2=0x7f5b080cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:02:44.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5b0ce09640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b080d3010 0x7f5b080cb8f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5af80011f0 tx=0x7f5af800c9b0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5b0ce09640 1 -- 172.21.15.88:0/1923003469 shutdown_connections 2023-11-20T07:02:44.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5b0ce09640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f5ae80664a0 0x7f5ae8068960 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5b0ce09640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b0815cb90 0x7f5b080b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5b0ce09640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5b080d3010 0x7f5b080cb8f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5b0ce09640 1 --2- 172.21.15.88:0/1923003469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b080d15d0 0x7f5b081f8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:02:44.904 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5b0ce09640 1 -- 172.21.15.88:0/1923003469 >> 172.21.15.88:0/1923003469 conn(0x7f5b0809bc50 msgr2=0x7f5b0806b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:02:44.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5b0ce09640 1 -- 172.21.15.88:0/1923003469 shutdown_connections 2023-11-20T07:02:44.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:02:44.901+0000 7f5b0ce09640 1 -- 172.21.15.88:0/1923003469 wait complete. 2023-11-20T07:02:44.922 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-11-20T07:02:43.558123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221104,"kb_used_data":4936,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753616,"statfs":{"total":773094113280,"available":772867702784,"internally_reserved":0,"allocated":5054464,"data_stored":2843616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.715900"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-20T07:02:35.483616+0000","last_change":"2023-11-20T07:00:43.158695+0000","last_active":"2023-11-20T07:02:35.483616+0000","last_peered":"2023-11-20T07:02:35.483616+0000","last_clean":"2023-11-20T07:02:35.483616+0000","last_became_active":"2023-11-20T07:00:43.157454+0000","last_became_peered":"2023-11-20T07:00:43.157454+0000","last_unstale":"2023-11-20T07:02:35.483616+0000","last_undegraded":"2023-11-20T07:02:35.483616+0000","last_fullsized":"2023-11-20T07:02:35.483616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-20T07:00:42.001721+0000","last_clean_scrub_stamp":"2023-11-20T07:00:42.001721+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T15:44:20.907460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":798228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.83499999999999996}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.66400000000000003}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.87}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.76200000000000001}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.58099999999999996}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.73799999999999999}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.621},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.60299999999999998}]},{"osd":1,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":2.319,"5min":2.319,"15min":2.319},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":0.52700000000000002}]},{"osd":3,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.4830000000000001,"5min":2.4830000000000001,"15min":2.4830000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.71599999999999997}]},{"osd":4,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.54900000000000004}]},{"osd":5,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.65600000000000003}]},{"osd":7,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.77600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.622}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.58599999999999997}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.7919999999999998,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.65100000000000002}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56699999999999995}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.72299999999999998}]},{"osd":1,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.74099999999999999}]},{"osd":2,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.78700000000000003}]},{"osd":3,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.83899999999999997}]},{"osd":7,"last update":"Mon Nov 20 07:01:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.85299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.34799999999999998}]},{"osd":1,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.48599999999999999}]},{"osd":2,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.502},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.52900000000000003}]},{"osd":4,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.76300000000000001}]},{"osd":5,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.77400000000000002}]},{"osd":6,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.71899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42999999999999999}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.63200000000000001}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.66300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.317},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.59399999999999997}]},{"osd":4,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.434},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.66200000000000003}]},{"osd":5,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.67700000000000005}]},{"osd":6,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Nov 20 07:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.495},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":798228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.40100000000000002}]},{"osd":2,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.503}]},{"osd":3,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.627}]},{"osd":6,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.67200000000000004}]},{"osd":7,"last update":"Mon Nov 20 07:01:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.79600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T07:02:44.927 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-20T07:00:42.001721+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=20, tm_hour=7, tm_min=0, tm_sec=42, tm_wday=0, tm_yday=324, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=20, tm_hour=7, tm_min=2, tm_sec=39, tm_wday=0, tm_yday=324, tm_isdst=0) 2023-11-20T07:02:44.927 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-20T07:02:47.307 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:02:47.311 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:03:04.928 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-20T07:03:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.077+0000 7f2976ec9640 1 Processor -- start 2023-11-20T07:03:05.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.077+0000 7f2976ec9640 1 -- start start 2023-11-20T07:03:05.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.077+0000 7f2976ec9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2970159ba0 0x7f29700cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.077+0000 7f2976ec9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29700c8cb0 0x7f29700cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.077+0000 7f2976ec9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29700723d0 con 0x7f29701597c0 2023-11-20T07:03:05.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.077+0000 7f2976ec9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29700717c0 con 0x7f2970159ba0 2023-11-20T07:03:05.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.077+0000 7f2976ec9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2970071aa0 con 0x7f29700c8cb0 2023-11-20T07:03:05.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.077+0000 7f296ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2970159ba0 0x7f29700cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.081+0000 7f2975466640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29700c8cb0 0x7f29700cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.081+0000 7f296ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2970159ba0 0x7f29700cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:33024/0 (socket says 172.21.15.88:33024) 2023-11-20T07:03:05.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.081+0000 7f296ffff640 1 -- 172.21.15.88:0/2243039464 learned_addr learned my addr 172.21.15.88:0/2243039464 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:03:05.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.081+0000 7f296ffff640 1 -- 172.21.15.88:0/2243039464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29700c8cb0 msgr2=0x7f29700cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:03:05.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.081+0000 7f296ffff640 1 --2- 172.21.15.88:0/2243039464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29700c8cb0 0x7f29700cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.081+0000 7f296ffff640 1 -- 172.21.15.88:0/2243039464 >> v1:172.21.15.175:6789/0 conn(0x7f29701597c0 legacy=0x7f29700ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.081+0000 7f296ffff640 1 -- 172.21.15.88:0/2243039464 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2970071d80 con 0x7f2970159ba0 2023-11-20T07:03:05.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.081+0000 7f296f7fe640 1 -- 172.21.15.88:0/2243039464 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208470836 0 0) 0x7f29700723d0 con 0x7f29701597c0 2023-11-20T07:03:05.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.081+0000 7f296ffff640 1 --2- 172.21.15.88:0/2243039464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2970159ba0 0x7f29700cae10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f295c009870 tx=0x7f295c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=528c01570129436b server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:03:05.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.081+0000 7f296f7fe640 1 -- 172.21.15.88:0/2243039464 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0aa610 con 0x7f2970159ba0 2023-11-20T07:03:05.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.081+0000 7f296f7fe640 1 -- 172.21.15.88:0/2243039464 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c0a6040 con 0x7f2970159ba0 2023-11-20T07:03:05.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.081+0000 7f296f7fe640 1 -- 172.21.15.88:0/2243039464 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0aa990 con 0x7f2970159ba0 2023-11-20T07:03:05.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 -- 172.21.15.88:0/2243039464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2970159ba0 msgr2=0x7f29700cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 --2- 172.21.15.88:0/2243039464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2970159ba0 0x7f29700cae10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f295c009870 tx=0x7f295c01c510 comp rx=0 tx=0).stop 2023-11-20T07:03:05.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 -- 172.21.15.88:0/2243039464 shutdown_connections 2023-11-20T07:03:05.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 --2- 172.21.15.88:0/2243039464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29700c8cb0 0x7f29700cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 --2- 172.21.15.88:0/2243039464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2970159ba0 0x7f29700cae10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 -- 172.21.15.88:0/2243039464 >> 172.21.15.88:0/2243039464 conn(0x7f297006c190 msgr2=0x7f297006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:03:05.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 -- 172.21.15.88:0/2243039464 shutdown_connections 2023-11-20T07:03:05.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 -- 172.21.15.88:0/2243039464 wait complete. 2023-11-20T07:03:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 Processor -- start 2023-11-20T07:03:05.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 -- start start 2023-11-20T07:03:05.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29700c8cb0 0x7f2970156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29701597c0 0x7f297015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2970159ba0 0x7f2970157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297015b7d0 con 0x7f2970159ba0 2023-11-20T07:03:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297015ae70 con 0x7f29701597c0 2023-11-20T07:03:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2976ec9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297015b110 con 0x7f29700c8cb0 2023-11-20T07:03:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2975466640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2970159ba0 0x7f2970157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2974c65640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29700c8cb0 0x7f2970156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f296ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29701597c0 0x7f297015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2975466640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2970159ba0 0x7f2970157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50344/0 (socket says 172.21.15.88:50344) 2023-11-20T07:03:05.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.085+0000 7f2975466640 1 -- 172.21.15.88:0/1342346217 learned_addr learned my addr 172.21.15.88:0/1342346217 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:03:05.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f2975466640 1 -- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29700c8cb0 msgr2=0x7f2970156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f2975466640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29700c8cb0 0x7f2970156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f2975466640 1 -- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29701597c0 msgr2=0x7f297015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f2975466640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29701597c0 0x7f297015bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f2975466640 1 -- 172.21.15.88:0/1342346217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c0094d0 con 0x7f2970159ba0 2023-11-20T07:03:05.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f2974c65640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29700c8cb0 0x7f2970156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-20T07:03:05.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f2975466640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2970159ba0 0x7f2970157fb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f296800efc0 tx=0x7f296800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:03:05.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f296d7fa640 1 -- 172.21.15.88:0/1342346217 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968009b10 con 0x7f2970159ba0 2023-11-20T07:03:05.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f296d7fa640 1 -- 172.21.15.88:0/1342346217 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296800f040 con 0x7f2970159ba0 2023-11-20T07:03:05.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f296d7fa640 1 -- 172.21.15.88:0/1342346217 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29680146c0 con 0x7f2970159ba0 2023-11-20T07:03:05.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f2976ec9640 1 -- 172.21.15.88:0/1342346217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297015b3f0 con 0x7f2970159ba0 2023-11-20T07:03:05.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f2976ec9640 1 -- 172.21.15.88:0/1342346217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29701584f0 con 0x7f2970159ba0 2023-11-20T07:03:05.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f2976ec9640 1 -- 172.21.15.88:0/1342346217 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297015b910 con 0x7f2970159ba0 2023-11-20T07:03:05.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f296d7fa640 1 -- 172.21.15.88:0/1342346217 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2968014820 con 0x7f2970159ba0 2023-11-20T07:03:05.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f296d7fa640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f29540664d0 0x7f2954068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.089+0000 7f296d7fa640 1 -- 172.21.15.88:0/1342346217 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f29680845f0 con 0x7f2970159ba0 2023-11-20T07:03:05.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.093+0000 7f2974c65640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f29540664d0 0x7f2954068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.093+0000 7f2974c65640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f29540664d0 0x7f2954068990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2964000f70 tx=0x7f2964009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:03:05.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.097+0000 7f296d7fa640 1 -- 172.21.15.88:0/1342346217 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f297015b910 con 0x7f2970159ba0 2023-11-20T07:03:05.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.241+0000 7f2976ec9640 1 -- 172.21.15.88:0/1342346217 --> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29700cb890 con 0x7f29540664d0 2023-11-20T07:03:05.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f296d7fa640 1 -- 172.21.15.88:0/1342346217 <== mgr.4107 v2:172.21.15.175:6832/2500557545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50598 (secure 0 0 0) 0x7f2964001930 con 0x7f29540664d0 2023-11-20T07:03:05.245 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:03:05.245 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-11-20T07:03:05.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f2976ec9640 1 -- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f29540664d0 msgr2=0x7f2954068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f2976ec9640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f29540664d0 0x7f2954068990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2964000f70 tx=0x7f2964009040 comp rx=0 tx=0).stop 2023-11-20T07:03:05.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f2976ec9640 1 -- 172.21.15.88:0/1342346217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2970159ba0 msgr2=0x7f2970157fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f2976ec9640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2970159ba0 0x7f2970157fb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f296800efc0 tx=0x7f296800c490 comp rx=0 tx=0).stop 2023-11-20T07:03:05.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f2976ec9640 1 -- 172.21.15.88:0/1342346217 shutdown_connections 2023-11-20T07:03:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f2976ec9640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f29540664d0 0x7f2954068990 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f2976ec9640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2970159ba0 0x7f2970157fb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f2976ec9640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29701597c0 0x7f297015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f2976ec9640 1 --2- 172.21.15.88:0/1342346217 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29700c8cb0 0x7f2970156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f2976ec9640 1 -- 172.21.15.88:0/1342346217 >> 172.21.15.88:0/1342346217 conn(0x7f297006c190 msgr2=0x7f29700cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:03:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f2976ec9640 1 -- 172.21.15.88:0/1342346217 shutdown_connections 2023-11-20T07:03:05.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.245+0000 7f2976ec9640 1 -- 172.21.15.88:0/1342346217 wait complete. 2023-11-20T07:03:05.265 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-11-20T07:03:03.562312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221088,"kb_used_data":4936,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753632,"statfs":{"total":773094113280,"available":772867719168,"internally_reserved":0,"allocated":5054464,"data_stored":2843616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002501"},"pg_stats":[{"pgid":"1.0","version":"41'119","reported_seq":194,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-20T07:02:44.715027+0000","last_change":"2023-11-20T07:02:44.715027+0000","last_active":"2023-11-20T07:02:44.715027+0000","last_peered":"2023-11-20T07:02:44.715027+0000","last_clean":"2023-11-20T07:02:44.715027+0000","last_became_active":"2023-11-20T07:00:43.157454+0000","last_became_peered":"2023-11-20T07:00:43.157454+0000","last_unstale":"2023-11-20T07:02:44.715027+0000","last_undegraded":"2023-11-20T07:02:44.715027+0000","last_fullsized":"2023-11-20T07:02:44.715027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'119","last_scrub_stamp":"2023-11-20T07:02:44.714854+0000","last_deep_scrub":"41'119","last_deep_scrub_stamp":"2023-11-20T07:02:44.714854+0000","last_clean_scrub_stamp":"2023-11-20T07:02:44.714854+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-21T07:06:11.176156+0000","scrub_duration":0.0064189599999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1077248,"data_stored":798228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.42799999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90900000000000003,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.71399999999999997,"15min":0.71999999999999997},"min":{"1min":0.44600000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84599999999999997,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.82399999999999995}]},{"osd":1,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.50900000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84599999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70099999999999996,"15min":0.70699999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91100000000000003,"5min":1.202,"15min":1.202},"last":0.74299999999999999}]},{"osd":2,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88,"5min":1.171,"15min":1.171},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.755},"min":{"1min":0.51200000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.87,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.77900000000000003}]},{"osd":3,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.753},"min":{"1min":0.625,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82699999999999996,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.82999999999999996,"15min":0.84399999999999997},"min":{"1min":0.55800000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93500000000000005,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.83699999999999997}]},{"osd":4,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.85799999999999998,"5min":1.01,"15min":1.01},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65200000000000002,"15min":0.65300000000000002},"min":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.79600000000000004,"5min":1.016,"15min":1.016},"last":0.76200000000000001}]},{"osd":5,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93999999999999995,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.55900000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81899999999999995,"5min":1.048,"15min":1.048},"last":0.70999999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.75800000000000001,"15min":0.754},"min":{"1min":0.58499999999999996,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92400000000000004,"5min":1.125,"15min":1.125},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.745,"15min":0.753},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.84499999999999997,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.80900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.41399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88200000000000001,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.94199999999999995,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.72399999999999998}]},{"osd":1,"last update":"Mon Nov 20 07:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.55300000000000005,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89700000000000002,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.81299999999999994,"15min":0.84199999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98799999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.58599999999999997}]},{"osd":2,"last update":"Mon Nov 20 07:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.76800000000000002,"15min":0.78300000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95699999999999996,"5min":2.319,"15min":2.319},"last":0.748},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.80300000000000005},"min":{"1min":0.495,"5min":0.438,"15min":0.438},"max":{"1min":0.88,"5min":2.294,"15min":2.294},"last":0.63100000000000001}]},{"osd":3,"last update":"Mon Nov 20 07:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.88600000000000001,"15min":0.91400000000000003},"min":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.026,"5min":2.4830000000000001,"15min":2.4830000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.83799999999999997,"15min":0.85399999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.96699999999999997,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.78600000000000003}]},{"osd":4,"last update":"Mon Nov 20 07:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.47299999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89400000000000002,"5min":1.5,"15min":1.5},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85799999999999998,"5min":1.917,"15min":1.917},"last":0.46800000000000003}]},{"osd":5,"last update":"Mon Nov 20 07:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73099999999999998,"15min":0.73599999999999999},"min":{"1min":0.47299999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.006,"5min":1.46,"15min":1.46},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.52900000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90000000000000002,"5min":1.744,"15min":1.744},"last":0.501}]},{"osd":7,"last update":"Mon Nov 20 07:02:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.80400000000000005,"15min":0.82099999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98599999999999999,"5min":1.274,"15min":1.274},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.81599999999999995,"15min":0.82499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0449999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.56399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.60999999999999999},"min":{"1min":0.45800000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84999999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.51400000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89300000000000002,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.53800000000000003}]},{"osd":1,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88900000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.69199999999999995,"15min":0.69899999999999995},"min":{"1min":0.46100000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.78600000000000003,"5min":1.962,"15min":1.962},"last":0.51400000000000001}]},{"osd":2,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73999999999999999,"15min":0.748},"min":{"1min":0.505,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88600000000000001,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.435,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84199999999999997,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.71299999999999997}]},{"osd":3,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.747,"15min":0.75800000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.872,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91300000000000003,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.73299999999999998}]},{"osd":4,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94299999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.65500000000000003,"15min":0.64800000000000002},"min":{"1min":0.51000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.47799999999999998}]},{"osd":6,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69299999999999995,"15min":0.68799999999999994},"min":{"1min":0.55000000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.53300000000000003,"5min":0.443,"15min":0.443},"max":{"1min":0.90800000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Nov 20 07:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92500000000000004,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88200000000000001,"5min":1.169,"15min":1.169},"last":0.66000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.872,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96199999999999997,"5min":1.208,"15min":1.208},"last":0.57199999999999995}]},{"osd":1,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70199999999999996,"15min":0.71199999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81200000000000006,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81100000000000005,"5min":1.075,"15min":1.075},"last":0.68899999999999995}]},{"osd":2,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69699999999999995,"15min":0.70499999999999996},"min":{"1min":0.48199999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.872,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70299999999999996,"15min":0.70399999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91400000000000003,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.77400000000000002}]},{"osd":3,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.84199999999999997,"5min":1.145,"15min":1.145},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.73099999999999998,"15min":0.73599999999999999},"min":{"1min":0.58199999999999996,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81899999999999995,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85299999999999998,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.503},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94299999999999995,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.45200000000000001}]},{"osd":6,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.502,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":1.266,"15min":1.266},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.103,"5min":1.264,"15min":1.264},"last":0.73499999999999999}]},{"osd":7,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0069999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79300000000000004,"15min":0.79600000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.98799999999999999,"5min":1.284,"15min":1.284},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.504,"15min":0.51900000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.70899999999999996,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.47699999999999998,"15min":0.48799999999999999},"min":{"1min":0.33300000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.497,"5min":1.087,"15min":1.087},"last":0.61399999999999999}]},{"osd":1,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47399999999999998,"15min":0.48199999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.56200000000000006,"5min":1.141,"15min":1.141},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.56000000000000005,"15min":0.57199999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73799999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.56699999999999995,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60899999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76100000000000001,"5min":1.538,"15min":1.538},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.72499999999999998,"15min":0.73299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88300000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.80700000000000005,"15min":0.82499999999999996},"min":{"1min":0.59799999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.90200000000000002,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.80600000000000005,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.86599999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.91300000000000003,"5min":1.659,"15min":1.659},"last":0.80800000000000005}]},{"osd":6,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.85699999999999998,"15min":0.88100000000000001},"min":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.004,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.875},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76800000000000002,"15min":0.78000000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84999999999999998,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.755}]},{"osd":7,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.82199999999999995,"15min":0.83699999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.96699999999999997,"5min":1.778,"15min":1.778},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.84299999999999997,"15min":0.86399999999999999},"min":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.82799999999999996,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.82099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.441,"15min":0.442},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.53400000000000003}]},{"osd":1,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.44600000000000001,"15min":0.45000000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.61099999999999999,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51400000000000001,"15min":0.52200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67800000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.46200000000000002}]},{"osd":3,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74399999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65700000000000003,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.51700000000000002}]},{"osd":4,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":0.78800000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.5309999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.82699999999999996,"15min":0.83499999999999996},"min":{"1min":0.59699999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.026,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.76000000000000001}]},{"osd":5,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.877},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.74099999999999999}]},{"osd":6,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.755,"15min":0.76200000000000001},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97399999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94999999999999996,"5min":0.996,"15min":0.996},"last":0.79400000000000004}]},{"osd":7,"last update":"Mon Nov 20 07:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.73999999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99199999999999999,"5min":1.012,"15min":1.012},"last":0.84299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 20 07:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.432,"15min":0.441},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.62,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.45700000000000002,"15min":0.46300000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57599999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.55100000000000005}]},{"osd":2,"last update":"Mon Nov 20 07:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58399999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52400000000000002,"15min":0.52900000000000003},"min":{"1min":0.40000000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69899999999999995,"5min":1.024,"15min":1.024},"last":0.63800000000000001}]},{"osd":3,"last update":"Mon Nov 20 07:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47499999999999998,"15min":0.48099999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.58999999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.40200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.73699999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.70199999999999996}]},{"osd":4,"last update":"Mon Nov 20 07:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.77000000000000002,"15min":0.79600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.87,"5min":1.853,"15min":1.853},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97599999999999998,"5min":1.339,"15min":1.339},"last":1.018}]},{"osd":5,"last update":"Mon Nov 20 07:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.76700000000000002,"15min":0.78300000000000003},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88800000000000001,"5min":1.177,"15min":1.177},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.51200000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.87,"5min":1.998,"15min":1.998},"last":0.95399999999999996}]},{"osd":6,"last update":"Mon Nov 20 07:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.87,"5min":1.226,"15min":1.226},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.83099999999999996,"15min":0.85099999999999998},"min":{"1min":0.56799999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.97099999999999997,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.0349999999999999}]},{"osd":7,"last update":"Mon Nov 20 07:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78600000000000003,"15min":0.80600000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.89500000000000002,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79900000000000004,"15min":0.81100000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0429999999999999,"5min":1.409,"15min":1.409},"last":1.0509999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1077248,"data_stored":798228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.438,"15min":0.44400000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52000000000000002,"5min":1.004,"15min":1.004},"last":0.376},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56799999999999995}]},{"osd":2,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":0.53600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69099999999999995,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.34300000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66000000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47499999999999998}]},{"osd":3,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79700000000000004,"5min":1.222,"15min":1.222},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.75800000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.59499999999999997}]},{"osd":4,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94999999999999996,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.78200000000000003,"15min":0.79700000000000004},"min":{"1min":0.53200000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93100000000000005,"5min":1.784,"15min":1.784},"last":0.64800000000000002}]},{"osd":5,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.58799999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.091,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.80700000000000005,"15min":0.82099999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.054,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.79500000000000004}]},{"osd":6,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.143,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0309999999999999,"5min":1.514,"15min":1.514},"last":0.66100000000000003}]},{"osd":7,"last update":"Mon Nov 20 07:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.79700000000000004,"15min":0.81100000000000005},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.84199999999999997,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1970000000000001,"5min":1.74,"15min":1.74},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-20T07:03:05.267 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-20T07:03:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.401+0000 7fe4103c5640 1 Processor -- start 2023-11-20T07:03:05.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.401+0000 7fe4103c5640 1 -- start start 2023-11-20T07:03:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.401+0000 7fe4103c5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4080b84e0 0x7fe4080d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.401+0000 7fe4103c5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4080d1670 con 0x7fe40815cba0 2023-11-20T07:03:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe4103c5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4080d1950 con 0x7fe4080d0210 2023-11-20T07:03:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe4103c5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4080d1460 con 0x7fe4080b84e0 2023-11-20T07:03:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe40e161640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe40815cba0 0x7fe4080cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37422/0 (socket says 172.21.15.88:37422) 2023-11-20T07:03:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe40e161640 1 -- 172.21.15.88:0/906535041 learned_addr learned my addr 172.21.15.88:0/906535041 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-11-20T07:03:05.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe40e962640 1 --2- 172.21.15.88:0/906535041 >> v2:172.21.15.88:3300/0 conn(0x7fe4080b84e0 0x7fe4080d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe40d15f640 1 -- 172.21.15.88:0/906535041 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520676293 0 0) 0x7fe4080d1670 con 0x7fe40815cba0 2023-11-20T07:03:05.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe40d15f640 1 -- 172.21.15.88:0/906535041 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3f4003530 con 0x7fe40815cba0 2023-11-20T07:03:05.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe40e962640 1 -- 172.21.15.88:0/906535041 >> v1:172.21.15.175:6789/0 conn(0x7fe4080d0210 legacy=0x7fe4080b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:03:05.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe40e962640 1 -- 172.21.15.88:0/906535041 >> v1:172.21.15.88:6789/0 conn(0x7fe40815cba0 legacy=0x7fe4080cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe40e962640 1 -- 172.21.15.88:0/906535041 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4080d1c30 con 0x7fe4080b84e0 2023-11-20T07:03:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe40e962640 1 --2- 172.21.15.88:0/906535041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4080b84e0 0x7fe4080d0f20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe400009d90 tx=0x7fe40001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d067480d97bd22a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:03:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe40d15f640 1 -- 172.21.15.88:0/906535041 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4000a5940 con 0x7fe4080b84e0 2023-11-20T07:03:05.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe40d15f640 1 -- 172.21.15.88:0/906535041 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4000a5aa0 con 0x7fe4080b84e0 2023-11-20T07:03:05.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.405+0000 7fe40d15f640 1 -- 172.21.15.88:0/906535041 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4000a5e30 con 0x7fe4080b84e0 2023-11-20T07:03:05.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 -- 172.21.15.88:0/906535041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4080b84e0 msgr2=0x7fe4080d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 --2- 172.21.15.88:0/906535041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4080b84e0 0x7fe4080d0f20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe400009d90 tx=0x7fe40001c880 comp rx=0 tx=0).stop 2023-11-20T07:03:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 -- 172.21.15.88:0/906535041 shutdown_connections 2023-11-20T07:03:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 --2- 172.21.15.88:0/906535041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4080b84e0 0x7fe4080d0f20 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 -- 172.21.15.88:0/906535041 >> 172.21.15.88:0/906535041 conn(0x7fe4080719c0 msgr2=0x7fe408071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:03:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 -- 172.21.15.88:0/906535041 shutdown_connections 2023-11-20T07:03:05.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 -- 172.21.15.88:0/906535041 wait complete. 2023-11-20T07:03:05.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 Processor -- start 2023-11-20T07:03:05.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 -- start start 2023-11-20T07:03:05.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4080b84e0 0x7fe408151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080d0210 0x7fe40814a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe40815cba0 0x7fe40814a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080c7e80 con 0x7fe40815cba0 2023-11-20T07:03:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40814d1b0 con 0x7fe4080b84e0 2023-11-20T07:03:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe4103c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe408151780 con 0x7fe4080d0210 2023-11-20T07:03:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe40e962640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe40815cba0 0x7fe40814a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe40e962640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe40815cba0 0x7fe40814a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50358/0 (socket says 172.21.15.88:50358) 2023-11-20T07:03:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe40e962640 1 -- 172.21.15.88:0/1007334534 learned_addr learned my addr 172.21.15.88:0/1007334534 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:03:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe40e161640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4080b84e0 0x7fe408151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.409+0000 7fe40d960640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080d0210 0x7fe40814a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe40e962640 1 -- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080d0210 msgr2=0x7fe40814a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe40e962640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080d0210 0x7fe40814a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe40e962640 1 -- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4080b84e0 msgr2=0x7fe408151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe40e962640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4080b84e0 0x7fe408151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe40e962640 1 -- 172.21.15.88:0/1007334534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400009a70 con 0x7fe40815cba0 2023-11-20T07:03:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe40d960640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080d0210 0x7fe40814a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:03:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe40e962640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe40815cba0 0x7fe40814a910 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe40001a4b0 tx=0x7fe400019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:03:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe3feffd640 1 -- 172.21.15.88:0/1007334534 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4000add90 con 0x7fe40815cba0 2023-11-20T07:03:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe3feffd640 1 -- 172.21.15.88:0/1007334534 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe400009450 con 0x7fe40815cba0 2023-11-20T07:03:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe4103c5640 1 -- 172.21.15.88:0/1007334534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe408151a60 con 0x7fe40815cba0 2023-11-20T07:03:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe3feffd640 1 -- 172.21.15.88:0/1007334534 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4000b9670 con 0x7fe40815cba0 2023-11-20T07:03:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe4103c5640 1 -- 172.21.15.88:0/1007334534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40814a6b0 con 0x7fe40815cba0 2023-11-20T07:03:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe4103c5640 1 -- 172.21.15.88:0/1007334534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe408151f80 con 0x7fe40815cba0 2023-11-20T07:03:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe3feffd640 1 -- 172.21.15.88:0/1007334534 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe4000b97d0 con 0x7fe40815cba0 2023-11-20T07:03:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe3feffd640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe3ec0664a0 0x7fe3ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe3feffd640 1 -- 172.21.15.88:0/1007334534 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe40011f420 con 0x7fe40815cba0 2023-11-20T07:03:05.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.413+0000 7fe40e161640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe3ec0664a0 0x7fe3ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.417+0000 7fe40e161640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe3ec0664a0 0x7fe3ec068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe4040011f0 tx=0x7fe404009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:03:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.417+0000 7fe3feffd640 1 -- 172.21.15.88:0/1007334534 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe408151f80 con 0x7fe40815cba0 2023-11-20T07:03:05.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.577+0000 7fe4103c5640 1 -- 172.21.15.88:0/1007334534 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fe4080c7fc0 con 0x7fe40815cba0 2023-11-20T07:03:05.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.581+0000 7fe3feffd640 1 -- 172.21.15.88:0/1007334534 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe4080c7fc0 con 0x7fe40815cba0 2023-11-20T07:03:05.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.581+0000 7fe3feffd640 1 -- 172.21.15.88:0/1007334534 <== mon.0 v2:172.21.15.88:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe4000ecaf0 con 0x7fe40815cba0 2023-11-20T07:03:05.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.585+0000 7fe4103c5640 1 -- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe3ec0664a0 msgr2=0x7fe3ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.585+0000 7fe4103c5640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe3ec0664a0 0x7fe3ec068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe4040011f0 tx=0x7fe404009040 comp rx=0 tx=0).stop 2023-11-20T07:03:05.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.585+0000 7fe4103c5640 1 -- 172.21.15.88:0/1007334534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe40815cba0 msgr2=0x7fe40814a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.585+0000 7fe4103c5640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe40815cba0 0x7fe40814a910 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe40001a4b0 tx=0x7fe400019620 comp rx=0 tx=0).stop 2023-11-20T07:03:05.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.585+0000 7fe4103c5640 1 -- 172.21.15.88:0/1007334534 shutdown_connections 2023-11-20T07:03:05.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.585+0000 7fe4103c5640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7fe3ec0664a0 0x7fe3ec068960 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.585+0000 7fe4103c5640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080d0210 0x7fe40814a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.585+0000 7fe4103c5640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe40815cba0 0x7fe40814a910 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.585+0000 7fe4103c5640 1 --2- 172.21.15.88:0/1007334534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4080b84e0 0x7fe408151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.585+0000 7fe4103c5640 1 -- 172.21.15.88:0/1007334534 >> 172.21.15.88:0/1007334534 conn(0x7fe4080719c0 msgr2=0x7fe4080d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:03:05.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.585+0000 7fe4103c5640 1 -- 172.21.15.88:0/1007334534 shutdown_connections 2023-11-20T07:03:05.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.585+0000 7fe4103c5640 1 -- 172.21.15.88:0/1007334534 wait complete. 2023-11-20T07:03:05.603 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-20T07:03:05.603 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-20T07:03:05.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.741+0000 7f95517c5640 1 Processor -- start 2023-11-20T07:03:05.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.741+0000 7f95517c5640 1 -- start start 2023-11-20T07:03:05.743 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.741+0000 7f95517c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c160320 0x7f954c0cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.741+0000 7f95517c5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f954c0b16f0 0x7f954c0d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.741+0000 7f95517c5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954c0d30b0 con 0x7f954c0ce5e0 2023-11-20T07:03:05.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.741+0000 7f95517c5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954c0d3390 con 0x7f954c0b16f0 2023-11-20T07:03:05.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.741+0000 7f95517c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c0d3670 con 0x7f954c160320 2023-11-20T07:03:05.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f954c0b16f0 0x7f954c0d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f954c0b16f0 0x7f954c0d14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50372/0 (socket says 172.21.15.88:50372) 2023-11-20T07:03:05.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954b7fe640 1 -- 172.21.15.88:0/3619699892 learned_addr learned my addr 172.21.15.88:0/3619699892 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:03:05.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954affd640 1 --2- 172.21.15.88:0/3619699892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c160320 0x7f954c0cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954a7fc640 1 -- 172.21.15.88:0/3619699892 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852248304 0 0) 0x7f954c0d30b0 con 0x7f954c0ce5e0 2023-11-20T07:03:05.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954b7fe640 1 -- 172.21.15.88:0/3619699892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c160320 msgr2=0x7f954c0cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-20T07:03:05.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954b7fe640 1 --2- 172.21.15.88:0/3619699892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c160320 0x7f954c0cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954b7fe640 1 -- 172.21.15.88:0/3619699892 >> v1:172.21.15.88:6789/0 conn(0x7f954c0ce5e0 legacy=0x7f954c0af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954b7fe640 1 -- 172.21.15.88:0/3619699892 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c0ce0c0 con 0x7f954c0b16f0 2023-11-20T07:03:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954b7fe640 1 --2- 172.21.15.88:0/3619699892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c0b16f0 0x7f954c0d14e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9544009e50 tx=0x7f954401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d4306ed02236dc server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:03:05.747 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954a7fc640 1 -- 172.21.15.88:0/3619699892 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440a5640 con 0x7f954c0b16f0 2023-11-20T07:03:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954a7fc640 1 -- 172.21.15.88:0/3619699892 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f95440a57a0 con 0x7f954c0b16f0 2023-11-20T07:03:05.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.745+0000 7f954a7fc640 1 -- 172.21.15.88:0/3619699892 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440a5b50 con 0x7f954c0b16f0 2023-11-20T07:03:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 -- 172.21.15.88:0/3619699892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c0b16f0 msgr2=0x7f954c0d14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 --2- 172.21.15.88:0/3619699892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c0b16f0 0x7f954c0d14e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9544009e50 tx=0x7f954401c980 comp rx=0 tx=0).stop 2023-11-20T07:03:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 -- 172.21.15.88:0/3619699892 shutdown_connections 2023-11-20T07:03:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 --2- 172.21.15.88:0/3619699892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c0b16f0 0x7f954c0d14e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 --2- 172.21.15.88:0/3619699892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c160320 0x7f954c0cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 -- 172.21.15.88:0/3619699892 >> 172.21.15.88:0/3619699892 conn(0x7f954c09bc50 msgr2=0x7f954c0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:03:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 -- 172.21.15.88:0/3619699892 shutdown_connections 2023-11-20T07:03:05.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 -- 172.21.15.88:0/3619699892 wait complete. 2023-11-20T07:03:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 Processor -- start 2023-11-20T07:03:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 -- start start 2023-11-20T07:03:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f954c0b16f0 0x7f954c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c0ce5e0 0x7f954c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c160320 0x7f954c152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c14ca10 con 0x7f954c160320 2023-11-20T07:03:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c14c710 con 0x7f954c0b16f0 2023-11-20T07:03:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f95517c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954c156600 con 0x7f954c0ce5e0 2023-11-20T07:03:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f954b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c160320 0x7f954c152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f954b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c160320 0x7f954c152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50374/0 (socket says 172.21.15.88:50374) 2023-11-20T07:03:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f954b7fe640 1 -- 172.21.15.88:0/3886746002 learned_addr learned my addr 172.21.15.88:0/3886746002 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-11-20T07:03:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f954affd640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f954c0b16f0 0x7f954c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f9543fff640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c0ce5e0 0x7f954c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f954b7fe640 1 -- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c0ce5e0 msgr2=0x7f954c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f954b7fe640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c0ce5e0 0x7f954c15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f954b7fe640 1 -- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f954c0b16f0 msgr2=0x7f954c1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f954b7fe640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f954c0b16f0 0x7f954c1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f954b7fe640 1 -- 172.21.15.88:0/3886746002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544009b30 con 0x7f954c160320 2023-11-20T07:03:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f954affd640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f954c0b16f0 0x7f954c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:03:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f9543fff640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c0ce5e0 0x7f954c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-20T07:03:05.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.749+0000 7f954b7fe640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c160320 0x7f954c152710 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f95440af040 tx=0x7f9544019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:03:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.753+0000 7f95437fe640 1 -- 172.21.15.88:0/3886746002 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440bd070 con 0x7f954c160320 2023-11-20T07:03:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.753+0000 7f95437fe640 1 -- 172.21.15.88:0/3886746002 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9544009510 con 0x7f954c160320 2023-11-20T07:03:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.753+0000 7f95437fe640 1 -- 172.21.15.88:0/3886746002 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440b88e0 con 0x7f954c160320 2023-11-20T07:03:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.753+0000 7f95517c5640 1 -- 172.21.15.88:0/3886746002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c15cf70 con 0x7f954c160320 2023-11-20T07:03:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.753+0000 7f95517c5640 1 -- 172.21.15.88:0/3886746002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c156b70 con 0x7f954c160320 2023-11-20T07:03:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.753+0000 7f95517c5640 1 -- 172.21.15.88:0/3886746002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954c14cb80 con 0x7f954c160320 2023-11-20T07:03:05.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.753+0000 7f95437fe640 1 -- 172.21.15.88:0/3886746002 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f95440b8a40 con 0x7f954c160320 2023-11-20T07:03:05.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.753+0000 7f95437fe640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f952c0664a0 0x7f952c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-20T07:03:05.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.753+0000 7f95437fe640 1 -- 172.21.15.88:0/3886746002 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f954411ec60 con 0x7f954c160320 2023-11-20T07:03:05.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.753+0000 7f954affd640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f952c0664a0 0x7f952c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-20T07:03:05.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.753+0000 7f954affd640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f952c0664a0 0x7f952c068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f954c15c980 tx=0x7f953c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-20T07:03:05.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.757+0000 7f95437fe640 1 -- 172.21.15.88:0/3886746002 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f95440ec2c0 con 0x7f954c160320 2023-11-20T07:03:05.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 -- 172.21.15.88:0/3886746002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f954c074010 con 0x7f954c160320 2023-11-20T07:03:05.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95437fe640 1 -- 172.21.15.88:0/3886746002 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f95440ef8e0 con 0x7f954c160320 2023-11-20T07:03:05.941 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-11-20T07:03:05.941 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/4055175580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4055175580},{"type":"v1","addr":"172.21.15.175:6836","nonce":4055175580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5060,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3966879465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3966879465},{"type":"v1","addr":"172.21.15.175:6837","nonce":3966879465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5469,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/2725430928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2725430928},{"type":"v1","addr":"172.21.15.88:6834","nonce":2725430928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2351080356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2351080356},{"type":"v1","addr":"172.21.15.88:6835","nonce":2351080356}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[]} 2023-11-20T07:03:05.941 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 20 2023-11-20T07:03:05.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 -- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f952c0664a0 msgr2=0x7f952c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f952c0664a0 0x7f952c068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f954c15c980 tx=0x7f953c008040 comp rx=0 tx=0).stop 2023-11-20T07:03:05.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 -- 172.21.15.88:0/3886746002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c160320 msgr2=0x7f954c152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-20T07:03:05.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c160320 0x7f954c152710 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f95440af040 tx=0x7f9544019720 comp rx=0 tx=0).stop 2023-11-20T07:03:05.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 -- 172.21.15.88:0/3886746002 shutdown_connections 2023-11-20T07:03:05.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:6832/2500557545,v1:172.21.15.175:6833/2500557545] conn(0x7f952c0664a0 0x7f952c068960 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f954c0ce5e0 0x7f954c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f954c160320 0x7f954c152710 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 --2- 172.21.15.88:0/3886746002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f954c0b16f0 0x7f954c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-20T07:03:05.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 -- 172.21.15.88:0/3886746002 >> 172.21.15.88:0/3886746002 conn(0x7f954c09bc50 msgr2=0x7f954c06b110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-20T07:03:05.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 -- 172.21.15.88:0/3886746002 shutdown_connections 2023-11-20T07:03:05.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-11-20T07:03:05.941+0000 7f95517c5640 1 -- 172.21.15.88:0/3886746002 wait complete. 2023-11-20T07:03:05.962 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-20T07:03:05.962 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-20T07:03:05.962 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-20T07:03:05.962 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:05.974 INFO:tasks.ceph.mds.a:Stopped 2023-11-20T07:03:05.974 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-20T07:03:05.974 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:06.030 INFO:tasks.ceph.mds.c:Stopped 2023-11-20T07:03:06.031 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-20T07:03:06.031 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:06.046 INFO:tasks.ceph.mds.b:Stopped 2023-11-20T07:03:06.047 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-20T07:03:06.047 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:06.105 INFO:tasks.ceph.mds.d:Stopped 2023-11-20T07:03:06.105 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-20T07:03:06.106 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-20T07:03:06.106 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:06.158 INFO:tasks.ceph.osd.0:Stopped 2023-11-20T07:03:06.159 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-20T07:03:06.159 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:06.233 INFO:tasks.ceph.osd.1:Stopped 2023-11-20T07:03:06.234 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-20T07:03:06.234 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:06.309 INFO:tasks.ceph.osd.2:Stopped 2023-11-20T07:03:06.309 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-20T07:03:06.310 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:07.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-20T07:03:12.412 INFO:tasks.ceph.osd.3:Stopped 2023-11-20T07:03:12.412 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-20T07:03:12.413 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:12.475 INFO:tasks.ceph.osd.4:Stopped 2023-11-20T07:03:12.475 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-20T07:03:12.475 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:12.568 INFO:tasks.ceph.osd.5:Stopped 2023-11-20T07:03:12.569 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-20T07:03:12.569 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:13.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~6s 2023-11-20T07:03:17.391 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:03:17.395 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:03:18.671 INFO:tasks.ceph.osd.6:Stopped 2023-11-20T07:03:18.671 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-20T07:03:18.671 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:18.735 INFO:tasks.ceph.osd.7:Stopped 2023-11-20T07:03:18.736 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-20T07:03:18.736 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-20T07:03:18.736 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:18.787 INFO:tasks.ceph.mgr.y:Stopped 2023-11-20T07:03:18.788 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-20T07:03:18.788 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:18.843 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-20T07:03:18.844 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-20T07:03:18.845 INFO:tasks.ceph.mgr.x:Stopped 2023-11-20T07:03:18.845 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-20T07:03:18.846 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-20T07:03:18.846 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:18.865 INFO:tasks.ceph.mon.a:Stopped 2023-11-20T07:03:18.866 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-20T07:03:18.866 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:18.881 INFO:tasks.ceph.mon.b:Stopped 2023-11-20T07:03:18.882 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-20T07:03:18.882 INFO:teuthology.orchestra.run:waiting for 300 2023-11-20T07:03:18.938 INFO:tasks.ceph.mon.c:Stopped 2023-11-20T07:03:18.938 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-20T07:03:18.939 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v 'inconsistent rstat on inode' | egrep -v 'Error recovering journal' | head -n 1 2023-11-20T07:03:18.975 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T07:03:18.976 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-20T07:03:19.502 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T07:03:19.505 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-20T07:03:19.666 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T07:03:19.666 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-20T07:03:19.841 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T07:03:19.841 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-20T07:03:20.010 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:03:20.010 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-20T07:03:20.233 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:03:20.233 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-20T07:03:20.426 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:03:20.427 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-20T07:03:20.619 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:03:20.619 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-20T07:03:20.819 INFO:tasks.ceph:Archiving mon data... 2023-11-20T07:03:20.820 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037/data/mon.a.tgz 2023-11-20T07:03:20.820 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-11-20T07:03:20.829 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.JnvIbj7eEV 2023-11-20T07:03:20.829 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JnvIbj7eEV 2023-11-20T07:03:20.950 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.JnvIbj7eEV 2023-11-20T07:03:21.024 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.JnvIbj7eEV is 301KB 2023-11-20T07:03:21.085 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.JnvIbj7eEV 2023-11-20T07:03:21.094 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037/data/mon.b.tgz 2023-11-20T07:03:21.094 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2023-11-20T07:03:21.103 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.ZffbXtqEjY 2023-11-20T07:03:21.104 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ZffbXtqEjY 2023-11-20T07:03:21.245 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.ZffbXtqEjY 2023-11-20T07:03:21.322 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.ZffbXtqEjY is 404KB 2023-11-20T07:03:21.388 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.ZffbXtqEjY 2023-11-20T07:03:21.396 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037/data/mon.c.tgz 2023-11-20T07:03:21.397 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2023-11-20T07:03:21.446 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.jZ1ixF6uYd 2023-11-20T07:03:21.446 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.jZ1ixF6uYd 2023-11-20T07:03:21.587 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.jZ1ixF6uYd 2023-11-20T07:03:21.663 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.jZ1ixF6uYd is 404KB 2023-11-20T07:03:21.728 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.jZ1ixF6uYd 2023-11-20T07:03:21.736 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-20T07:03:21.736 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-20T07:03:21.739 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-20T07:03:21.797 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-20T07:03:21.797 DEBUG:teuthology.orchestra.run.smithi088:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-20T07:03:21.806 DEBUG:teuthology.orchestra.run.smithi175:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-20T07:03:21.845 INFO:teuthology.orchestra.run.smithi088.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-20T07:03:21.872 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-20T07:03:21.879 INFO:tasks.ceph:Archiving crash dumps... 2023-11-20T07:03:21.880 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037/remote/smithi088/crash 2023-11-20T07:03:21.881 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-20T07:03:21.921 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037/remote/smithi175/crash 2023-11-20T07:03:21.922 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-20T07:03:21.945 INFO:tasks.ceph:Shutting down logrotate 2023-11-20T07:03:21.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:03:21.970 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-20T07:03:22.042 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-20T07:03:22.076 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-20T07:03:22.095 INFO:tasks.ceph:Compressing logs... 2023-11-20T07:03:22.096 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-20T07:03:22.122 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-20T07:03:22.146 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49474.log 2023-11-20T07:03:22.147 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45876.log 2023-11-20T07:03:22.148 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48710.log 2023-11-20T07:03:22.148 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49474.log.gz 2023-11-20T07:03:22.149 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48242.log 2023-11-20T07:03:22.149 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45876.log.gz 2023-11-20T07:03:22.150 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44026.log 2023-11-20T07:03:22.150 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48710.log.gz 2023-11-20T07:03:22.151 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43972.log 2023-11-20T07:03:22.151 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48242.log.gz 2023-11-20T07:03:22.152 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46867.log 2023-11-20T07:03:22.152 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44026.log.gz 2023-11-20T07:03:22.153 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43972.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43972.log.gz 2023-11-20T07:03:22.153 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47924.log 2023-11-20T07:03:22.154 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46867.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-20T07:03:22.154 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46867.log.gz 2023-11-20T07:03:22.155 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45928.log 2023-11-20T07:03:22.155 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47924.log.gz 2023-11-20T07:03:22.156 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48580.log 2023-11-20T07:03:22.157 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45928.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45928.log.gz -5 2023-11-20T07:03:22.157 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph.tmp-client.admin.33224.log 2023-11-20T07:03:22.158 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46058.log 87.7% 2023-11-20T07:03:22.158 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48580.log.gz 2023-11-20T07:03:22.159 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.tmp-client.admin.33224.log: 93.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-20T07:03:22.159 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33224.log.gz 2023-11-20T07:03:22.159 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44940.log 2023-11-20T07:03:22.160 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47023.log 2023-11-20T07:03:22.160 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46058.log.gz 2023-11-20T07:03:22.161 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44940.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.44940.log.gz 2023-11-20T07:03:22.161 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45273.log 2023-11-20T07:03:22.162 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48107.log 2023-11-20T07:03:22.163 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47023.log.gz 2023-11-20T07:03:22.164 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48294.log 2023-11-20T07:03:22.164 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45273.log.gz 2023-11-20T07:03:22.165 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44384.log 2023-11-20T07:03:22.165 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48107.log.gz 2023-11-20T07:03:22.165 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38336.log 2023-11-20T07:03:22.166 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48989.log 2023-11-20T07:03:22.166 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48294.log.gz 2023-11-20T07:03:22.168 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-20T07:03:22.168 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38336.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-20T07:03:22.168 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38336.log.gz 2023-11-20T07:03:22.169 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49094.log 2023-11-20T07:03:22.169 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49368.log 88.8% 2023-11-20T07:03:22.169 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48989.log.gz 2023-11-20T07:03:22.170 INFO:teuthology.orchestra.run.smithi088.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.44384.log.gz 2023-11-20T07:03:22.170 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49094.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49094.log.gz 2023-11-20T07:03:22.170 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-20T07:03:22.172 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-20T07:03:22.172 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38240.log 2023-11-20T07:03:22.173 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38216.log 2023-11-20T07:03:22.173 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38240.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38240.log.gz 2023-11-20T07:03:22.173 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-20T07:03:22.174 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49368.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49368.log.gz 2023-11-20T07:03:22.174 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43890.log 2023-11-20T07:03:22.174 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47740.log 2023-11-20T07:03:22.174 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43890.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43890.log.gz 2023-11-20T07:03:22.175 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47075.log 2023-11-20T07:03:22.175 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47740.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47740.log.gz 2023-11-20T07:03:22.175 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50353.log 2023-11-20T07:03:22.175 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47075.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.47075.log.gz --verbose 2023-11-20T07:03:22.175 INFO:teuthology.orchestra.run.smithi088.stderr: -- /var/log/ceph/ceph-client.admin.46971.log 2023-11-20T07:03:22.178 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38216.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-20T07:03:22.178 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38216.log.gz 2023-11-20T07:03:22.179 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38288.log 2023-11-20T07:03:22.179 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-20T07:03:22.179 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38288.log: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-20T07:03:22.179 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38288.log.gz 2023-11-20T07:03:22.179 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-20T07:03:22.180 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47153.log 2023-11-20T07:03:22.181 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50353.log.gz 2023-11-20T07:03:22.181 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46971.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46971.log.gz 2023-11-20T07:03:22.181 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45067.log 2023-11-20T07:03:22.181 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47153.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47153.log.gz 2023-11-20T07:03:22.181 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46555.log 2023-11-20T07:03:22.181 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50797.log 2023-11-20T07:03:22.181 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45067.log.gz 2023-11-20T07:03:22.182 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44992.log 2023-11-20T07:03:22.182 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46555.log.gz 2023-11-20T07:03:22.182 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46084.log 2023-11-20T07:03:22.182 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50797.log.gz 2023-11-20T07:03:22.182 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44992.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.44992.log.gz --verbose 2023-11-20T07:03:22.182 INFO:teuthology.orchestra.run.smithi088.stderr: -- /var/log/ceph/ceph-client.admin.46633.log 2023-11-20T07:03:22.184 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44237.log 2023-11-20T07:03:22.185 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-20T07:03:22.185 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.1.44237.log: 90.4% 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-20T07:03:22.185 INFO:teuthology.orchestra.run.smithi175.stderr: -- replaced with /var/log/ceph/ceph-client.1.44237.log.gz 2023-11-20T07:03:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46084.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.46084.log.gz 2023-11-20T07:03:22.186 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49342.log 2023-11-20T07:03:22.186 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47501.log 2023-11-20T07:03:22.187 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46633.log.gz 2023-11-20T07:03:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49342.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49342.log.gzgzip 2023-11-20T07:03:22.187 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50955.log 2023-11-20T07:03:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44078.log 2023-11-20T07:03:22.187 INFO:teuthology.orchestra.run.smithi088.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47501.log.gz 2023-11-20T07:03:22.187 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50955.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50955.log.gz 2023-11-20T07:03:22.188 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45280.log 2023-11-20T07:03:22.189 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38264.log 2023-11-20T07:03:22.189 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38192.log 2023-11-20T07:03:22.190 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46006.log 2023-11-20T07:03:22.191 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44078.log.gz 2023-11-20T07:03:22.191 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45280.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45280.log.gz 2023-11-20T07:03:22.191 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50849.log 2023-11-20T07:03:22.191 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45472.log 2023-11-20T07:03:22.191 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46006.log.gz 2023-11-20T07:03:22.191 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48159.log 2023-11-20T07:03:22.191 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50849.log.gz 2023-11-20T07:03:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38264.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38264.log.gz 2023-11-20T07:03:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38192.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38192.log.gz 2023-11-20T07:03:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38168.log 2023-11-20T07:03:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-20T07:03:22.195 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45474.log 2023-11-20T07:03:22.195 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45472.log.gz 2023-11-20T07:03:22.196 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48159.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48159.log.gz 2023-11-20T07:03:22.196 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49841.log 2023-11-20T07:03:22.196 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44052.log 2023-11-20T07:03:22.196 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45474.log.gz 2023-11-20T07:03:22.196 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49841.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49841.log.gz 2023-11-20T07:03:22.196 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45850.log 2023-11-20T07:03:22.196 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47610.log 2023-11-20T07:03:22.197 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44052.log.gz 2023-11-20T07:03:22.198 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38168.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38168.log.gz 2023-11-20T07:03:22.199 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.b.log: 91.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-20T07:03:22.199 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38312.log 2023-11-20T07:03:22.200 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47872.log 2023-11-20T07:03:22.200 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45850.log.gz 2023-11-20T07:03:22.200 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47610.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47610.log.gz 2023-11-20T07:03:22.200 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50823.log 2023-11-20T07:03:22.200 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47872.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-20T07:03:22.201 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47872.log.gz 2023-11-20T07:03:22.201 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44647.log 2023-11-20T07:03:22.201 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50823.log.gz 2023-11-20T07:03:22.203 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-20T07:03:22.203 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38312.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38312.log.gz 2023-11-20T07:03:22.203 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44345.log 2023-11-20T07:03:22.204 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49789.log 2023-11-20T07:03:22.204 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44647.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44647.log.gz 2023-11-20T07:03:22.204 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48502.log 2023-11-20T07:03:22.204 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49789.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49789.log.gz 2023-11-20T07:03:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49015.log 2023-11-20T07:03:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48502.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48502.log.gz 2023-11-20T07:03:22.205 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49552.log 2023-11-20T07:03:22.206 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49015.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49015.log.gz 2023-11-20T07:03:22.206 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44490.log 2023-11-20T07:03:22.207 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-20T07:03:22.207 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.3.44345.log: 91.5% -- replaced with /var/log/ceph/ceph-client.3.44345.log.gz 2023-11-20T07:03:22.207 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49552.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.50433.log 2023-11-20T07:03:22.208 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49552.log.gz 2023-11-20T07:03:22.208 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44490.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44490.log.gz 2023-11-20T07:03:22.208 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47423.log 2023-11-20T07:03:22.209 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50433.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50433.log.gz 2023-11-20T07:03:22.209 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45071.log 2023-11-20T07:03:22.210 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47423.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47423.log.gz 2023-11-20T07:03:22.210 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43635.log 2023-11-20T07:03:22.211 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46997.log 88.9% 2023-11-20T07:03:22.211 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45071.log.gz 2023-11-20T07:03:22.212 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43635.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43635.log.gz 2023-11-20T07:03:22.212 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45746.log 2023-11-20T07:03:22.213 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46997.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46997.log.gz 2023-11-20T07:03:22.213 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46893.log 2023-11-20T07:03:22.214 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45746.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-20T07:03:22.214 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45746.log.gz 2023-11-20T07:03:22.215 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46893.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46893.log.gz 2023-11-20T07:03:22.216 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46945.log 2023-11-20T07:03:22.217 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.4.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-20T07:03:22.217 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44756.log 2023-11-20T07:03:22.217 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46945.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46945.log.gz 2023-11-20T07:03:22.218 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44516.log 2023-11-20T07:03:22.219 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46763.log 2023-11-20T07:03:22.220 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44756.log.gz 2023-11-20T07:03:22.220 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44516.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44516.log.gz 2023-11-20T07:03:22.221 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44182.log 2023-11-20T07:03:22.221 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46763.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46763.log.gz 2023-11-20T07:03:22.222 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48268.log 2023-11-20T07:03:22.223 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50232.log 2023-11-20T07:03:22.224 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44182.log.gz 2023-11-20T07:03:22.225 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48268.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2023-11-20T07:03:22.225 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47344.log 2023-11-20T07:03:22.225 INFO:teuthology.orchestra.run.smithi175.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-20T07:03:22.226 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50232.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50232.log.gz 2023-11-20T07:03:22.226 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45479.log 2023-11-20T07:03:22.227 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47976.log 2023-11-20T07:03:22.228 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47344.log.gz 2023-11-20T07:03:22.228 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45479.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45479.log.gz 2023-11-20T07:03:22.229 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49308.log 2023-11-20T07:03:22.230 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47976.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47976.log.gz 2023-11-20T07:03:22.230 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47205.log 2023-11-20T07:03:22.231 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44438.log 2023-11-20T07:03:22.232 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49308.log.gz 2023-11-20T07:03:22.233 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47205.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.44258.log 2023-11-20T07:03:22.233 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47205.log.gz 2023-11-20T07:03:22.234 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44438.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44438.log.gz 2023-11-20T07:03:22.234 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44104.log 2023-11-20T07:03:22.236 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45059.log 2023-11-20T07:03:22.236 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44258.log.gz 2023-11-20T07:03:22.237 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44104.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44104.log.gz 2023-11-20T07:03:22.237 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45064.log 2023-11-20T07:03:22.239 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45059.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45059.log.gz 2023-11-20T07:03:22.239 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50310.log 2023-11-20T07:03:22.240 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45064.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45064.log.gz 2023-11-20T07:03:22.240 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45482.log 2023-11-20T07:03:22.241 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48554.log 2023-11-20T07:03:22.242 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50310.log.gz 2023-11-20T07:03:22.242 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45482.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45482.log.gz 2023-11-20T07:03:22.243 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50407.log 2023-11-20T07:03:22.244 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48554.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48554.log.gz 2023-11-20T07:03:22.244 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47240.log 2023-11-20T07:03:22.245 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50407.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50407.log.gz 2023-11-20T07:03:22.245 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44208.log 2023-11-20T07:03:22.247 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47818.log 2023-11-20T07:03:22.247 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47240.log.gz 2023-11-20T07:03:22.248 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44208.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44208.log.gz 2023-11-20T07:03:22.248 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45694.log 2023-11-20T07:03:22.249 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48372.log 2023-11-20T07:03:22.250 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45694.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47818.log.gz 2023-11-20T07:03:22.251 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45694.log.gz 2023-11-20T07:03:22.251 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48658.log 2023-11-20T07:03:22.252 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48372.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48372.log.gz 2023-11-20T07:03:22.252 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47292.log 2023-11-20T07:03:22.253 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44834.log 2023-11-20T07:03:22.254 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48658.log.gz 2023-11-20T07:03:22.254 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47292.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47292.log.gz 2023-11-20T07:03:22.255 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49146.log 2023-11-20T07:03:22.256 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50875.log 2023-11-20T07:03:22.256 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44834.log.gz 2023-11-20T07:03:22.257 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49146.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49146.log.gz 2023-11-20T07:03:22.257 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46292.log 2023-11-20T07:03:22.258 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48762.log 2023-11-20T07:03:22.259 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50875.log.gz 2023-11-20T07:03:22.260 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.46292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48866.log 2023-11-20T07:03:22.260 INFO:teuthology.orchestra.run.smithi088.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.46292.log.gz 2023-11-20T07:03:22.261 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48762.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48762.log.gz 2023-11-20T07:03:22.261 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50083.log 2023-11-20T07:03:22.262 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46737.log 2023-11-20T07:03:22.263 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48866.log.gz 2023-11-20T07:03:22.264 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50083.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50083.log.gz 2023-11-20T07:03:22.264 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48029.log 2023-11-20T07:03:22.265 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49448.log 2023-11-20T07:03:22.265 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46737.log.gz 2023-11-20T07:03:22.266 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48029.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48029.log.gz 2023-11-20T07:03:22.267 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49041.log 2023-11-20T07:03:22.267 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49448.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49448.log.gz 2023-11-20T07:03:22.268 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47475.log 2023-11-20T07:03:22.269 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44542.log 2023-11-20T07:03:22.269 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49041.log.gz 2023-11-20T07:03:22.270 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47475.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47475.log.gz 2023-11-20T07:03:22.270 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43838.log 2023-11-20T07:03:22.271 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44542.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-20T07:03:22.272 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44542.log.gz 2023-11-20T07:03:22.273 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43838.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43838.log.gz 2023-11-20T07:03:22.273 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48684.log 2023-11-20T07:03:22.274 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50693.log 2023-11-20T07:03:22.276 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50459.log 2023-11-20T07:03:22.276 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48684.log.gz 2023-11-20T07:03:22.277 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46032.log 2023-11-20T07:03:22.277 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50693.log.gz 2023-11-20T07:03:22.279 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48055.log 2023-11-20T07:03:22.279 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50459.log.gz 2023-11-20T07:03:22.280 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46032.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46032.log.gz 2023-11-20T07:03:22.280 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49953.log 2023-11-20T07:03:22.282 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48055.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.48055.log.gz 2023-11-20T07:03:22.282 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47527.log 2023-11-20T07:03:22.283 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45065.log 2023-11-20T07:03:22.284 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49953.log.gz 2023-11-20T07:03:22.284 INFO:teuthology.orchestra.run.smithi175.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-20T07:03:22.284 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47527.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.47527.log.gz -5 2023-11-20T07:03:22.285 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43733.log 2023-11-20T07:03:22.286 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45798.log 2023-11-20T07:03:22.286 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45065.log.gz 2023-11-20T07:03:22.288 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43733.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.43733.log.gz --verbose 2023-11-20T07:03:22.288 INFO:teuthology.orchestra.run.smithi088.stderr: -- /var/log/ceph/ceph-client.admin.48788.log 2023-11-20T07:03:22.289 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45798.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45798.log.gz 2023-11-20T07:03:22.289 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47558.log 2023-11-20T07:03:22.290 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49709.log 2023-11-20T07:03:22.291 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48788.log.gz 2023-11-20T07:03:22.292 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47558.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47558.log.gz 2023-11-20T07:03:22.292 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48736.log 2023-11-20T07:03:22.294 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.49709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48528.log 2023-11-20T07:03:22.294 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.0.49709.log.gz 2023-11-20T07:03:22.295 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45263.log 2023-11-20T07:03:22.295 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48736.log.gz 2023-11-20T07:03:22.296 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47049.log 2023-11-20T07:03:22.297 INFO:teuthology.orchestra.run.smithi088.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48528.log.gz 2023-11-20T07:03:22.298 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48320.log 2023-11-20T07:03:22.298 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45263.log.gz 2023-11-20T07:03:22.299 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48450.log 2023-11-20T07:03:22.299 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47049.log.gz 2023-11-20T07:03:22.300 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48320.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48320.log.gz 2023-11-20T07:03:22.301 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49500.log 2023-11-20T07:03:22.302 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50284.log 2023-11-20T07:03:22.302 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48450.log.gz 2023-11-20T07:03:22.304 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44914.log 2023-11-20T07:03:22.304 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49500.log.gz 2023-11-20T07:03:22.305 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46841.log 2023-11-20T07:03:22.305 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50284.log.gz 2023-11-20T07:03:22.307 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44914.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-20T07:03:22.307 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44914.log.gz 2023-11-20T07:03:22.308 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48814.log 2023-11-20T07:03:22.308 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46841.log.gz 2023-11-20T07:03:22.309 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48002.log 2023-11-20T07:03:22.311 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50195.log 2023-11-20T07:03:22.311 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48814.log.gz 2023-11-20T07:03:22.312 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48133.log 2023-11-20T07:03:22.313 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48002.log.gz 2023-11-20T07:03:22.314 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49604.log 2023-11-20T07:03:22.314 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50195.log.gz 2023-11-20T07:03:22.315 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48133.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48133.log.gz 2023-11-20T07:03:22.315 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50485.log 2023-11-20T07:03:22.317 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50511.log 2023-11-20T07:03:22.317 INFO:teuthology.orchestra.run.smithi088.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.49604.log.gz 2023-11-20T07:03:22.319 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50485.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50485.log.gz 2023-11-20T07:03:22.319 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43812.log 2023-11-20T07:03:22.320 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50511.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50511.log.gz 2023-11-20T07:03:22.321 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47101.log 2023-11-20T07:03:22.322 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49867.log 2023-11-20T07:03:22.322 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43812.log.gz 2023-11-20T07:03:22.323 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47266.log 2023-11-20T07:03:22.323 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47101.log.gz 2023-11-20T07:03:22.324 INFO:teuthology.orchestra.run.smithi175.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-20T07:03:22.325 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49867.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49867.log.gz 2023-11-20T07:03:22.325 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50005.log 2023-11-20T07:03:22.326 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48476.log 2023-11-20T07:03:22.326 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47266.log.gz 2023-11-20T07:03:22.327 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49224.log 2023-11-20T07:03:22.328 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50005.log.gz 2023-11-20T07:03:22.329 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48190.log 2023-11-20T07:03:22.329 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48476.log.gz 2023-11-20T07:03:22.330 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45265.log 2023-11-20T07:03:22.330 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49224.log.gz 2023-11-20T07:03:22.332 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49901.log 2023-11-20T07:03:22.332 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48190.log.gz 2023-11-20T07:03:22.333 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44595.log 2023-11-20T07:03:22.333 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45265.log.gz 2023-11-20T07:03:22.335 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45055.log 2023-11-20T07:03:22.335 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49901.log.gz 2023-11-20T07:03:22.336 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47688.log 2023-11-20T07:03:22.336 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44595.log.gz 2023-11-20T07:03:22.338 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48216.log 2023-11-20T07:03:22.338 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45055.log.gz 2023-11-20T07:03:22.339 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45824.log 2023-11-20T07:03:22.339 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47688.log.gz 2023-11-20T07:03:22.340 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44888.log 2023-11-20T07:03:22.341 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48216.log.gz 2023-11-20T07:03:22.342 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48892.log 2023-11-20T07:03:22.342 INFO:teuthology.orchestra.run.smithi088.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45824.log.gz 2023-11-20T07:03:22.343 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47127.log 2023-11-20T07:03:22.343 INFO:teuthology.orchestra.run.smithi088.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44888.log.gz 2023-11-20T07:03:22.345 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49250.log 2023-11-20T07:03:22.345 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48892.log.gz 2023-11-20T07:03:22.346 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44782.log 2023-11-20T07:03:22.346 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47127.log.gz 2023-11-20T07:03:22.348 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45271.log 2023-11-20T07:03:22.348 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49250.log.gz 2023-11-20T07:03:22.349 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44782.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44782.log.gz 2023-11-20T07:03:22.349 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43918.log 2023-11-20T07:03:22.351 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47662.log 2023-11-20T07:03:22.351 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45271.log.gz 2023-11-20T07:03:22.352 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43918.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-20T07:03:22.352 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43918.log.gz 2023-11-20T07:03:22.353 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47662.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47662.log.gz 2023-11-20T07:03:22.355 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.log: 85.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-20T07:03:22.356 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47792.log 2023-11-20T07:03:22.357 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44699.log 2023-11-20T07:03:22.359 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50135.log 2023-11-20T07:03:22.359 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47792.log.gz 2023-11-20T07:03:22.360 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44568.log 2023-11-20T07:03:22.361 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44699.log.gz 2023-11-20T07:03:22.362 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47179.log 2023-11-20T07:03:22.362 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50135.log.gz 2023-11-20T07:03:22.364 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47584.log 2023-11-20T07:03:22.364 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44568.log.gz 2023-11-20T07:03:22.366 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47179.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47179.log.gz 2023-11-20T07:03:22.366 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44862.log 2023-11-20T07:03:22.366 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47584.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47584.log.gz 2023-11-20T07:03:22.367 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46497.log 2023-11-20T07:03:22.368 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44621.log 2023-11-20T07:03:22.369 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44862.log.gz 2023-11-20T07:03:22.369 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46497.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46497.log.gz 2023-11-20T07:03:22.371 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44621.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44621.log.gz 2023-11-20T07:03:22.371 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44966.log 2023-11-20T07:03:22.373 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49526.log 2023-11-20T07:03:22.374 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45276.log 2023-11-20T07:03:22.375 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44966.log.gz 2023-11-20T07:03:22.376 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38252.log 2023-11-20T07:03:22.376 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49526.log.gz 2023-11-20T07:03:22.377 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47397.log 2023-11-20T07:03:22.378 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45276.log.gz 2023-11-20T07:03:22.379 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38252.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38252.log.gzgzip 2023-11-20T07:03:22.379 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46471.log 2023-11-20T07:03:22.380 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45485.log 2023-11-20T07:03:22.381 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47397.log.gz 2023-11-20T07:03:22.382 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46471.log: gzip 88.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.46471.log.gz -- 2023-11-20T07:03:22.382 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.admin.49763.log 2023-11-20T07:03:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48346.log 2023-11-20T07:03:22.383 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45485.log.gz 2023-11-20T07:03:22.385 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49198.log 2023-11-20T07:03:22.385 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49763.log.gz 2023-11-20T07:03:22.386 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50745.log 2023-11-20T07:03:22.386 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48346.log.gz 2023-11-20T07:03:22.387 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49198.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49198.log.gz 2023-11-20T07:03:22.388 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45072.log 2023-11-20T07:03:22.389 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38032.log 2023-11-20T07:03:22.389 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50745.log.gz 2023-11-20T07:03:22.391 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45072.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45072.log.gz 2023-11-20T07:03:22.392 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38032.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.38032.log.gz 2023-11-20T07:03:22.392 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46685.log 2023-11-20T07:03:22.394 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45460.log 2023-11-20T07:03:22.395 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43946.log 2023-11-20T07:03:22.396 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46685.log.gz 2023-11-20T07:03:22.397 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49172.log 88.4% 2023-11-20T07:03:22.397 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45460.log.gz 2023-11-20T07:03:22.398 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50771.log 2023-11-20T07:03:22.399 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43946.log.gz 2023-11-20T07:03:22.400 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50589.log 88.8% 2023-11-20T07:03:22.401 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49172.log.gz 2023-11-20T07:03:22.401 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46336.log 2023-11-20T07:03:22.401 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50771.log.gz 2023-11-20T07:03:22.403 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46427.log 2023-11-20T07:03:22.403 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50589.log.gz 2023-11-20T07:03:22.404 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44725.log 2023-11-20T07:03:22.405 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46336.log.gz 2023-11-20T07:03:22.406 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.2.46427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48924.log 2023-11-20T07:03:22.406 INFO:teuthology.orchestra.run.smithi088.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.2.46427.log.gz/var/log/ceph/ceph-client.admin.44725.log: 2023-11-20T07:03:22.407 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44725.log.gz 2023-11-20T07:03:22.408 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48924.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48924.log.gz 2023-11-20T07:03:22.409 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45269.log 2023-11-20T07:03:22.411 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50641.log 2023-11-20T07:03:22.412 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48840.log 2023-11-20T07:03:22.412 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45269.log.gz 2023-11-20T07:03:22.413 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47950.log 2023-11-20T07:03:22.414 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50641.log.gz 2023-11-20T07:03:22.415 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47844.log 2023-11-20T07:03:22.415 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48840.log.gz 2023-11-20T07:03:22.416 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46919.log 2023-11-20T07:03:22.417 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47950.log.gz 2023-11-20T07:03:22.418 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47844.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47844.log.gz 2023-11-20T07:03:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46919.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46919.log.gz 2023-11-20T07:03:22.419 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49280.log 2023-11-20T07:03:22.421 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46711.log 2023-11-20T07:03:22.422 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49280.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-20T07:03:22.423 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49280.log.gz 2023-11-20T07:03:22.423 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46711.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46711.log.gz 2023-11-20T07:03:22.426 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.audit.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-20T07:03:22.427 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47766.log 2023-11-20T07:03:22.428 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-20T07:03:22.430 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49578.log 2023-11-20T07:03:22.430 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47766.log.gz 2023-11-20T07:03:22.433 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.49578.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49578.log.gz 2023-11-20T07:03:22.433 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-20T07:03:22.435 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49394.log 2023-11-20T07:03:22.438 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.49394.log: 91.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-20T07:03:22.438 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49394.log.gz 2023-11-20T07:03:22.438 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45053.log 2023-11-20T07:03:22.440 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50905.log 2023-11-20T07:03:22.441 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45053.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45053.log.gz 2023-11-20T07:03:22.442 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50905.log: 89.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-20T07:03:22.442 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50905.log.gz 2023-11-20T07:03:22.443 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45488.log 2023-11-20T07:03:22.445 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50615.log 2023-11-20T07:03:22.446 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44808.log 2023-11-20T07:03:22.446 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45488.log.gz 2023-11-20T07:03:22.447 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46581.log 2023-11-20T07:03:22.448 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50615.log.gz 2023-11-20T07:03:22.449 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44673.log 2023-11-20T07:03:22.449 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44808.log.gz 2023-11-20T07:03:22.450 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46581.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46581.log.gz 2023-11-20T07:03:22.452 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44673.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44673.log.gz 2023-11-20T07:03:22.452 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47714.log 2023-11-20T07:03:22.454 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50537.log 2023-11-20T07:03:22.455 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48398.log 2023-11-20T07:03:22.455 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47714.log.gz 2023-11-20T07:03:22.457 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50537.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50537.log.gz 2023-11-20T07:03:22.457 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48632.log 2023-11-20T07:03:22.458 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48606.log 2023-11-20T07:03:22.458 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48398.log.gz 2023-11-20T07:03:22.460 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45668.log 89.0% 2023-11-20T07:03:22.460 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48632.log.gz 2023-11-20T07:03:22.461 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48424.log 2023-11-20T07:03:22.461 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48606.log.gz 2023-11-20T07:03:22.462 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45668.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45668.log.gz 2023-11-20T07:03:22.463 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50161.log 2023-11-20T07:03:22.464 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48424.log.gz 2023-11-20T07:03:22.465 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50719.log 2023-11-20T07:03:22.467 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45954.log 2023-11-20T07:03:22.467 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50161.log.gz 2023-11-20T07:03:22.468 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47636.log 2023-11-20T07:03:22.468 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50719.log.gz 2023-11-20T07:03:22.469 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45954.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz 2023-11-20T07:03:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47636.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47636.log.gz 2023-11-20T07:03:22.471 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50057.log 2023-11-20T07:03:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45720.log 2023-11-20T07:03:22.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45980.log 2023-11-20T07:03:22.474 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50057.log.gz 2023-11-20T07:03:22.476 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50031.log 2023-11-20T07:03:22.476 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45720.log.gz 2023-11-20T07:03:22.477 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50563.log 2023-11-20T07:03:22.477 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45980.log.gz 2023-11-20T07:03:22.479 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50031.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.50031.log.gz -5 2023-11-20T07:03:22.479 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45772.log 2023-11-20T07:03:22.479 INFO:teuthology.orchestra.run.smithi088.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-20T07:03:22.480 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50929.log 2023-11-20T07:03:22.480 INFO:teuthology.orchestra.run.smithi088.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50563.log.gz 2023-11-20T07:03:22.481 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45487.log 2023-11-20T07:03:22.481 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45772.log.gz 2023-11-20T07:03:22.482 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50929.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50929.log.gz 2023-11-20T07:03:22.483 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46172.log 2023-11-20T07:03:22.484 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45487.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45487.log.gz 2023-11-20T07:03:22.484 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46815.log 2023-11-20T07:03:22.485 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46172.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46172.log.gz 2023-11-20T07:03:22.486 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49927.log 2023-11-20T07:03:22.487 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46815.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46815.log.gz 2023-11-20T07:03:22.488 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44130.log 2023-11-20T07:03:22.489 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49927.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49927.log.gz 2023-11-20T07:03:22.489 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44156.log 2023-11-20T07:03:22.490 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44130.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44130.log.gz 2023-11-20T07:03:22.491 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49979.log 2023-11-20T07:03:22.492 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44156.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44156.log.gz 2023-11-20T07:03:22.492 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43998.log 2023-11-20T07:03:22.494 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49979.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49979.log.gz 2023-11-20T07:03:22.494 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46529.log 2023-11-20T07:03:22.494 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43998.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43998.log.gz 2023-11-20T07:03:22.495 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50667.log 2023-11-20T07:03:22.496 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46529.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46529.log.gz 2023-11-20T07:03:22.496 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46789.log 2023-11-20T07:03:22.498 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50667.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50667.log.gz 2023-11-20T07:03:22.498 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43668.log 2023-11-20T07:03:22.500 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43577.log 2023-11-20T07:03:22.500 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46789.log.gz 2023-11-20T07:03:22.501 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43668.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43668.log.gz 2023-11-20T07:03:22.502 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49815.log 2023-11-20T07:03:22.503 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45018.log 2023-11-20T07:03:22.503 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43577.log.gz 2023-11-20T07:03:22.504 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49815.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49815.log.gz 2023-11-20T07:03:22.505 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50109.log 2023-11-20T07:03:22.506 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45018.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45018.log.gz 2023-11-20T07:03:22.506 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49422.log 2023-11-20T07:03:22.507 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50109.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50109.log.gz 2023-11-20T07:03:22.507 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49654.log 2023-11-20T07:03:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49422.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49422.log.gz 2023-11-20T07:03:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46607.log 2023-11-20T07:03:22.510 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49654.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49654.log.gz 2023-11-20T07:03:22.511 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48081.log 2023-11-20T07:03:22.512 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50258.log 2023-11-20T07:03:22.512 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46607.log.gz 2023-11-20T07:03:22.513 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.48081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43759.log 2023-11-20T07:03:22.513 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48081.log.gz 2023-11-20T07:03:22.515 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47370.log 2023-11-20T07:03:22.515 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50258.log.gz 2023-11-20T07:03:22.516 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49120.log 2023-11-20T07:03:22.517 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43759.log.gz 2023-11-20T07:03:22.518 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47370.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47370.log.gz 2023-11-20T07:03:22.518 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43864.log 2023-11-20T07:03:22.519 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50381.log 2023-11-20T07:03:22.520 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49120.log.gz 2023-11-20T07:03:22.520 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43864.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43864.log.gz 2023-11-20T07:03:22.521 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47898.log 2023-11-20T07:03:22.521 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50381.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50381.log.gz 2023-11-20T07:03:22.522 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46659.log 2023-11-20T07:03:22.523 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47898.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47898.log.gz 2023-11-20T07:03:22.524 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47318.log 2023-11-20T07:03:22.525 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43786.log 2023-11-20T07:03:22.526 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46659.log.gz 2023-11-20T07:03:22.527 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47318.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47318.log.gz 2023-11-20T07:03:22.527 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49068.log 2023-11-20T07:03:22.527 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45279.log 2023-11-20T07:03:22.529 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43786.log.gz 2023-11-20T07:03:22.529 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49068.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49068.log.gz 2023-11-20T07:03:22.530 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45902.log 2023-11-20T07:03:22.530 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45279.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45279.log.gz 2023-11-20T07:03:22.531 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44464.log 2023-11-20T07:03:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45902.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45902.log.gz 2023-11-20T07:03:22.532 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38150.log 2023-11-20T07:03:22.533 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44464.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44464.log.gz 2023-11-20T07:03:22.534 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47449.log 2023-11-20T07:03:22.535 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.38150.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38150.log.gz 2023-11-20T07:03:22.535 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46111.log 2023-11-20T07:03:22.536 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.47449.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47449.log.gz 2023-11-20T07:03:22.538 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46111.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46111.log.gz 2023-11-20T07:03:22.864 INFO:teuthology.orchestra.run.smithi175.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-20T07:03:22.870 INFO:teuthology.orchestra.run.smithi175.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-20T07:03:22.876 INFO:teuthology.orchestra.run.smithi175.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-20T07:03:22.877 INFO:teuthology.orchestra.run.smithi175.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-20T07:03:22.881 INFO:teuthology.orchestra.run.smithi175.stderr: 2023-11-20T07:03:22.882 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m0.735s 2023-11-20T07:03:22.882 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m2.881s 2023-11-20T07:03:22.882 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m0.281s 2023-11-20T07:03:22.890 INFO:teuthology.orchestra.run.smithi088.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-20T07:03:22.924 INFO:teuthology.orchestra.run.smithi088.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-20T07:03:23.001 INFO:teuthology.orchestra.run.smithi088.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-20T07:03:23.041 INFO:teuthology.orchestra.run.smithi088.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-20T07:03:23.043 INFO:teuthology.orchestra.run.smithi088.stderr: 2023-11-20T07:03:23.043 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m0.917s 2023-11-20T07:03:23.043 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m3.266s 2023-11-20T07:03:23.044 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m0.760s 2023-11-20T07:03:23.045 INFO:tasks.ceph:Archiving logs... 2023-11-20T07:03:23.045 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037/remote/smithi088/log 2023-11-20T07:03:23.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-20T07:03:23.677 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037/remote/smithi175/log 2023-11-20T07:03:23.677 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-20T07:03:23.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-20T07:03:24.044 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-20T07:03:24.053 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-20T07:03:24.054 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-20T07:03:24.057 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-20T07:03:24.141 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-20T07:03:24.151 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-20T07:03:24.151 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-20T07:03:24.155 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-20T07:03:24.167 INFO:teuthology.orchestra.run.smithi088.stdout: remote refid st t when poll reach delay offset jitter 2023-11-20T07:03:24.167 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================== 2023-11-20T07:03:24.167 INFO:teuthology.orchestra.run.smithi088.stdout: hv01.front.sepi 44.4.53.2 2 u 39 64 77 0.053 -0.643 2.062 2023-11-20T07:03:24.167 INFO:teuthology.orchestra.run.smithi088.stdout:*hv02.front.sepi 63.231.80.2 3 u 47 64 77 0.096 +0.657 1.388 2023-11-20T07:03:24.168 INFO:teuthology.orchestra.run.smithi088.stdout: hv03.front.sepi 74.6.168.72 3 u 43 64 77 0.069 +1.507 1.828 2023-11-20T07:03:24.168 INFO:teuthology.orchestra.run.smithi088.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T07:03:24.170 INFO:teuthology.orchestra.run.smithi175.stdout: remote refid st t when poll reach delay offset jitter 2023-11-20T07:03:24.170 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================== 2023-11-20T07:03:24.170 INFO:teuthology.orchestra.run.smithi175.stdout:*hv01.front.sepi 44.4.53.2 2 u 44 64 77 0.103 -1.572 1.319 2023-11-20T07:03:24.170 INFO:teuthology.orchestra.run.smithi175.stdout:+hv02.front.sepi 63.231.80.2 3 u 45 64 77 0.103 +0.679 1.244 2023-11-20T07:03:24.171 INFO:teuthology.orchestra.run.smithi175.stdout:+hv03.front.sepi 74.6.168.72 3 u 51 64 77 0.077 +0.853 1.424 2023-11-20T07:03:24.171 INFO:teuthology.orchestra.run.smithi175.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-20T07:03:24.172 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-20T07:03:24.181 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-20T07:03:24.181 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-20T07:03:24.190 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-20T07:03:24.199 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-20T07:03:24.208 INFO:teuthology.task.internal:Duration was 914.997128 seconds 2023-11-20T07:03:24.208 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-20T07:03:24.217 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-20T07:03:24.218 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-20T07:03:24.221 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-20T07:03:24.320 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-20T07:03:24.320 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2023-11-20T07:03:24.320 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-20T07:03:24.342 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2023-11-20T07:03:24.342 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-20T07:03:24.364 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-20T07:03:24.365 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-20T07:03:24.390 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-20T07:03:24.443 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-20T07:03:24.444 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-20T07:03:24.466 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-20T07:03:24.551 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-20T07:03:24.562 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-20T07:03:24.562 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-20T07:03:24.583 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-20T07:03:24.603 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-20T07:03:24.614 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-20T07:03:24.630 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-20T07:03:24.644 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2023-11-20T07:03:24.663 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2023-11-20T07:03:24.682 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-20T07:03:24.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T07:03:24.715 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-20T07:03:24.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-20T07:03:24.733 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-20T07:03:24.744 INFO:teuthology.task.internal:Transferring archived files... 2023-11-20T07:03:24.745 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037/remote/smithi088 2023-11-20T07:03:24.745 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-20T07:03:24.784 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037/remote/smithi175 2023-11-20T07:03:24.784 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-20T07:03:24.808 INFO:teuthology.task.internal:Removing archive directory... 2023-11-20T07:03:24.809 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-20T07:03:24.826 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-20T07:03:24.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-20T07:03:24.877 INFO:teuthology.task.internal:Not uploading archives. 2023-11-20T07:03:24.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-20T07:03:24.888 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-20T07:03:24.889 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-20T07:03:24.892 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-20T07:03:24.897 INFO:teuthology.orchestra.run.smithi088.stdout: 658042 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 20 07:03 /home/ubuntu/cephtest 2023-11-20T07:03:24.922 INFO:teuthology.orchestra.run.smithi175.stdout: 655428 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 20 07:03 /home/ubuntu/cephtest 2023-11-20T07:03:24.926 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-20T07:03:24.937 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-20T07:03:24.959 INFO:teuthology.nuke:Checking targets against current locks 2023-11-20T07:03:24.986 DEBUG:teuthology.nuke:shortname: smithi088 2023-11-20T07:03:24.987 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-20T07:03:25.011 DEBUG:teuthology.nuke:shortname: smithi175 2023-11-20T07:03:25.011 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-20T07:03:25.015 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-20 06:38:32.304625', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNzpL51gNqz4xUF966H1QvQlmp/+VMXN2RIlr8gUZDJyno4913EymWp34c045bEN3w/DhhH1V92xmMb/ODu7+3o='} 2023-11-20T07:03:25.038 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-20_06:01:31-fs-wip-57087-3-testing-default-smithi/7463037', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-20 06:38:32.302870', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHBmbQcfoU3kC5OuxqTXMlJhKGIZNquLGok3zXFwFEXkZ0hbRaPVhbglq261RhnLLHH/qK6ZOo1dnjrl+PqeFBc='} 2023-11-20T07:03:25.056 INFO:teuthology.orchestra.console.smithi088:Power off 2023-11-20T07:03:25.056 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-20T07:03:25.078 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-11-20T07:03:25.078 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-20T07:03:25.093 INFO:teuthology.orchestra.console.smithi175:Power off 2023-11-20T07:03:25.094 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-20T07:03:25.104 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-11-20T07:03:25.118 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-11-20T07:03:25.118 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-20T07:03:25.140 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-11-20T07:03:29.105 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-20T07:03:29.142 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-20T07:03:29.215 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-11-20T07:03:29.252 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-11-20T07:03:33.220 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-20T07:03:33.253 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-20T07:03:33.330 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-11-20T07:03:33.363 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-11-20T07:03:33.432 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-11-20T07:03:33.464 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-11-20T07:03:33.569 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} duration: 914.9971284866333 failure_reason: 'Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)' flavor: default mon.a-kernel-sha1: 7678e1afe51c4ac0c30e2c032e042c836160928a mon.b-kernel-sha1: 7678e1afe51c4ac0c30e2c032e042c836160928a owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=b9bb5078c7f34f2daffcf8ce1bd3e10a status: fail success: false 2023-11-20T07:03:33.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-20T07:03:33.642 INFO:teuthology.run:FAIL